-- Logs begin at Tue 2022-07-19 10:18:30 UTC, end at Tue 2022-07-19 12:29:52 UTC. -- Jul 19 10:50:25.849713 dv-neutron-master-2-hyperv systemd[1]: Starting Devstack devstack@keystone.service... Jul 19 10:50:25.865016 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 19 10:50:25.868058 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 19 10:50:25 2022] *** Jul 19 10:50:25.868058 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 10:50:25.868058 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 10:50:25.868058 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: nodename: dv-neutron-master-2-hyperv Jul 19 10:50:25.868058 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: machine: x86_64 Jul 19 10:50:25.868058 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: clock source: unix Jul 19 10:50:25.868058 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: pcre jit disabled Jul 19 10:50:25.868058 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: detected number of CPU cores: 4 Jul 19 10:50:25.868058 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: current working directory: / Jul 19 10:50:25.868058 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: detected binary path: /usr/bin/uwsgi-core Jul 19 10:50:25.868854 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: your processes number limit is 47680 Jul 19 10:50:25.868854 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: your memory page size is 4096 bytes Jul 19 10:50:25.868854 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: detected max file descriptor number: 2048 Jul 19 10:50:25.868854 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: lock engine: pthread robust mutexes Jul 19 10:50:25.868854 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: thunder lock: enabled Jul 19 10:50:25.868854 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 19 10:50:25.868854 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 19 10:50:25.915022 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: Python main interpreter initialized at 0x565007e849c0 Jul 19 10:50:25.915022 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: python threads support enabled Jul 19 10:50:25.915022 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: your server socket listen backlog is limited to 100 connections Jul 19 10:50:25.915022 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: your mercy for graceful operations on workers is 90 seconds Jul 19 10:50:25.915565 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 10:50:25.915565 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: *** Operational MODE: preforking *** Jul 19 10:50:25.915939 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: *** uWSGI is running in multiple interpreter mode *** Jul 19 10:50:25.915939 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: spawned uWSGI master process (pid: 80486) Jul 19 10:50:25.916202 dv-neutron-master-2-hyperv systemd[1]: Started Devstack devstack@keystone.service. Jul 19 10:50:25.918222 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: spawned uWSGI worker 1 (pid: 80497, cores: 1) Jul 19 10:50:25.918222 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: spawned uWSGI worker 2 (pid: 80498, cores: 1) Jul 19 10:50:25.918222 dv-neutron-master-2-hyperv devstack@keystone.service[80486]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 10:50:31.428452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 10:50:31.428452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: from cryptography.utils import int_from_bytes Jul 19 10:50:31.429729 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 10:50:31.429729 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: from cryptography.utils import int_from_bytes Jul 19 10:50:31.481471 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 10:50:31.481686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 10:50:31.481847 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] command line args: [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 10:50:31.482125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 10:50:31.482306 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ================================================================================ {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 10:50:31.482564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] admin_token = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.482818 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] config_dir = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.483006 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.483191 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] config_source = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.483382 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] debug = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.483586 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.483958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.484120 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.484385 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.484637 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.484903 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.485086 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] log_config_append = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.485261 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.485443 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] log_dir = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.485613 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] log_file = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.485855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.486111 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.486440 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.486613 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.486786 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.486960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.487178 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.487427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.487664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.487901 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.488137 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.488374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.488621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.488901 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.489181 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.489743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.489937 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] publish_errors = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.490189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.490447 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.490641 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.490969 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.491226 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.491495 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] standard_threads = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.491743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.492013 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.492179 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.492414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] use_journal = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.492560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] use_json = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.492798 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] use_stderr = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.492999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] use_syslog = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.493278 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.493554 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.493815 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.494093 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.494390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.494659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.494932 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.495199 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.495457 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.495718 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.496104 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.496375 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.496638 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.496933 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.497196 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.497461 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.497721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.497987 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.498256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.498528 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.498801 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.499054 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.499333 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.499614 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.499892 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.500148 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.500387 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.500636 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.500919 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.501171 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.501447 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.501714 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.501971 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.502217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.502488 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.502752 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.503049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.503315 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.503555 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.503798 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.504046 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.504290 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.504528 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.504791 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.505032 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.505276 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.505533 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.505770 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.506013 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.506249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.506488 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.506729 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.506982 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.507220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.507463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.507704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.507943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.508185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.508427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.508662 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.508948 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.509209 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.509432 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.509670 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.509938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.510180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.510415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.510658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.510900 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.511175 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.511506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.511738 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.511990 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.512230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.512469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.512708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.512995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.513243 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.513486 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.513731 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.513971 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.514211 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.514449 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.514688 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.514925 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.515194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.515439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.515684 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.515924 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.516166 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.516405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.516643 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.516907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.517143 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.517378 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.517621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.517860 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.518093 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.518340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.518577 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.518833 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.519069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.519330 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.519593 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.519840 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.520076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.external = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.520312 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.520614 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.520878 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.521115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.password = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.521352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.token = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.521869 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.522126 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.522383 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.522622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.522880 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.523137 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.523374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.523614 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.523867 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.524122 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.524376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.524617 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.524892 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.525132 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.525406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.525666 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.525906 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.526164 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.526457 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.526709 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.527015 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.527266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.527528 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.527769 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.528023 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.528275 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.528525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.528782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.529037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.529279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.529539 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.529780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.530040 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.530283 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.530533 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.530776 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.531837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.531837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.531837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.531837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.532238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.532341 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.532575 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.532856 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.533123 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.533363 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.533604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.533838 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.534090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.534346 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.534601 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.534862 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.535113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.535390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.535635 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.535875 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.536112 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.536356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.536589 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.536855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.537103 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.537348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.537603 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.537840 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.538094 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.538347 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.538587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.538842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.539093 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.539347 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.539566 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.539800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.540039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.540278 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.540528 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.540795 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.541037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.541286 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.541537 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.541770 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.542003 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.542254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.542506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.542819 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.543063 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.543302 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.543537 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.543781 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.544046 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.544281 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.544532 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.544808 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.545061 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.545299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.545531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.545770 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.546009 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.546246 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.546481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.546730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.546982 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.547231 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.547489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.547740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.547973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.548222 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.548462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.548700 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.548961 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.549198 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.549446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.549697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.549944 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.550202 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.550437 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.550685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.550926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.551166 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.551403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.551655 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.551904 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.552140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.552382 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.552625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.552909 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.553162 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.553402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.553656 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.553908 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.554147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.554397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.554636 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.554877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.555115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] role.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.555365 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] role.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.555598 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.555850 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.556103 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.556352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.556604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.556880 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.557130 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.557380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.557630 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.557865 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.558113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.558407 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.558659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.558910 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.559354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.559593 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.559847 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.560099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.560350 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.560604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.560882 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.561037 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 10:50:31.561037 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: from cryptography.utils import int_from_bytes Jul 19 10:50:31.561738 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.561885 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 10:50:31.561885 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: from cryptography.utils import int_from_bytes Jul 19 10:50:31.562152 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.562152 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.562152 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.562152 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.562688 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.562688 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.562976 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.563118 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.563273 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.563469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.563706 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.563947 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] token.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.564190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.564443 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.564684 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.564979 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.565233 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.565475 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.565808 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.566065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.566317 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.566558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.566803 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.567039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.567289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.567542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.567775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.568023 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.568331 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.568598 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] database.connection = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.568872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.569127 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.569368 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.569621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.569861 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.570100 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.570338 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.570575 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.570825 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.571063 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.571310 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.571545 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.571797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.572035 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.572282 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.572514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.572815 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.573056 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.573253 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 10:50:31.605023 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.605346 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.605567 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.607559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 10:50:31.607760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 10:50:31.607950 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] command line args: [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 10:50:31.608214 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 10:50:31.608388 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ================================================================================ {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 10:50:31.608635 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] admin_token = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.608904 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] config_dir = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.609088 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.609266 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] config_source = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.609442 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] debug = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.609654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.609885 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.610058 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.610303 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.610555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.610783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.610959 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] log_config_append = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.611131 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.611303 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] log_dir = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.611474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] log_file = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.611704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.611944 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.612181 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.612419 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.612590 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.612783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.613023 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.613262 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.613488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.613715 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.613940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.614121 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.614249 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.614393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.614630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.614900 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.615394 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.615573 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] publish_errors = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.615799 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.616024 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.616229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.616476 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.616705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.616960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] standard_threads = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.617186 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.617423 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.617595 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.617766 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] use_journal = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.617969 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] use_json = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.618144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] use_stderr = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.618314 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] use_syslog = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.618541 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:50:31.618796 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.619060 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.619315 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.619554 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.619798 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.620031 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.620272 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.620503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.620798 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.621078 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.621328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.621559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.621802 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.622033 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.622275 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.622518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.622750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.623045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.623324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.623518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.623785 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.624014 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.624289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.624517 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.624777 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.625034 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.625230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.625476 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.625674 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.625977 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.626176 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.626431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.626628 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.626897 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.627094 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.627361 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.627559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.627819 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.628030 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.628265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.628462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.628700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.628942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.629169 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.629397 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.629643 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.629867 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.630098 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.630322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.630551 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.630778 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.631068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.631297 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.631528 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.631756 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.631989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.632219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.632430 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.632654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.632921 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.633153 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.633389 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.633615 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.633871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.634103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.634329 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.634560 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.634790 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.635074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.635310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.635554 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.635794 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.636025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.636257 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.636622 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.636887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.637119 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.637351 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.637586 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.637818 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.638047 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.638275 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.638504 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.638732 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.639026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.639262 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.639499 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.639736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.639972 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.640287 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.640552 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.640896 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.641124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.641351 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.641576 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.641882 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.642114 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.642352 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.642582 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.642826 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.642979 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.643133 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.643279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.643437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.643585 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.643772 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.644000 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.external = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.644227 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.644521 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.644774 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.645003 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.password = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.645230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.token = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.645466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.645696 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.645937 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.646163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.646405 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.646649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.646885 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.647114 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.647353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.647595 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.647836 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.648066 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.648303 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.648531 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.648816 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.649065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.649295 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.649541 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.649829 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.650070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.650325 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.650560 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.650810 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.651041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.651273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.651511 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.651751 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.652010 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.652254 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.652485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.652751 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.652984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.653234 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.653464 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.653709 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.653937 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.654177 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.654415 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.654646 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.654877 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.655247 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.655481 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.655716 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.655962 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.656211 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.656440 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.656669 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.656920 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.657173 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.657417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.657661 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.657914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.658157 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.658433 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.658668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.658902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.659130 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.659363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.659589 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.659825 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.660066 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.660303 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.660547 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.660798 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.661041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.661283 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.661515 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.661758 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.661999 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.662235 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.662467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.662696 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.662929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.663161 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.663403 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.663633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.663865 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.664109 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.664349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.664575 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.664828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.665069 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.665309 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.665539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.665770 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.665998 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.666220 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.666458 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.666712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.666938 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.667176 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.667417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.667776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.668007 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.668232 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.668460 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.668689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.668940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.669165 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.669404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.669642 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.669886 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.670133 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.670729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.670729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.671030 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.671030 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.671312 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.671457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.671694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.671894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.672158 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.672355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.672620 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.672874 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.673055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.673281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.673521 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.673750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.673988 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.674223 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.674451 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.674681 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.674916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.675159 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.675402 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.675633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.675874 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.676117 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.676345 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.676583 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.676833 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.677067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.677295 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] role.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.677536 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] role.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.677760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.678004 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.678244 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.678529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.678723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.678961 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.679211 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.679450 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.679695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.679923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.680163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.680404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.680643 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.680905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.681336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.681565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.681807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.682048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.682290 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.682533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.682762 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.683010 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.683298 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.683532 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.683759 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.683986 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.684211 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.684455 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.684702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.684970 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.685200 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.685431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.685657 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.685886 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] token.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.686117 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.686357 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.686588 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.686838 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.687089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.687322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.687562 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.687802 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.688043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.688274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.688508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.688761 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.689001 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.689243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.689470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.689714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.690017 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.690271 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] database.connection = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.690509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.690749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.690980 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.691214 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.691442 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.691673 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.691903 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.692133 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.692373 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.692604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.692865 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.693096 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.693339 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.693571 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.693811 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.694035 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.694269 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.694497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:50:31.694664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 10:50:31.722270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.722567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.722720 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.732438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.752037 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.752378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.785595 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.790197 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.836811 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.837164 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.907229 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.907548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.907714 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.907869 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.908041 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.908273 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.924896 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.925204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.939304 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.939588 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.939725 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.939952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.940178 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.940377 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.940550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.952116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.965109 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.965368 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.965546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.965739 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.965979 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.966190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.966350 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.968501 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.968708 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.968919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.969156 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.969365 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.969520 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.982783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.983037 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.983322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.983599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.983854 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.984029 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:31.984182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.984312 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 10:50:31.984449 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.984574 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:31.984738 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 10:50:31.985054 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:31.985317 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:31.985571 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:31.985799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:31.992563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.995531 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.995816 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.995991 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.996200 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.996431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.996625 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.996810 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:50:31.997144 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:31.997432 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:31.997671 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:31.997978 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.006201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.009038 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.009243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 10:50:32.009529 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.009731 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.009731 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 10:50:32.010036 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.010190 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.010358 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.010509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.010655 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.010803 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.010803 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.011100 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.011100 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.011354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.011553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.011783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.012059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.012294 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.026099 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.026392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.026632 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.026960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.035601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.038962 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.039205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.039405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.039621 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.039904 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.040178 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.040439 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.040702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.040963 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.041105 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.041288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.041402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.041536 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.041787 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.046643 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.046924 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.047189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.054561 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.054846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.059536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.059826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.060104 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.060384 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.060657 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.060962 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.061229 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.061481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.068526 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.070204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.070480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.075819 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.076086 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.076363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.080516 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.080839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.083885 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.084167 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.085800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.088755 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.089066 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.089335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.089797 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.089939 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.090024 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.090192 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.090317 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.090566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.090825 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.095624 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.099645 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.103821 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.104121 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.104441 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.105128 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.105447 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.105761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.109807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.110097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.114702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.118330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.118622 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.123674 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.126515 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.126938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.127282 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.127429 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.127557 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.131086 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.131426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.131704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.131973 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.132245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.132509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.136680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.138666 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.138926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.142430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.142716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.143048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.143381 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.143696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.151501 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.151796 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.152090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.152372 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.158035 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.158323 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.158634 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.158938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.159268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.159603 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.159884 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.160189 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.161916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.162182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.165220 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.165493 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.165759 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.166036 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.166303 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.179513 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.179801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.180077 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.180349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.180616 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.180907 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.181030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.181143 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.184678 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.188367 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.190254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.192003 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.192317 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.192637 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.199067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.200974 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.202382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.203056 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.205693 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.206813 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.207132 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.207254 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.207427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.207784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.208871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.209144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.209414 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.216845 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.217658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.217987 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.218298 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.218420 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.221664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.221945 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.222214 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.222476 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.227033 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.227399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.227710 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.228016 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.228289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.228595 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.229222 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.229550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.230181 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.230483 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.230826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.231115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.231426 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.231723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.231915 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.232199 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.232468 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.240352 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:50:32.240654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.240935 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.241198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.241459 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.241728 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.241997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.242255 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.242525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.242779 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.243053 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.243301 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.244758 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.245051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:50:32.270526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x565007e849c0 pid: 80498 (default app) Jul 19 10:50:32.274086 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6367daf-cab8-42e4-a1b2-3a63c6af657b None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:32.274383 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6367daf-cab8-42e4-a1b2-3a63c6af657b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:32.274664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6367daf-cab8-42e4-a1b2-3a63c6af657b None None] PATH_INFO: `/v3` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:32.278988 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Tue Jul 19 10:50:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:50:32.283164 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x565007e849c0 pid: 80497 (default app) Jul 19 10:50:40.063048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44143d-9781-4ee2-9ea8-68f683031af9 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:40.063668 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44143d-9781-4ee2-9ea8-68f683031af9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:40.063668 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44143d-9781-4ee2-9ea8-68f683031af9 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:40.065134 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:50:40.074092 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d48489-3501-4977-a359-9cc8a556c58e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:40.074753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d48489-3501-4977-a359-9cc8a556c58e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:40.074753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d48489-3501-4977-a359-9cc8a556c58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:40.148991 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: INFO dbcounter [None req-e3d48489-3501-4977-a359-9cc8a556c58e None None] Registered counter for database keystone Jul 19 10:50:40.171849 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG oslo_db.sqlalchemy.engines [None req-e3d48489-3501-4977-a359-9cc8a556c58e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 10:50:40.179132 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writer thread running {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 10:50:40.362138 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG passlib.handlers.bcrypt [None req-e3d48489-3501-4977-a359-9cc8a556c58e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80497) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 19 10:50:40.362452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG passlib.handlers.bcrypt [None req-e3d48489-3501-4977-a359-9cc8a556c58e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80497) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 19 10:50:40.419027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e3d48489-3501-4977-a359-9cc8a556c58e None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:50:40.420665 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e3d48489-3501-4977-a359-9cc8a556c58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:50:40.551286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1/3] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:50:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 19 10:50:40.751921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44143d-9781-4ee2-9ea8-68f683031af9 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:40.822147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: INFO dbcounter [None req-7c44143d-9781-4ee2-9ea8-68f683031af9 None None] Registered counter for database keystone Jul 19 10:50:40.842577 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG oslo_db.sqlalchemy.engines [None req-7c44143d-9781-4ee2-9ea8-68f683031af9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 10:50:40.850169 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writer thread running {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 10:50:40.967513 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44143d-9781-4ee2-9ea8-68f683031af9 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:40.972355 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1add8-a1dd-42a7-a966-6ec805324874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:40.973058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1add8-a1dd-42a7-a966-6ec805324874 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:40.973341 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1add8-a1dd-42a7-a966-6ec805324874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:40.973612 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1add8-a1dd-42a7-a966-6ec805324874 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:40.982359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1add8-a1dd-42a7-a966-6ec805324874 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:41.033437 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: WARNING keystone.common.rbac_enforcer.enforcer [None req-92c1add8-a1dd-42a7-a966-6ec805324874 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 19 10:50:41.033699 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1add8-a1dd-42a7-a966-6ec805324874 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:41.043815 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 3/4] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Jul 19 10:50:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 10:50:41.050180 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d48489-3501-4977-a359-9cc8a556c58e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:41.065341 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d48489-3501-4977-a359-9cc8a556c58e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:41.070785 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82d214-c3c1-43eb-ac77-2f5b35f22001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:41.072007 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82d214-c3c1-43eb-ac77-2f5b35f22001 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:41.072288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82d214-c3c1-43eb-ac77-2f5b35f22001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:41.072556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82d214-c3c1-43eb-ac77-2f5b35f22001 admin admin] PATH_INFO: `/v3/projects/4f39c75cf6e84472a01d3e6114767933` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:41.074214 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82d214-c3c1-43eb-ac77-2f5b35f22001 admin admin] RBAC: Authorizing `identity:get_project(project_id=4f39c75cf6e84472a01d3e6114767933)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:41.126814 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5f82d214-c3c1-43eb-ac77-2f5b35f22001 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 19 10:50:41.127145 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82d214-c3c1-43eb-ac77-2f5b35f22001 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:41.131933 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 2/5] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Jul 19 10:50:41 2022] GET /identity/v3/projects/4f39c75cf6e84472a01d3e6114767933 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:50:43.124869 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ebaf8-5dcb-4d10-ac41-846602f903cd None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:43.125438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ebaf8-5dcb-4d10-ac41-846602f903cd None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:43.125438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ebaf8-5dcb-4d10-ac41-846602f903cd None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:43.129514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 4/6] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:50:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:50:43.135286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa5e54-9c92-43d3-826d-e6e0db0060ae None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:43.135698 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa5e54-9c92-43d3-826d-e6e0db0060ae None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:43.135841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa5e54-9c92-43d3-826d-e6e0db0060ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:43.156338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c5aa5e54-9c92-43d3-826d-e6e0db0060ae None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:50:43.157924 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c5aa5e54-9c92-43d3-826d-e6e0db0060ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:50:43.167596 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 3/7] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:50:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 19 10:50:43.190470 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ebaf8-5dcb-4d10-ac41-846602f903cd None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:43.203294 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ebaf8-5dcb-4d10-ac41-846602f903cd None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:43.207978 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab853c34-ba82-49c3-8c1e-d5b5f4dc4e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:43.208626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab853c34-ba82-49c3-8c1e-d5b5f4dc4e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:43.208953 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab853c34-ba82-49c3-8c1e-d5b5f4dc4e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:43.209229 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab853c34-ba82-49c3-8c1e-d5b5f4dc4e78 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:43.217404 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab853c34-ba82-49c3-8c1e-d5b5f4dc4e78 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:43.219199 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab853c34-ba82-49c3-8c1e-d5b5f4dc4e78 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:43.227978 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 5/8] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Jul 19 10:50:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 10:50:43.234316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa5e54-9c92-43d3-826d-e6e0db0060ae None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:43.244123 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa5e54-9c92-43d3-826d-e6e0db0060ae None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:43.249925 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183df750-73af-4912-afac-f3bc27c23eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:43.250810 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183df750-73af-4912-afac-f3bc27c23eca admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:43.251084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183df750-73af-4912-afac-f3bc27c23eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:43.251352 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183df750-73af-4912-afac-f3bc27c23eca admin admin] PATH_INFO: `/v3/users/2c3f1716e28a48c696a1d4a7994e37ba` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:43.252935 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183df750-73af-4912-afac-f3bc27c23eca admin admin] RBAC: Authorizing `identity:get_user(user_id=2c3f1716e28a48c696a1d4a7994e37ba)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:43.254786 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183df750-73af-4912-afac-f3bc27c23eca admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:43.256391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 4/9] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Jul 19 10:50:43 2022] GET /identity/v3/users/2c3f1716e28a48c696a1d4a7994e37ba => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:50:45.347447 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89681711-049c-4aff-837f-9cc335859500 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:45.347995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89681711-049c-4aff-837f-9cc335859500 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:45.347995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89681711-049c-4aff-837f-9cc335859500 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:45.349478 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:50:45.355286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540677a-4860-4503-8443-6a98a032ceed None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:45.355755 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540677a-4860-4503-8443-6a98a032ceed None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:45.355844 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540677a-4860-4503-8443-6a98a032ceed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:45.368439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be622d-f6a2-49a2-ad15-dafbbda5c20d None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:45.368696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be622d-f6a2-49a2-ad15-dafbbda5c20d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:45.370578 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be622d-f6a2-49a2-ad15-dafbbda5c20d None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:45.370957 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 7/11] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:50:45.375062 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4540677a-4860-4503-8443-6a98a032ceed None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:50:45.375752 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415af637-caf7-4789-9951-a9d6a8168203 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:45.376043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415af637-caf7-4789-9951-a9d6a8168203 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:45.376276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4540677a-4860-4503-8443-6a98a032ceed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:50:45.376420 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415af637-caf7-4789-9951-a9d6a8168203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:45.416228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG passlib.handlers.bcrypt [None req-415af637-caf7-4789-9951-a9d6a8168203 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80498) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 19 10:50:45.416652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG passlib.handlers.bcrypt [None req-415af637-caf7-4789-9951-a9d6a8168203 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80498) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 19 10:50:45.461900 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-415af637-caf7-4789-9951-a9d6a8168203 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:50:45.462572 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 5/12] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:50:45.463549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-415af637-caf7-4789-9951-a9d6a8168203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:50:45.491455 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540677a-4860-4503-8443-6a98a032ceed None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:45.516319 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:45.567763 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 8/13] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:50:45.589556 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415af637-caf7-4789-9951-a9d6a8168203 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:45.599138 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540677a-4860-4503-8443-6a98a032ceed None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:45.632182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b555a-20e8-4396-9fde-2c66749b18dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:45.633008 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b555a-20e8-4396-9fde-2c66749b18dc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:45.633288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b555a-20e8-4396-9fde-2c66749b18dc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:45.633560 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b555a-20e8-4396-9fde-2c66749b18dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:45.645516 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b555a-20e8-4396-9fde-2c66749b18dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:50:45.657090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-221b555a-20e8-4396-9fde-2c66749b18dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:50:45.657090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:50:45.657090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:50:45.657090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:50:45.657090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:50:45.657090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:50:45.657090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:50:45.657090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:50:45.657090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:50:45.657090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:50:45.657090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:50:45.657090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:50:45.657090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:50:45.657090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:50:45.657090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:50:45.657090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:50:45.658026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:50:45.658026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:50:45.658026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:50:45.658026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:50:45.658026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:50:45.658026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:50:45.658026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:50:45.658026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:50:45.658026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:50:45.658026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:50:45.658026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:50:45.658026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:50:45.658026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:50:45.658026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:50:45.658026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:50:45.658026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:50:45.658864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:50:45.658864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:50:45.658864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:50:45.658864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:50:45.658864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:50:45.658864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:50:45.658864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:50:45.658864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:50:45.658864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:50:45.658864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:50:45.658864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:50:45.658864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:50:45.658864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 6/14] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:50:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:50:45.664326 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b555a-20e8-4396-9fde-2c66749b18dc None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:45.690516 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415af637-caf7-4789-9951-a9d6a8168203 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:45.692870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:45.727936 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5524f38-f587-48d0-b61a-c18e576aed36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:45.728869 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5524f38-f587-48d0-b61a-c18e576aed36 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:45.729155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5524f38-f587-48d0-b61a-c18e576aed36 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:45.729774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5524f38-f587-48d0-b61a-c18e576aed36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:45.749165 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:45.769939 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b555a-20e8-4396-9fde-2c66749b18dc None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:45.799418 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5524f38-f587-48d0-b61a-c18e576aed36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:45.801065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5524f38-f587-48d0-b61a-c18e576aed36 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:45.805731 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f0bc8-7e6c-4295-857a-09c03d3ec698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:45.806411 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f0bc8-7e6c-4295-857a-09c03d3ec698 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:45.806688 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f0bc8-7e6c-4295-857a-09c03d3ec698 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:45.806961 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f0bc8-7e6c-4295-857a-09c03d3ec698 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:45.807758 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f0bc8-7e6c-4295-857a-09c03d3ec698 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:50:45.808064 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f0bc8-7e6c-4295-857a-09c03d3ec698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:45.809480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f0bc8-7e6c-4295-857a-09c03d3ec698 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:45.821826 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 7/15] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:50:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:50:45.827450 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f0bc8-7e6c-4295-857a-09c03d3ec698 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:45.903831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 9/16] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:50:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 10:50:45.909891 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5524f38-f587-48d0-b61a-c18e576aed36 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:45.912784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:45.928088 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f0bc8-7e6c-4295-857a-09c03d3ec698 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:45.961630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1858bb-6388-48c4-9e4f-9377fa12e2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:45.962509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1858bb-6388-48c4-9e4f-9377fa12e2bb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:45.962788 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1858bb-6388-48c4-9e4f-9377fa12e2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:45.963058 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1858bb-6388-48c4-9e4f-9377fa12e2bb None admin] PATH_INFO: `/v3/users/2c3f1716e28a48c696a1d4a7994e37ba` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:45.964292 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1858bb-6388-48c4-9e4f-9377fa12e2bb None admin] RBAC: Authorizing `identity:get_user(user_id=2c3f1716e28a48c696a1d4a7994e37ba)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:45.966074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1858bb-6388-48c4-9e4f-9377fa12e2bb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:45.967703 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 8/17] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:50:45 2022] GET /identity/v3/users/2c3f1716e28a48c696a1d4a7994e37ba => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:50:45.973037 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1858bb-6388-48c4-9e4f-9377fa12e2bb None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:45.987656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:46.010019 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5524f38-f587-48d0-b61a-c18e576aed36 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:46.042723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d376c-5758-48b3-b0cc-10ad4ce90849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:46.043520 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d376c-5758-48b3-b0cc-10ad4ce90849 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:46.043799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d376c-5758-48b3-b0cc-10ad4ce90849 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:46.044061 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d376c-5758-48b3-b0cc-10ad4ce90849 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:46.065565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d376c-5758-48b3-b0cc-10ad4ce90849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:46.067349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d376c-5758-48b3-b0cc-10ad4ce90849 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:46.079575 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1858bb-6388-48c4-9e4f-9377fa12e2bb None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:46.088490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-8b3d376c-5758-48b3-b0cc-10ad4ce90849 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:50:46.088490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:50:46.088490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:50:46.088490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:50:46.088490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:50:46.088490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:50:46.088490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:50:46.088490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:50:46.088490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:50:46.088490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:50:46.088490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:50:46.088490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:50:46.088490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:50:46.088490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:50:46.088490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:50:46.089390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:50:46.089390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:50:46.089390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:50:46.089390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:50:46.089390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:50:46.089390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:50:46.089390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:50:46.089390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:50:46.089390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:50:46.089390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:50:46.089390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:50:46.089390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:50:46.089390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:50:46.089390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:50:46.089390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:50:46.089390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:50:46.089390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:50:46.090172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:50:46.090172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:50:46.090172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:50:46.090172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:50:46.090172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 10/18] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:50:46.095638 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d376c-5758-48b3-b0cc-10ad4ce90849 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:46.117723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd567c0d-bb54-4532-867d-8950ae20c02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:46.118522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd567c0d-bb54-4532-867d-8950ae20c02c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:46.118808 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd567c0d-bb54-4532-867d-8950ae20c02c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:46.119083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd567c0d-bb54-4532-867d-8950ae20c02c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:46.120349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd567c0d-bb54-4532-867d-8950ae20c02c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:46.121860 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd567c0d-bb54-4532-867d-8950ae20c02c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:46.123495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 9/19] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:50:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:50:46.129541 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd567c0d-bb54-4532-867d-8950ae20c02c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:46.153044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:46.200848 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d376c-5758-48b3-b0cc-10ad4ce90849 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:46.212220 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:46.234811 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd567c0d-bb54-4532-867d-8950ae20c02c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:46.238711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f60ef-8b03-4082-8d76-f1a061582a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:46.239398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f60ef-8b03-4082-8d76-f1a061582a79 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:46.239686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f60ef-8b03-4082-8d76-f1a061582a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:46.239962 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f60ef-8b03-4082-8d76-f1a061582a79 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:46.240743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f60ef-8b03-4082-8d76-f1a061582a79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:50:46.241059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f60ef-8b03-4082-8d76-f1a061582a79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:46.242527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f60ef-8b03-4082-8d76-f1a061582a79 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:46.262859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:50:46.275297 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572506a8-6c53-41b1-bdf2-1f0646f82ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:46.275985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572506a8-6c53-41b1-bdf2-1f0646f82ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:46.276261 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572506a8-6c53-41b1-bdf2-1f0646f82ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:46.276640 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572506a8-6c53-41b1-bdf2-1f0646f82ab1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:46.277578 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572506a8-6c53-41b1-bdf2-1f0646f82ab1 None admin] RBAC: Adding query filter params (role.id=3f9528e7a7914797a4635aa6b536b7ff, scope.domain.id=default, user.id=2c3f1716e28a48c696a1d4a7994e37ba) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:50:46.277891 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572506a8-6c53-41b1-bdf2-1f0646f82ab1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:46.279494 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572506a8-6c53-41b1-bdf2-1f0646f82ab1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:46.288134 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1322 bytes} [Tue Jul 19 10:50:46 2022] GET /identity/v3/role_assignments?user.id=2c3f1716e28a48c696a1d4a7994e37ba&scope.domain.id=default&role.id=3f9528e7a7914797a4635aa6b536b7ff => generated 233 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:50:48.825929 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb0d6c-3ce5-492e-9d86-450015917a48 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:48.826911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb0d6c-3ce5-492e-9d86-450015917a48 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:48.827418 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb0d6c-3ce5-492e-9d86-450015917a48 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:48.829058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:50:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:50:48.834768 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d5c80-33b6-44de-be3c-c3cad55a05e2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:48.835217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d5c80-33b6-44de-be3c-c3cad55a05e2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:48.835322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d5c80-33b6-44de-be3c-c3cad55a05e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:48.857759 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e85d5c80-33b6-44de-be3c-c3cad55a05e2 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:50:48.859282 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e85d5c80-33b6-44de-be3c-c3cad55a05e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:50:48.939960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 11/23] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:50:48.974307 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb0d6c-3ce5-492e-9d86-450015917a48 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:49.118933 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb0d6c-3ce5-492e-9d86-450015917a48 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:49.144346 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:49.164400 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038d8ba-2e92-45b2-b1c4-565225d4dda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:49.165229 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038d8ba-2e92-45b2-b1c4-565225d4dda9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:49.165508 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038d8ba-2e92-45b2-b1c4-565225d4dda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:49.165775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038d8ba-2e92-45b2-b1c4-565225d4dda9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:49.171047 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6299a2-9464-4bce-b9d0-926e79bea7e5 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:49.171600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6299a2-9464-4bce-b9d0-926e79bea7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:49.172065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6299a2-9464-4bce-b9d0-926e79bea7e5 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:49.173673 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:50:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:50:49.182297 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27855ea3-7dac-40c0-8ed6-34c3363ed9e5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:49.183093 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27855ea3-7dac-40c0-8ed6-34c3363ed9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:49.183587 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27855ea3-7dac-40c0-8ed6-34c3363ed9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:49.187538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038d8ba-2e92-45b2-b1c4-565225d4dda9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:50:49.204751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-f038d8ba-2e92-45b2-b1c4-565225d4dda9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:50:49.204751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:50:49.204751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:50:49.204751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:50:49.204751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:50:49.204751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:50:49.204751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:50:49.204751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:50:49.204751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:50:49.204751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:50:49.204751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:50:49.204751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:50:49.204751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:50:49.204751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:50:49.204751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:50:49.204751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:50:49.205625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:50:49.205625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:50:49.205625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:50:49.205625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:50:49.205625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:50:49.205625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:50:49.205625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:50:49.205625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:50:49.205625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:50:49.205625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:50:49.205625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:50:49.205625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:50:49.205625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:50:49.205625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:50:49.205625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:50:49.205625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:50:49.206356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:50:49.206356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:50:49.206356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:50:49.206356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:50:49.206356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:50:49.206356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:50:49.206356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:50:49.206356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:50:49.206356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:50:49.206356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:50:49.206356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:50:49.206356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:50:49.206356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 13/25] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:50:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:50:49.213625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038d8ba-2e92-45b2-b1c4-565225d4dda9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:49.221754 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-27855ea3-7dac-40c0-8ed6-34c3363ed9e5 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:50:49.223569 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-27855ea3-7dac-40c0-8ed6-34c3363ed9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:50:49.339711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 13/26] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:50:49.339711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ba6f0-58e0-4548-85c8-03c6a3b6d166 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:49.339711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ba6f0-58e0-4548-85c8-03c6a3b6d166 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:49.339711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ba6f0-58e0-4548-85c8-03c6a3b6d166 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:49.340078 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 14/27] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:50:49.345578 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a49af-6216-425a-9865-6920d9e4c8f8 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:49.345856 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a49af-6216-425a-9865-6920d9e4c8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:49.346133 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a49af-6216-425a-9865-6920d9e4c8f8 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:49.350171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 15/28] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:50:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:50:49.354703 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc84cf8-55c8-45b9-b76d-6b0dfde05af6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:49.354990 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc84cf8-55c8-45b9-b76d-6b0dfde05af6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:49.355266 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc84cf8-55c8-45b9-b76d-6b0dfde05af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:49.365035 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:49.380432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0cc84cf8-55c8-45b9-b76d-6b0dfde05af6 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:50:49.381578 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0cc84cf8-55c8-45b9-b76d-6b0dfde05af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:50:49.427630 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038d8ba-2e92-45b2-b1c4-565225d4dda9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:49.461045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 16/29] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:50:49.462627 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae2627-84f0-46b0-b378-b755d92b70c0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:49.463120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae2627-84f0-46b0-b378-b755d92b70c0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:49.463639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae2627-84f0-46b0-b378-b755d92b70c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:49.482050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6dae2627-84f0-46b0-b378-b755d92b70c0 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:50:49.483778 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6dae2627-84f0-46b0-b378-b755d92b70c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:50:49.489423 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624f2d2-fca9-4ed9-98e7-5cb195dfa601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:49.490118 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624f2d2-fca9-4ed9-98e7-5cb195dfa601 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:49.490406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624f2d2-fca9-4ed9-98e7-5cb195dfa601 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:49.490682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624f2d2-fca9-4ed9-98e7-5cb195dfa601 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:49.491453 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624f2d2-fca9-4ed9-98e7-5cb195dfa601 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:50:49.491761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624f2d2-fca9-4ed9-98e7-5cb195dfa601 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:49.493262 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624f2d2-fca9-4ed9-98e7-5cb195dfa601 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:49.515743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 14/30] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:50:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:50:49.517366 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624f2d2-fca9-4ed9-98e7-5cb195dfa601 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:49.559814 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 17/31] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:50:49.560865 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae2627-84f0-46b0-b378-b755d92b70c0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:49.561608 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:49.627866 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:49.636511 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624f2d2-fca9-4ed9-98e7-5cb195dfa601 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:49.668955 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae2627-84f0-46b0-b378-b755d92b70c0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:49.676520 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb77ce2-5a26-42be-9d65-d4560be8ea15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:49.677615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb77ce2-5a26-42be-9d65-d4560be8ea15 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:49.678142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb77ce2-5a26-42be-9d65-d4560be8ea15 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:49.678607 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb77ce2-5a26-42be-9d65-d4560be8ea15 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:49.679668 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb77ce2-5a26-42be-9d65-d4560be8ea15 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:49.681433 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb77ce2-5a26-42be-9d65-d4560be8ea15 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:49.708439 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32d65f-b7f6-4473-862f-cffadac4ab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:49.709547 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32d65f-b7f6-4473-862f-cffadac4ab0c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:49.709988 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32d65f-b7f6-4473-862f-cffadac4ab0c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:49.710407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32d65f-b7f6-4473-862f-cffadac4ab0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:49.721895 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32d65f-b7f6-4473-862f-cffadac4ab0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:49.723572 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32d65f-b7f6-4473-862f-cffadac4ab0c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:49.743584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-5d32d65f-b7f6-4473-862f-cffadac4ab0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:50:49.743584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:50:49.743584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:50:49.743584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:50:49.743584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:50:49.743584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:50:49.743584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:50:49.743584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:50:49.743584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:50:49.743584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:50:49.743584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:50:49.743584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:50:49.743584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:50:49.743584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:50:49.743584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:50:49.744457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:50:49.744457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:50:49.744457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:50:49.744457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:50:49.744457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:50:49.744457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:50:49.744457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:50:49.744457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:50:49.744457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:50:49.744457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:50:49.744457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:50:49.744457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:50:49.744457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:50:49.744457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:50:49.744457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:50:49.744457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:50:49.744457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:50:49.745524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:50:49.745524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:50:49.745524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:50:49.745524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:50:49.747305 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 18/32] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:50:49.748284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32d65f-b7f6-4473-862f-cffadac4ab0c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:49.828932 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 15/33] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jul 19 10:50:49 2022] POST /identity/v3/roles => generated 225 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:50:49.830558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb77ce2-5a26-42be-9d65-d4560be8ea15 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:49.905551 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32d65f-b7f6-4473-862f-cffadac4ab0c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:49.965502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:49.983487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:49.994889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb77ce2-5a26-42be-9d65-d4560be8ea15 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:49.997181 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d133924-5e8f-4a1c-8641-7b07106facd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:49.998227 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d133924-5e8f-4a1c-8641-7b07106facd2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:49.998510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d133924-5e8f-4a1c-8641-7b07106facd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:49.998785 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d133924-5e8f-4a1c-8641-7b07106facd2 None admin] PATH_INFO: `/v3/users/2c3f1716e28a48c696a1d4a7994e37ba` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:50.000070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d133924-5e8f-4a1c-8641-7b07106facd2 None admin] RBAC: Authorizing `identity:get_user(user_id=2c3f1716e28a48c696a1d4a7994e37ba)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:50.001602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d133924-5e8f-4a1c-8641-7b07106facd2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:50.004726 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 19/34] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:50:49 2022] GET /identity/v3/users/2c3f1716e28a48c696a1d4a7994e37ba => generated 247 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:50:50.005642 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d133924-5e8f-4a1c-8641-7b07106facd2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:50.072996 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20545f5-3144-42cb-b494-1fdb975b450e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:50.074381 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20545f5-3144-42cb-b494-1fdb975b450e None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:50.074868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20545f5-3144-42cb-b494-1fdb975b450e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:50.075360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20545f5-3144-42cb-b494-1fdb975b450e None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:50.077008 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20545f5-3144-42cb-b494-1fdb975b450e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:50.079149 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20545f5-3144-42cb-b494-1fdb975b450e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:50.100997 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 16/35] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jul 19 10:50:49 2022] POST /identity/v3/roles => generated 219 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:50:50.102941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20545f5-3144-42cb-b494-1fdb975b450e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:50.182718 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d133924-5e8f-4a1c-8641-7b07106facd2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:50.239190 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79aa74c-747e-4d34-bc67-257365bdbbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:50.239923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79aa74c-747e-4d34-bc67-257365bdbbb8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:50.240300 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79aa74c-747e-4d34-bc67-257365bdbbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:50.240578 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79aa74c-747e-4d34-bc67-257365bdbbb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:50.241360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79aa74c-747e-4d34-bc67-257365bdbbb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:50:50.241665 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79aa74c-747e-4d34-bc67-257365bdbbb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:50.243179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79aa74c-747e-4d34-bc67-257365bdbbb8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:50.265469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20545f5-3144-42cb-b494-1fdb975b450e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:50.265658 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 20/36] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:50:50.267256 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd0667-4073-41ad-aae2-279fc0b1c619 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:50.267547 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd0667-4073-41ad-aae2-279fc0b1c619 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:50.267845 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd0667-4073-41ad-aae2-279fc0b1c619 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:50.273768 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 21/37] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:50:50.274788 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd0667-4073-41ad-aae2-279fc0b1c619 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:50.308234 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04441ab8-34b1-4fc1-abeb-f25dde3c1dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:50.309082 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04441ab8-34b1-4fc1-abeb-f25dde3c1dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:50.309364 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04441ab8-34b1-4fc1-abeb-f25dde3c1dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:50.309655 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04441ab8-34b1-4fc1-abeb-f25dde3c1dc3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:50.311233 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04441ab8-34b1-4fc1-abeb-f25dde3c1dc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:50.312703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04441ab8-34b1-4fc1-abeb-f25dde3c1dc3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:50.314398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 17/38] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:50:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:50:50.315660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29400da3-130c-4a91-bda1-4f6c6c29f380 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:50.315950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29400da3-130c-4a91-bda1-4f6c6c29f380 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:50.316227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29400da3-130c-4a91-bda1-4f6c6c29f380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:50.334700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:50.335581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-29400da3-130c-4a91-bda1-4f6c6c29f380 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:50:50.337884 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-29400da3-130c-4a91-bda1-4f6c6c29f380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:50:50.375113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:50.419265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd0667-4073-41ad-aae2-279fc0b1c619 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:50.439962 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 18/39] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:50:50.440744 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29400da3-130c-4a91-bda1-4f6c6c29f380 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:50.474688 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a5f9c-0508-4d66-934f-78c98f3434c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:50.475357 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a5f9c-0508-4d66-934f-78c98f3434c3 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:50.475633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a5f9c-0508-4d66-934f-78c98f3434c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:50.475918 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a5f9c-0508-4d66-934f-78c98f3434c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:50.476631 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a5f9c-0508-4d66-934f-78c98f3434c3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:50.478118 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a5f9c-0508-4d66-934f-78c98f3434c3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:50.547973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29400da3-130c-4a91-bda1-4f6c6c29f380 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:50.583255 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebd119-aba4-4cab-bb93-9128121acc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:50.584415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebd119-aba4-4cab-bb93-9128121acc1f None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:50.584883 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebd119-aba4-4cab-bb93-9128121acc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:50.585293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebd119-aba4-4cab-bb93-9128121acc1f None admin] PATH_INFO: `/v3/domains/default/users/2c3f1716e28a48c696a1d4a7994e37ba/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:50.587756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebd119-aba4-4cab-bb93-9128121acc1f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2c3f1716e28a48c696a1d4a7994e37ba, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:50.589459 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebd119-aba4-4cab-bb93-9128121acc1f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:50.605921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 19/40] 10.222.0.18 () {58 vars in 1361 bytes} [Tue Jul 19 10:50:50 2022] PUT /identity/v3/domains/default/users/2c3f1716e28a48c696a1d4a7994e37ba/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:50:50.607022 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebd119-aba4-4cab-bb93-9128121acc1f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:50.623244 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 22/41] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 19 10:50:50 2022] POST /identity/v3/projects => generated 301 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:50:50.637671 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:50.748211 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebd119-aba4-4cab-bb93-9128121acc1f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:50.775880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69af296-7509-4e05-9517-c3a4437a5301 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:50.776634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69af296-7509-4e05-9517-c3a4437a5301 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:50.777140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69af296-7509-4e05-9517-c3a4437a5301 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:50.778800 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 23/42] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:50:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:50:50.785434 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dad4a6-3366-49ba-a56e-260f7225bffc None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:50.786085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dad4a6-3366-49ba-a56e-260f7225bffc None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:50.786696 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dad4a6-3366-49ba-a56e-260f7225bffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:50.793587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42323110-5e7e-495f-b3bc-c94f24d3ec8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:50.794305 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42323110-5e7e-495f-b3bc-c94f24d3ec8c None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:50.794595 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42323110-5e7e-495f-b3bc-c94f24d3ec8c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:50.794879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42323110-5e7e-495f-b3bc-c94f24d3ec8c None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:50.795681 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42323110-5e7e-495f-b3bc-c94f24d3ec8c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:50.797208 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42323110-5e7e-495f-b3bc-c94f24d3ec8c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:50.810879 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d9dad4a6-3366-49ba-a56e-260f7225bffc None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:50:50.813029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d9dad4a6-3366-49ba-a56e-260f7225bffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:50:50.816098 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 20/43] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jul 19 10:50:50 2022] POST /identity/v3/roles => generated 223 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:50:51.014676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 24/44] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:50:51.038209 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42323110-5e7e-495f-b3bc-c94f24d3ec8c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:51.121272 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:51.146983 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42323110-5e7e-495f-b3bc-c94f24d3ec8c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:51.182434 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8dc84-9596-4622-a2b6-ccfa5c7470b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:51.183246 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8dc84-9596-4622-a2b6-ccfa5c7470b1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:51.183531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8dc84-9596-4622-a2b6-ccfa5c7470b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:51.183809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8dc84-9596-4622-a2b6-ccfa5c7470b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:51.185061 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8dc84-9596-4622-a2b6-ccfa5c7470b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:51.186530 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8dc84-9596-4622-a2b6-ccfa5c7470b1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:51.188167 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 21/45] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:50:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:50:51.193931 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dad4a6-3366-49ba-a56e-260f7225bffc None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:51.221547 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:51.298599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dad4a6-3366-49ba-a56e-260f7225bffc None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:51.332362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e663e-fd92-4e43-b6bb-326e038dfe11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:51.333069 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e663e-fd92-4e43-b6bb-326e038dfe11 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:51.333355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e663e-fd92-4e43-b6bb-326e038dfe11 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:51.333635 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e663e-fd92-4e43-b6bb-326e038dfe11 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:51.334352 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e663e-fd92-4e43-b6bb-326e038dfe11 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:51.335964 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e663e-fd92-4e43-b6bb-326e038dfe11 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:51.362818 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 25/46] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 19 10:50:51 2022] POST /identity/v3/projects => generated 312 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:50:52.840817 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7836db-9252-45d2-b297-6374958cc29c None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:52.841331 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7836db-9252-45d2-b297-6374958cc29c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:52.841331 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7836db-9252-45d2-b297-6374958cc29c None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:52.842675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 22/47] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:50:52.848075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c3ac5-0159-4ea9-a7bc-468779519ba1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:52.848517 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c3ac5-0159-4ea9-a7bc-468779519ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:52.848636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c3ac5-0159-4ea9-a7bc-468779519ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:52.867242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ef7c3ac5-0159-4ea9-a7bc-468779519ba1 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:50:52.868472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ef7c3ac5-0159-4ea9-a7bc-468779519ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:50:52.947263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 26/48] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:50:52.975775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7836db-9252-45d2-b297-6374958cc29c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:53.086704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7836db-9252-45d2-b297-6374958cc29c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:53.124487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e4bd4-eb45-47c2-b32b-ec81e7b9e8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:53.125250 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e4bd4-eb45-47c2-b32b-ec81e7b9e8de None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:53.125718 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e4bd4-eb45-47c2-b32b-ec81e7b9e8de None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:53.125995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e4bd4-eb45-47c2-b32b-ec81e7b9e8de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:53.138891 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e4bd4-eb45-47c2-b32b-ec81e7b9e8de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:50:53.146633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-3e1e4bd4-eb45-47c2-b32b-ec81e7b9e8de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:50:53.146633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:50:53.146633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:50:53.146633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:50:53.146633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:50:53.146633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:50:53.146633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:50:53.146633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:50:53.146633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:50:53.146633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:50:53.146633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:50:53.146633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:50:53.146633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:50:53.146633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:50:53.146633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:50:53.146633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:50:53.147855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:50:53.147855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:50:53.147855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:50:53.147855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:50:53.147855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:50:53.147855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:50:53.147855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:50:53.147855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:50:53.147855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:50:53.147855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:50:53.147855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:50:53.147855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:50:53.147855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:50:53.147855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:50:53.147855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:50:53.147855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:50:53.148665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:50:53.148665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:50:53.148665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:50:53.148665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:50:53.148665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:50:53.148665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:50:53.148665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:50:53.148665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:50:53.148665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:50:53.148665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:50:53.148665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:50:53.148665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:50:53.148665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 23/49] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:50:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:50:53.154536 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c3ac5-0159-4ea9-a7bc-468779519ba1 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:53.165825 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:53.266577 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c3ac5-0159-4ea9-a7bc-468779519ba1 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:53.303942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7cb87-8481-429c-9cc4-e25529fbe9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:53.304618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7cb87-8481-429c-9cc4-e25529fbe9dc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:53.304929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7cb87-8481-429c-9cc4-e25529fbe9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:53.305209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7cb87-8481-429c-9cc4-e25529fbe9dc None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:53.305963 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7cb87-8481-429c-9cc4-e25529fbe9dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:50:53.306270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7cb87-8481-429c-9cc4-e25529fbe9dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:53.307719 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7cb87-8481-429c-9cc4-e25529fbe9dc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:53.316306 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 27/50] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:50:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:50:53.322180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e4bd4-eb45-47c2-b32b-ec81e7b9e8de None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:53.327084 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:53.421455 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5ed75-39e5-48df-ae38-89246850fe92 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:53.421632 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5ed75-39e5-48df-ae38-89246850fe92 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:53.421919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5ed75-39e5-48df-ae38-89246850fe92 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:53.423352 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 28/51] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:50:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:50:53.429217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcbb69-d97d-4b73-b300-d55285393aca None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:53.429509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcbb69-d97d-4b73-b300-d55285393aca None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:53.430168 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcbb69-d97d-4b73-b300-d55285393aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:53.433274 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e4bd4-eb45-47c2-b32b-ec81e7b9e8de None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:53.448887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c1dcbb69-d97d-4b73-b300-d55285393aca None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:50:53.450118 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c1dcbb69-d97d-4b73-b300-d55285393aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:50:53.472434 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59bd67-8fc4-4294-8031-b918bb21a0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:53.473479 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59bd67-8fc4-4294-8031-b918bb21a0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:53.473766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59bd67-8fc4-4294-8031-b918bb21a0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:53.474044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59bd67-8fc4-4294-8031-b918bb21a0e0 None admin] PATH_INFO: `/v3/users/2c3f1716e28a48c696a1d4a7994e37ba` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:53.475449 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59bd67-8fc4-4294-8031-b918bb21a0e0 None admin] RBAC: Authorizing `identity:get_user(user_id=2c3f1716e28a48c696a1d4a7994e37ba)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:53.477129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59bd67-8fc4-4294-8031-b918bb21a0e0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:53.478840 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 24/52] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:50:53 2022] GET /identity/v3/users/2c3f1716e28a48c696a1d4a7994e37ba => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:50:53.484970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59bd67-8fc4-4294-8031-b918bb21a0e0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:53.521709 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:53.528188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 29/53] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:50:53.552112 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcbb69-d97d-4b73-b300-d55285393aca None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:53.665853 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcbb69-d97d-4b73-b300-d55285393aca None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:53.675467 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:53.704974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840baf3-0ce8-4584-aed4-c3976174a50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:53.706221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840baf3-0ce8-4584-aed4-c3976174a50d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:53.706704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840baf3-0ce8-4584-aed4-c3976174a50d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:53.707173 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840baf3-0ce8-4584-aed4-c3976174a50d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:53.707484 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59bd67-8fc4-4294-8031-b918bb21a0e0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:53.709324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840baf3-0ce8-4584-aed4-c3976174a50d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:53.711758 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840baf3-0ce8-4584-aed4-c3976174a50d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:53.713722 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 30/54] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:50:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:50:53.720564 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840baf3-0ce8-4584-aed4-c3976174a50d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:53.749023 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62e0cb-eec1-4ba9-b082-38c8e04b969d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:53.750248 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62e0cb-eec1-4ba9-b082-38c8e04b969d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:53.750248 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62e0cb-eec1-4ba9-b082-38c8e04b969d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:53.750912 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62e0cb-eec1-4ba9-b082-38c8e04b969d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:53.751819 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62e0cb-eec1-4ba9-b082-38c8e04b969d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:53.753468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62e0cb-eec1-4ba9-b082-38c8e04b969d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:53.755010 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 25/55] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:50:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:50:53.761294 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62e0cb-eec1-4ba9-b082-38c8e04b969d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:53.795406 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:53.840388 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840baf3-0ce8-4584-aed4-c3976174a50d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:53.866199 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62e0cb-eec1-4ba9-b082-38c8e04b969d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:53.884124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dcce7-fcbb-4c55-879d-c645d0c4bc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:53.884834 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dcce7-fcbb-4c55-879d-c645d0c4bc91 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:53.885116 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dcce7-fcbb-4c55-879d-c645d0c4bc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:53.885442 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dcce7-fcbb-4c55-879d-c645d0c4bc91 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:53.886163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dcce7-fcbb-4c55-879d-c645d0c4bc91 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:53.887654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dcce7-fcbb-4c55-879d-c645d0c4bc91 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:53.902222 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac511750-ae63-4a0d-83b9-9d1f397eb05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:53.902510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac511750-ae63-4a0d-83b9-9d1f397eb05e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:53.902806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac511750-ae63-4a0d-83b9-9d1f397eb05e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:53.903093 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac511750-ae63-4a0d-83b9-9d1f397eb05e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:53.904019 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac511750-ae63-4a0d-83b9-9d1f397eb05e None admin] RBAC: Adding query filter params (role.id=3f9528e7a7914797a4635aa6b536b7ff, scope.domain.id=default, user.id=2c3f1716e28a48c696a1d4a7994e37ba) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:50:53.904377 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac511750-ae63-4a0d-83b9-9d1f397eb05e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:53.906021 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac511750-ae63-4a0d-83b9-9d1f397eb05e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:53.913665 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 31/56] 10.222.0.18 () {60 vars in 1140 bytes} [Tue Jul 19 10:50:53 2022] POST /identity/v3/projects => generated 298 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 10:50:53.915232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 26/57] 10.222.0.18 () {56 vars in 1322 bytes} [Tue Jul 19 10:50:53 2022] GET /identity/v3/role_assignments?user.id=2c3f1716e28a48c696a1d4a7994e37ba&scope.domain.id=default&role.id=3f9528e7a7914797a4635aa6b536b7ff => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:50:56.031992 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589ad97-eb20-43c5-906d-b78c71981f69 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:56.032545 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589ad97-eb20-43c5-906d-b78c71981f69 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:56.032545 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589ad97-eb20-43c5-906d-b78c71981f69 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:56.033942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 32/58] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:50:56.039395 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3202e-6666-492d-9595-72db29da844b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:56.039858 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3202e-6666-492d-9595-72db29da844b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:56.039945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3202e-6666-492d-9595-72db29da844b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:56.046578 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:56.058289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-94e3202e-6666-492d-9595-72db29da844b None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:50:56.059590 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-94e3202e-6666-492d-9595-72db29da844b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:50:56.143483 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 27/59] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:50:56.168595 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589ad97-eb20-43c5-906d-b78c71981f69 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:56.285339 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589ad97-eb20-43c5-906d-b78c71981f69 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:56.308427 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:56.325398 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02c290-7821-4956-9039-9d284fa361d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:56.326234 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02c290-7821-4956-9039-9d284fa361d9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:56.326515 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02c290-7821-4956-9039-9d284fa361d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:56.326788 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02c290-7821-4956-9039-9d284fa361d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:56.328108 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02c290-7821-4956-9039-9d284fa361d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:56.329626 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02c290-7821-4956-9039-9d284fa361d9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:56.331332 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 33/60] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:50:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:50:56.337116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3202e-6666-492d-9595-72db29da844b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:50:56.450961 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3202e-6666-492d-9595-72db29da844b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:50:56.488143 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73958a-1a39-4b3a-93e1-b0eab4acde47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:50:56.488852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73958a-1a39-4b3a-93e1-b0eab4acde47 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:56.489137 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73958a-1a39-4b3a-93e1-b0eab4acde47 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:56.489414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73958a-1a39-4b3a-93e1-b0eab4acde47 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:56.490134 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73958a-1a39-4b3a-93e1-b0eab4acde47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:50:56.491607 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73958a-1a39-4b3a-93e1-b0eab4acde47 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:50:56.500901 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:50:56.518006 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 28/61] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 19 10:50:56 2022] POST /identity/v3/users => generated 275 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:50:59.834877 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c11684-4c46-466a-bf37-50f6f64522f4 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:59.835858 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c11684-4c46-466a-bf37-50f6f64522f4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:59.836333 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c11684-4c46-466a-bf37-50f6f64522f4 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:59.837956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 34/62] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:50:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:50:59.843836 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9dce6-8aef-4136-a9ef-4ed18b64279a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:59.845912 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79bde5-78ef-409a-bd49-02e13e3fcf4f None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:59.846398 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79bde5-78ef-409a-bd49-02e13e3fcf4f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:59.846863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79bde5-78ef-409a-bd49-02e13e3fcf4f None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:59.848416 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 35/63] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:50:59.848966 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9dce6-8aef-4136-a9ef-4ed18b64279a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:59.849462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9dce6-8aef-4136-a9ef-4ed18b64279a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:59.854672 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8a78d-2eca-4f4a-b3fd-a98df422dc38 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:59.855204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8a78d-2eca-4f4a-b3fd-a98df422dc38 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:59.855671 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8a78d-2eca-4f4a-b3fd-a98df422dc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:59.880663 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5de9dce6-8aef-4136-a9ef-4ed18b64279a None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:50:59.882432 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5de9dce6-8aef-4136-a9ef-4ed18b64279a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:50:59.888681 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e2c8a78d-2eca-4f4a-b3fd-a98df422dc38 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:50:59.890180 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e2c8a78d-2eca-4f4a-b3fd-a98df422dc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:50:59.975637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 36/64] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:50:59.977339 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19f423-2212-4cfd-b84d-d7f210228c0f None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:59.977898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19f423-2212-4cfd-b84d-d7f210228c0f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:59.978317 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19f423-2212-4cfd-b84d-d7f210228c0f None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:59.979966 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 29/65] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:50:59.980511 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 37/66] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:50:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:50:59.986055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77533b65-ab7c-4f43-a2bf-ac4e2f7f4cd2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:50:59.986519 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77533b65-ab7c-4f43-a2bf-ac4e2f7f4cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:50:59.986959 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77533b65-ab7c-4f43-a2bf-ac4e2f7f4cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:50:59.999505 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19f423-2212-4cfd-b84d-d7f210228c0f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:00.015152 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-77533b65-ab7c-4f43-a2bf-ac4e2f7f4cd2 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:00.016599 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-77533b65-ab7c-4f43-a2bf-ac4e2f7f4cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:00.112048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 30/67] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:51:00.115835 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77533b65-ab7c-4f43-a2bf-ac4e2f7f4cd2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:00.143684 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19f423-2212-4cfd-b84d-d7f210228c0f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:00.176661 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:00.201410 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb10cf9-ddf4-49f6-9373-ce37cd647ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:00.202391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb10cf9-ddf4-49f6-9373-ce37cd647ffe None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:00.202777 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb10cf9-ddf4-49f6-9373-ce37cd647ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:00.203150 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb10cf9-ddf4-49f6-9373-ce37cd647ffe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:00.216190 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb10cf9-ddf4-49f6-9373-ce37cd647ffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:00.225760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-abb10cf9-ddf4-49f6-9373-ce37cd647ffe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:00.225760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:00.225760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:00.225760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:00.225760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:00.225760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:00.225760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:00.225760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:00.225760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:00.225760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:00.225760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:00.225760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:00.225760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:00.225760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:00.225760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:00.225760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:00.227503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:00.227503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:00.227503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:00.227503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:00.227503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:00.227503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:00.227503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:00.227503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:00.227503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:00.227503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:00.227503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:00.227503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:00.227503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:00.227503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:00.227503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:00.227503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:00.229392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:00.229392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:00.229392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:00.229392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:00.229392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:00.229392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:00.229392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:00.229392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:00.229392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:00.229392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:00.229392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:00.229392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:00.229392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 38/68] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:50:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:00.229392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb10cf9-ddf4-49f6-9373-ce37cd647ffe None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:00.233276 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:00.322615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77533b65-ab7c-4f43-a2bf-ac4e2f7f4cd2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:00.368165 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb10cf9-ddf4-49f6-9373-ce37cd647ffe None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:00.380793 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2a2a9-7b17-4805-a778-3b6bf4461335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:00.382641 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2a2a9-7b17-4805-a778-3b6bf4461335 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:00.383117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2a2a9-7b17-4805-a778-3b6bf4461335 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:00.383588 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2a2a9-7b17-4805-a778-3b6bf4461335 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:00.402932 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2a2a9-7b17-4805-a778-3b6bf4461335 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:00.417076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-41b2a2a9-7b17-4805-a778-3b6bf4461335 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:00.417076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:00.417076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:00.417076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:00.417076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:00.417076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:00.417076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:00.417076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:00.417076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:00.417076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:00.417076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:00.417076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:00.417076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:00.417076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:00.417076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:00.417076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:00.418743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:00.418743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:00.418743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:00.418743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:00.418743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:00.418743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:00.418743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:00.418743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:00.418743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:00.418743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:00.418743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:00.418743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:00.418743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:00.418743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:00.418743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:00.418743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:00.420212 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:00.420212 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:00.420212 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:00.420212 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:00.420212 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:00.420212 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:00.420212 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:00.420212 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:00.420212 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:00.420212 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:00.420212 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:00.420212 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:00.420212 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 31/69] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:51:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:00.421472 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53772761-325f-4205-ac70-aad6b14239f1 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:00.421873 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53772761-325f-4205-ac70-aad6b14239f1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:00.422488 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53772761-325f-4205-ac70-aad6b14239f1 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:00.425258 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 32/70] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:00.431487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53772761-325f-4205-ac70-aad6b14239f1 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:00.436863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad42fa-b373-4544-80fa-1c6cb5581dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:00.437705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad42fa-b373-4544-80fa-1c6cb5581dcd None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:00.437990 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad42fa-b373-4544-80fa-1c6cb5581dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:00.438266 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad42fa-b373-4544-80fa-1c6cb5581dcd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:00.449239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad42fa-b373-4544-80fa-1c6cb5581dcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:00.457473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-02ad42fa-b373-4544-80fa-1c6cb5581dcd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:00.457473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:00.457473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:00.457473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:00.457473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:00.457473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:00.457473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:00.457473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:00.457473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:00.457473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:00.457473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:00.457473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:00.457473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:00.457473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:00.457473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:00.457473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:00.458480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:00.458480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:00.458480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:00.458480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:00.458480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:00.458480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:00.458480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:00.458480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:00.458480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:00.458480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:00.458480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:00.458480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:00.458480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:00.458480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:00.458480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:00.458480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:00.459393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:00.459393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:00.459393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:00.459393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:00.459393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:00.459393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:00.459393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:00.459393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:00.459393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:00.459393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:00.459393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:00.459393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:00.459393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 39/71] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 19 10:51:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:00.459393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad42fa-b373-4544-80fa-1c6cb5581dcd None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:00.500152 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:00.538226 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53772761-325f-4205-ac70-aad6b14239f1 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:00.549263 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:00.573573 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad42fa-b373-4544-80fa-1c6cb5581dcd None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:00.580323 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876eccca-4270-4e9c-a280-b6dd197aaddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:00.581036 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876eccca-4270-4e9c-a280-b6dd197aaddd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:00.581325 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876eccca-4270-4e9c-a280-b6dd197aaddd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:00.581716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876eccca-4270-4e9c-a280-b6dd197aaddd None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:00.583174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876eccca-4270-4e9c-a280-b6dd197aaddd None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:00.583174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876eccca-4270-4e9c-a280-b6dd197aaddd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:00.584220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876eccca-4270-4e9c-a280-b6dd197aaddd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:00.594296 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 33/72] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:00.595611 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b116f9e-c61e-4875-9f67-2f7748ac583d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:00.595929 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b116f9e-c61e-4875-9f67-2f7748ac583d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:00.596179 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b116f9e-c61e-4875-9f67-2f7748ac583d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:00.614394 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7b116f9e-c61e-4875-9f67-2f7748ac583d None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:00.615881 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7b116f9e-c61e-4875-9f67-2f7748ac583d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:00.618730 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4e0ea-d9ce-470d-86c3-657d6daf145d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:00.619456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4e0ea-d9ce-470d-86c3-657d6daf145d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:00.619754 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4e0ea-d9ce-470d-86c3-657d6daf145d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:00.620033 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4e0ea-d9ce-470d-86c3-657d6daf145d None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:00.620894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4e0ea-d9ce-470d-86c3-657d6daf145d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:00.621213 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4e0ea-d9ce-470d-86c3-657d6daf145d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:00.622634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4e0ea-d9ce-470d-86c3-657d6daf145d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:00.631596 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 40/73] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:00.633062 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e8964-144d-4362-98a7-8fdc87e7c5d8 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:00.633354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e8964-144d-4362-98a7-8fdc87e7c5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:00.633635 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e8964-144d-4362-98a7-8fdc87e7c5d8 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:00.636900 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 41/74] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:00.637774 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e8964-144d-4362-98a7-8fdc87e7c5d8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:00.689750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 34/75] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:00.690613 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b116f9e-c61e-4875-9f67-2f7748ac583d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:00.755318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:00.759461 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e8964-144d-4362-98a7-8fdc87e7c5d8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:00.794325 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f431ecd-5680-4932-8c16-2f0fcc933ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:00.795046 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f431ecd-5680-4932-8c16-2f0fcc933ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:00.795322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f431ecd-5680-4932-8c16-2f0fcc933ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:00.795600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f431ecd-5680-4932-8c16-2f0fcc933ad3 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:00.796358 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f431ecd-5680-4932-8c16-2f0fcc933ad3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:00.796653 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f431ecd-5680-4932-8c16-2f0fcc933ad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:00.798098 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f431ecd-5680-4932-8c16-2f0fcc933ad3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:00.798195 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b116f9e-c61e-4875-9f67-2f7748ac583d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:00.799774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:00.807071 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 42/76] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:51:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:00.811766 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f431ecd-5680-4932-8c16-2f0fcc933ad3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:00.839834 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9446af7-4f1b-4472-a92e-f745ec20dfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:00.840786 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9446af7-4f1b-4472-a92e-f745ec20dfb2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:00.841080 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9446af7-4f1b-4472-a92e-f745ec20dfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:00.841359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9446af7-4f1b-4472-a92e-f745ec20dfb2 None admin] PATH_INFO: `/v3/users/a4e1397234b748429b5677746ccbc985` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:00.857519 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9446af7-4f1b-4472-a92e-f745ec20dfb2 None admin] RBAC: Authorizing `identity:get_user(user_id=a4e1397234b748429b5677746ccbc985)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:00.859005 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9446af7-4f1b-4472-a92e-f745ec20dfb2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:00.860756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 35/77] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:00 2022] GET /identity/v3/users/a4e1397234b748429b5677746ccbc985 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:00.861963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd5f51-2e29-48fe-b9a4-88fc9806f815 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:00.862250 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd5f51-2e29-48fe-b9a4-88fc9806f815 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:00.862526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd5f51-2e29-48fe-b9a4-88fc9806f815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:00.879340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d2cd5f51-2e29-48fe-b9a4-88fc9806f815 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:00.880460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d2cd5f51-2e29-48fe-b9a4-88fc9806f815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:00.911196 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f431ecd-5680-4932-8c16-2f0fcc933ad3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:00.944200 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3381e-703c-4f25-a733-83ac5f9c4c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:00.945113 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3381e-703c-4f25-a733-83ac5f9c4c4c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:00.945406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 36/78] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:00.945538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3381e-703c-4f25-a733-83ac5f9c4c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:00.945687 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3381e-703c-4f25-a733-83ac5f9c4c4c None admin] PATH_INFO: `/v3/users/2c3f1716e28a48c696a1d4a7994e37ba` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:00.946243 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd5f51-2e29-48fe-b9a4-88fc9806f815 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:00.947058 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3381e-703c-4f25-a733-83ac5f9c4c4c None admin] RBAC: Authorizing `identity:get_user(user_id=2c3f1716e28a48c696a1d4a7994e37ba)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:00.948592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3381e-703c-4f25-a733-83ac5f9c4c4c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:00.950264 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 43/79] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:00 2022] GET /identity/v3/users/2c3f1716e28a48c696a1d4a7994e37ba => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:00.951024 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3381e-703c-4f25-a733-83ac5f9c4c4c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:00.988656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:01.046957 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:01.057155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd5f51-2e29-48fe-b9a4-88fc9806f815 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:01.058657 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3381e-703c-4f25-a733-83ac5f9c4c4c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:01.092381 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c608afe-9834-4c40-a1a2-8c82607fe867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:01.093224 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c608afe-9834-4c40-a1a2-8c82607fe867 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:01.093354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198b119-378f-4493-ad79-c849c9322534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:01.093566 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c608afe-9834-4c40-a1a2-8c82607fe867 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:01.093749 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c608afe-9834-4c40-a1a2-8c82607fe867 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:01.094249 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198b119-378f-4493-ad79-c849c9322534 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:01.094532 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198b119-378f-4493-ad79-c849c9322534 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:01.094805 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198b119-378f-4493-ad79-c849c9322534 None admin] PATH_INFO: `/v3/users/a4e1397234b748429b5677746ccbc985` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:01.096031 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198b119-378f-4493-ad79-c849c9322534 None admin] RBAC: Authorizing `identity:get_user(user_id=a4e1397234b748429b5677746ccbc985)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:01.097529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198b119-378f-4493-ad79-c849c9322534 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:01.099192 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 44/80] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:00 2022] GET /identity/v3/users/a4e1397234b748429b5677746ccbc985 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:01.099967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198b119-378f-4493-ad79-c849c9322534 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:01.108790 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c608afe-9834-4c40-a1a2-8c82607fe867 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:01.116615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-2c608afe-9834-4c40-a1a2-8c82607fe867 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:01.116615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:01.116615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:01.116615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:01.116615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:01.116615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:01.116615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:01.116615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:01.116615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:01.116615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:01.116615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:01.116615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:01.116615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:01.116615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:01.116615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:01.116615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:01.117592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:01.117592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:01.117592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:01.117592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:01.117592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:01.117592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:01.117592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:01.117592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:01.117592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:01.117592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:01.117592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:01.117592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:01.117592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:01.117592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:01.117592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:01.117592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:01.118373 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:01.118373 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:01.118373 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:01.118373 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:01.118373 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:01.118373 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:01.118373 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:01.118373 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:01.118373 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:01.118373 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:01.118373 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:01.118373 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:01.118373 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 37/81] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:01.118993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c608afe-9834-4c40-a1a2-8c82607fe867 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:01.211536 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:01.216194 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198b119-378f-4493-ad79-c849c9322534 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:01.228063 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c608afe-9834-4c40-a1a2-8c82607fe867 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:01.253551 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc77f2-77fb-4336-a06b-9f262dc6e4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:01.254212 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc77f2-77fb-4336-a06b-9f262dc6e4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:01.254502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc77f2-77fb-4336-a06b-9f262dc6e4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:01.254776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc77f2-77fb-4336-a06b-9f262dc6e4b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:01.263428 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770dba8-26ef-4060-877a-180db1673bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:01.264121 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770dba8-26ef-4060-877a-180db1673bfa None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:01.264392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770dba8-26ef-4060-877a-180db1673bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:01.264668 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770dba8-26ef-4060-877a-180db1673bfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:01.283898 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:01.325173 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc77f2-77fb-4336-a06b-9f262dc6e4b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:01.326683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc77f2-77fb-4336-a06b-9f262dc6e4b3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:01.333151 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770dba8-26ef-4060-877a-180db1673bfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:01.334655 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770dba8-26ef-4060-877a-180db1673bfa None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:01.424089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:01.430555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 45/82] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:01.431426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc77f2-77fb-4336-a06b-9f262dc6e4b3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:01.440751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 38/83] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:01.441915 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770dba8-26ef-4060-877a-180db1673bfa None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:01.492788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:01.536963 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc77f2-77fb-4336-a06b-9f262dc6e4b3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:01.543787 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770dba8-26ef-4060-877a-180db1673bfa None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:01.570897 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722327f-f48c-4d18-8662-6a45dd273147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:01.571689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722327f-f48c-4d18-8662-6a45dd273147 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:01.572004 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722327f-f48c-4d18-8662-6a45dd273147 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:01.572275 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722327f-f48c-4d18-8662-6a45dd273147 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:01.573544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722327f-f48c-4d18-8662-6a45dd273147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:01.575026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722327f-f48c-4d18-8662-6a45dd273147 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:01.576655 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 46/84] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:01.577444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722327f-f48c-4d18-8662-6a45dd273147 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:01.577598 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11debe-277d-44a5-8132-21395d46c166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:01.578284 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11debe-277d-44a5-8132-21395d46c166 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:01.578523 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11debe-277d-44a5-8132-21395d46c166 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:01.578804 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11debe-277d-44a5-8132-21395d46c166 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:01.646338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:01.648153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11debe-277d-44a5-8132-21395d46c166 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:01.649824 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11debe-277d-44a5-8132-21395d46c166 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:01.683347 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722327f-f48c-4d18-8662-6a45dd273147 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:01.700169 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:01.717938 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a5087-cd30-4073-82a6-d9b8cf5363cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:01.718613 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a5087-cd30-4073-82a6-d9b8cf5363cf None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:01.718894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a5087-cd30-4073-82a6-d9b8cf5363cf None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:01.719169 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a5087-cd30-4073-82a6-d9b8cf5363cf None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:01.719915 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a5087-cd30-4073-82a6-d9b8cf5363cf None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:01.720219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a5087-cd30-4073-82a6-d9b8cf5363cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:01.721634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a5087-cd30-4073-82a6-d9b8cf5363cf None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:01.730340 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 47/85] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:01.730340 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a5087-cd30-4073-82a6-d9b8cf5363cf None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:01.758233 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 39/86] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:01.759043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11debe-277d-44a5-8132-21395d46c166 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:01.836466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a5087-cd30-4073-82a6-d9b8cf5363cf None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:01.865996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:01.868408 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11debe-277d-44a5-8132-21395d46c166 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:01.874647 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ad532-b810-40e0-afff-cc01b27e3c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:01.875530 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ad532-b810-40e0-afff-cc01b27e3c72 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:01.875811 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ad532-b810-40e0-afff-cc01b27e3c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:01.876087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ad532-b810-40e0-afff-cc01b27e3c72 None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:01.877335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ad532-b810-40e0-afff-cc01b27e3c72 None admin] RBAC: Authorizing `identity:get_project(project_id=4c9b1fef5ff14878b0fe811a533eb847)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:01.878790 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ad532-b810-40e0-afff-cc01b27e3c72 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:01.880690 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 48/87] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:01 2022] GET /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:01.881298 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ad532-b810-40e0-afff-cc01b27e3c72 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:01.916328 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34711f2b-0db4-4254-bca9-a12b968eecbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:01.917235 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34711f2b-0db4-4254-bca9-a12b968eecbb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:01.917523 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34711f2b-0db4-4254-bca9-a12b968eecbb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:01.917801 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34711f2b-0db4-4254-bca9-a12b968eecbb None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:01.919008 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34711f2b-0db4-4254-bca9-a12b968eecbb None admin] RBAC: Authorizing `identity:get_project(project_id=4c9b1fef5ff14878b0fe811a533eb847)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:01.920491 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34711f2b-0db4-4254-bca9-a12b968eecbb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:01.922238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 40/88] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:01 2022] GET /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:01.923013 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34711f2b-0db4-4254-bca9-a12b968eecbb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:01.943821 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:01.996034 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ad532-b810-40e0-afff-cc01b27e3c72 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:02.033140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34711f2b-0db4-4254-bca9-a12b968eecbb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:02.035727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a058db0-08b7-4aa6-be62-d5ea488d0a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:02.036421 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a058db0-08b7-4aa6-be62-d5ea488d0a68 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:02.036703 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a058db0-08b7-4aa6-be62-d5ea488d0a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:02.036999 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a058db0-08b7-4aa6-be62-d5ea488d0a68 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:02.037723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a058db0-08b7-4aa6-be62-d5ea488d0a68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:02.039172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a058db0-08b7-4aa6-be62-d5ea488d0a68 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:02.064544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 49/89] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 19 10:51:01 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:51:02.065533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a058db0-08b7-4aa6-be62-d5ea488d0a68 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:02.080957 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaae2f-1ee9-4ec3-99f1-2e161847db47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:02.081975 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaae2f-1ee9-4ec3-99f1-2e161847db47 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:02.082335 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaae2f-1ee9-4ec3-99f1-2e161847db47 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:02.082690 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaae2f-1ee9-4ec3-99f1-2e161847db47 None admin] PATH_INFO: `/v3/users/a4e1397234b748429b5677746ccbc985` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:02.084262 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacaae2f-1ee9-4ec3-99f1-2e161847db47 None admin] RBAC: Authorizing `identity:get_user(user_id=a4e1397234b748429b5677746ccbc985)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:02.085937 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacaae2f-1ee9-4ec3-99f1-2e161847db47 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:02.087865 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 41/90] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:01 2022] GET /identity/v3/users/a4e1397234b748429b5677746ccbc985 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:02.088903 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaae2f-1ee9-4ec3-99f1-2e161847db47 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:02.131530 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:02.194291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a058db0-08b7-4aa6-be62-d5ea488d0a68 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:02.196513 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:02.215365 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaae2f-1ee9-4ec3-99f1-2e161847db47 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:02.240053 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc51ac-2def-4be1-b91e-409f72f629e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:02.241020 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc51ac-2def-4be1-b91e-409f72f629e4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:02.241307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc51ac-2def-4be1-b91e-409f72f629e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:02.241580 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc51ac-2def-4be1-b91e-409f72f629e4 None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:02.244572 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc51ac-2def-4be1-b91e-409f72f629e4 None admin] RBAC: Authorizing `identity:get_project(project_id=4c9b1fef5ff14878b0fe811a533eb847)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:02.247252 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc51ac-2def-4be1-b91e-409f72f629e4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:02.250492 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 50/91] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:02 2022] GET /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:02.251118 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc51ac-2def-4be1-b91e-409f72f629e4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:02.270063 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f60af8-670f-46a1-86b7-2a60b0fc41d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:02.270804 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f60af8-670f-46a1-86b7-2a60b0fc41d8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:02.271096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f60af8-670f-46a1-86b7-2a60b0fc41d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:02.273653 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f60af8-670f-46a1-86b7-2a60b0fc41d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:02.273653 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f60af8-670f-46a1-86b7-2a60b0fc41d8 None admin] RBAC: Adding query filter params (role.id=6ff885694ad84e4cb935ef1c1f001858, scope.project.id=4c9b1fef5ff14878b0fe811a533eb847, user.id=a4e1397234b748429b5677746ccbc985) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:02.273653 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f60af8-670f-46a1-86b7-2a60b0fc41d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:02.274224 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f60af8-670f-46a1-86b7-2a60b0fc41d8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:02.280388 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 42/92] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:51:02 2022] GET /identity/v3/role_assignments?user.id=a4e1397234b748429b5677746ccbc985&scope.project.id=4c9b1fef5ff14878b0fe811a533eb847&role.id=6ff885694ad84e4cb935ef1c1f001858 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:02.281260 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f60af8-670f-46a1-86b7-2a60b0fc41d8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:02.398054 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc51ac-2def-4be1-b91e-409f72f629e4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:02.427270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:02.431012 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f60af8-670f-46a1-86b7-2a60b0fc41d8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:02.447687 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10b013-0561-4e16-9307-101ca7b51462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:02.448402 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10b013-0561-4e16-9307-101ca7b51462 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:02.448687 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10b013-0561-4e16-9307-101ca7b51462 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:02.449003 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10b013-0561-4e16-9307-101ca7b51462 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:02.450567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10b013-0561-4e16-9307-101ca7b51462 None admin] RBAC: Adding query filter params (role.id=3f9528e7a7914797a4635aa6b536b7ff, scope.project.id=4c9b1fef5ff14878b0fe811a533eb847, user.id=2c3f1716e28a48c696a1d4a7994e37ba) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:02.450921 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10b013-0561-4e16-9307-101ca7b51462 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:02.453089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10b013-0561-4e16-9307-101ca7b51462 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:02.461668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 51/93] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:51:02 2022] GET /identity/v3/role_assignments?user.id=2c3f1716e28a48c696a1d4a7994e37ba&scope.project.id=4c9b1fef5ff14878b0fe811a533eb847&role.id=3f9528e7a7914797a4635aa6b536b7ff => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:02.462496 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10b013-0561-4e16-9307-101ca7b51462 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:02.498408 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddf479-2c6a-4fa7-9cae-fecf0f259824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:02.499122 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddf479-2c6a-4fa7-9cae-fecf0f259824 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:02.499416 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddf479-2c6a-4fa7-9cae-fecf0f259824 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:02.499704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddf479-2c6a-4fa7-9cae-fecf0f259824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:02.526247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:02.634436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddf479-2c6a-4fa7-9cae-fecf0f259824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:02.638773 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddf479-2c6a-4fa7-9cae-fecf0f259824 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:02.698156 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10b013-0561-4e16-9307-101ca7b51462 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:02.742323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bf301-16a6-4657-a8e6-617df03250c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:02.743444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bf301-16a6-4657-a8e6-617df03250c2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:02.743925 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bf301-16a6-4657-a8e6-617df03250c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:02.744504 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bf301-16a6-4657-a8e6-617df03250c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:02.745579 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250bf301-16a6-4657-a8e6-617df03250c2 None admin] RBAC: Adding query filter params (role.id=0a734da5c17d4cd39ea84b75878e55f1, scope.project.id=4c9b1fef5ff14878b0fe811a533eb847, user.id=a4e1397234b748429b5677746ccbc985) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:02.746084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250bf301-16a6-4657-a8e6-617df03250c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:02.748704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250bf301-16a6-4657-a8e6-617df03250c2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:02.761940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 52/94] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:51:02 2022] GET /identity/v3/role_assignments?user.id=a4e1397234b748429b5677746ccbc985&scope.project.id=4c9b1fef5ff14878b0fe811a533eb847&role.id=0a734da5c17d4cd39ea84b75878e55f1 => generated 259 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:02.841975 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 43/95] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:02.847791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bf301-16a6-4657-a8e6-617df03250c2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:02.917126 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:02.964435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bf301-16a6-4657-a8e6-617df03250c2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:03.000701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d236bdf-af7e-4ade-b19f-d4a42400e4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:03.001623 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d236bdf-af7e-4ade-b19f-d4a42400e4dd None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:03.002038 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d236bdf-af7e-4ade-b19f-d4a42400e4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:03.002313 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d236bdf-af7e-4ade-b19f-d4a42400e4dd None admin] PATH_INFO: `/v3/projects/5d43746f642649cab2d3a0be97046cce` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:03.003566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d236bdf-af7e-4ade-b19f-d4a42400e4dd None admin] RBAC: Authorizing `identity:get_project(project_id=5d43746f642649cab2d3a0be97046cce)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:03.005118 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d236bdf-af7e-4ade-b19f-d4a42400e4dd None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:03.006907 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 53/96] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:02 2022] GET /identity/v3/projects/5d43746f642649cab2d3a0be97046cce => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:03.013265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddf479-2c6a-4fa7-9cae-fecf0f259824 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:03.082806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:03.145807 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddf479-2c6a-4fa7-9cae-fecf0f259824 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:03.184981 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201a6c2-2c31-4379-98cc-ebad0f9acdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:03.185663 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201a6c2-2c31-4379-98cc-ebad0f9acdaa None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:03.185941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201a6c2-2c31-4379-98cc-ebad0f9acdaa None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:03.186215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201a6c2-2c31-4379-98cc-ebad0f9acdaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:03.187060 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201a6c2-2c31-4379-98cc-ebad0f9acdaa None admin] RBAC: Adding query filter params (role.id=6ff885694ad84e4cb935ef1c1f001858, scope.project.id=5d43746f642649cab2d3a0be97046cce, user.id=a4e1397234b748429b5677746ccbc985) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:03.187370 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201a6c2-2c31-4379-98cc-ebad0f9acdaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:03.188921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201a6c2-2c31-4379-98cc-ebad0f9acdaa None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:03.196875 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 44/97] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:51:03 2022] GET /identity/v3/role_assignments?user.id=a4e1397234b748429b5677746ccbc985&scope.project.id=5d43746f642649cab2d3a0be97046cce&role.id=6ff885694ad84e4cb935ef1c1f001858 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:05.213267 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6d54d-5c8f-4cec-90a3-c4a7e30173cd None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:05.214400 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6d54d-5c8f-4cec-90a3-c4a7e30173cd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:05.214898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6d54d-5c8f-4cec-90a3-c4a7e30173cd None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:05.216523 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 54/98] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:51:05.226351 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045f900-2dea-4c04-8b74-0125e40fe88d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:05.227301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045f900-2dea-4c04-8b74-0125e40fe88d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:05.227788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045f900-2dea-4c04-8b74-0125e40fe88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:05.249761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7045f900-2dea-4c04-8b74-0125e40fe88d None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:05.251340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7045f900-2dea-4c04-8b74-0125e40fe88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:05.306896 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adac95f-23a0-4662-b3a4-63f99745ba7c None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:05.307168 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adac95f-23a0-4662-b3a4-63f99745ba7c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:05.307473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adac95f-23a0-4662-b3a4-63f99745ba7c None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:05.309079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 55/99] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:51:05.320782 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4023bd8-6444-482f-9f7b-c7a04539a345 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:05.321196 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4023bd8-6444-482f-9f7b-c7a04539a345 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:05.321347 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4023bd8-6444-482f-9f7b-c7a04539a345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:05.357218 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a4023bd8-6444-482f-9f7b-c7a04539a345 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:05.358451 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a4023bd8-6444-482f-9f7b-c7a04539a345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:05.361414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 45/100] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:05.446113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045f900-2dea-4c04-8b74-0125e40fe88d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:05.531819 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:05.535227 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 56/101] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 19 10:51:05.574372 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4023bd8-6444-482f-9f7b-c7a04539a345 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:05.618847 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045f900-2dea-4c04-8b74-0125e40fe88d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:05.684527 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:05.686177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b2439-d7df-4ff0-95a5-ea7fa65f617e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:05.687271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b2439-d7df-4ff0-95a5-ea7fa65f617e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:05.687567 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b2439-d7df-4ff0-95a5-ea7fa65f617e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:05.687897 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b2439-d7df-4ff0-95a5-ea7fa65f617e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:05.732182 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b2439-d7df-4ff0-95a5-ea7fa65f617e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:05.740517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e07b2439-d7df-4ff0-95a5-ea7fa65f617e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:51:05.740517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:05.740517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:05.740517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:05.740517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:05.740517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:05.740517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:05.740517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:05.740517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:05.740517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:05.740517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:05.740517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:05.740517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:05.740517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:05.740517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:05.740517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:05.747783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:05.747783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:05.747783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:05.747783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:05.747783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:05.747783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:05.747783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:05.747783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:05.747783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:05.747783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:05.747783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:05.747783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:05.747783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:05.747783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:05.747783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:05.747783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:05.748632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:05.748632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:05.748632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:05.748632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:05.748632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:05.748632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:05.748632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:05.748632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:05.748632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:05.748632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:05.748632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:51:05.748632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:05.751262 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4023bd8-6444-482f-9f7b-c7a04539a345 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:05.751772 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 46/102] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:51:05.757914 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b2439-d7df-4ff0-95a5-ea7fa65f617e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:05.788295 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cef33-1571-4526-91a9-50373f41c8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:05.789074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cef33-1571-4526-91a9-50373f41c8fe None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:05.789356 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cef33-1571-4526-91a9-50373f41c8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:05.789630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cef33-1571-4526-91a9-50373f41c8fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:05.801461 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cef33-1571-4526-91a9-50373f41c8fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:05.809555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-e39cef33-1571-4526-91a9-50373f41c8fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:05.809555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:05.809555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:05.809555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:05.809555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:05.809555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:05.809555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:05.809555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:05.809555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:05.809555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:05.809555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:05.809555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:05.809555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:05.809555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:05.809555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:05.809555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:05.810471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:05.810471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:05.810471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:05.810471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:05.810471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:05.810471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:05.810471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:05.810471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:05.810471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:05.810471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:05.810471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:05.810471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:05.810471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:05.810471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:05.810471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:05.810471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:05.811675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:05.811675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:05.811675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:05.811675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:05.811675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:05.811675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:05.811675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:05.811675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:05.811675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:05.811675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:05.811675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:05.811675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:05.811675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 57/103] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:51:05.816746 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cef33-1571-4526-91a9-50373f41c8fe None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:05.939243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cef33-1571-4526-91a9-50373f41c8fe None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:05.946463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b2439-d7df-4ff0-95a5-ea7fa65f617e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:05.951134 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:05.958061 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:05.981216 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ead63-f89b-409a-81f8-06a27f500302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:05.981907 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ead63-f89b-409a-81f8-06a27f500302 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:05.982187 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ead63-f89b-409a-81f8-06a27f500302 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:05.982462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ead63-f89b-409a-81f8-06a27f500302 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:05.983223 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ead63-f89b-409a-81f8-06a27f500302 None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:05.983530 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ead63-f89b-409a-81f8-06a27f500302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:05.984986 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ead63-f89b-409a-81f8-06a27f500302 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:05.995267 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 58/104] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:05.996621 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea669a1-6cd0-44ab-a642-6d2fe2ddca37 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:05.996927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea669a1-6cd0-44ab-a642-6d2fe2ddca37 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:05.997204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea669a1-6cd0-44ab-a642-6d2fe2ddca37 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:06.003470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 59/105] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:06.005900 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea669a1-6cd0-44ab-a642-6d2fe2ddca37 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:06.040031 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2f396-96c0-4038-93fc-5fc01e4d4758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:06.041561 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2f396-96c0-4038-93fc-5fc01e4d4758 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:06.042253 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2f396-96c0-4038-93fc-5fc01e4d4758 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:06.042882 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2f396-96c0-4038-93fc-5fc01e4d4758 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:06.044267 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2f396-96c0-4038-93fc-5fc01e4d4758 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:06.045029 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2f396-96c0-4038-93fc-5fc01e4d4758 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:06.047258 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2f396-96c0-4038-93fc-5fc01e4d4758 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:06.064895 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 47/106] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:06.067761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5824b-7bb6-45a2-b6f7-8af093f4aba1 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:06.068647 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5824b-7bb6-45a2-b6f7-8af093f4aba1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:06.069443 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5824b-7bb6-45a2-b6f7-8af093f4aba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:06.104375 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-eed5824b-7bb6-45a2-b6f7-8af093f4aba1 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:06.106475 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-eed5824b-7bb6-45a2-b6f7-8af093f4aba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:06.129509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea669a1-6cd0-44ab-a642-6d2fe2ddca37 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:06.167406 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5c41d-4cfc-4f57-b3f4-52b3fb50c330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:06.168312 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5c41d-4cfc-4f57-b3f4-52b3fb50c330 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:06.168593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5c41d-4cfc-4f57-b3f4-52b3fb50c330 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:06.168900 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5c41d-4cfc-4f57-b3f4-52b3fb50c330 None admin] PATH_INFO: `/v3/users/a4e1397234b748429b5677746ccbc985` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:06.170758 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac5c41d-4cfc-4f57-b3f4-52b3fb50c330 None admin] RBAC: Authorizing `identity:get_user(user_id=a4e1397234b748429b5677746ccbc985)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:06.172247 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac5c41d-4cfc-4f57-b3f4-52b3fb50c330 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:06.174663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 60/107] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:06 2022] GET /identity/v3/users/a4e1397234b748429b5677746ccbc985 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:06.175584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5c41d-4cfc-4f57-b3f4-52b3fb50c330 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:06.225395 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:06.290457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5c41d-4cfc-4f57-b3f4-52b3fb50c330 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:06.323602 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 48/108] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:06.325309 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5824b-7bb6-45a2-b6f7-8af093f4aba1 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:06.328975 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01eb0e-9e9d-41cb-b144-f0df7f3e72f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:06.329900 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01eb0e-9e9d-41cb-b144-f0df7f3e72f7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:06.330449 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01eb0e-9e9d-41cb-b144-f0df7f3e72f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:06.330723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01eb0e-9e9d-41cb-b144-f0df7f3e72f7 None admin] PATH_INFO: `/v3/users/1dd842221d5d48c99a39ab10b215384d` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:06.347880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01eb0e-9e9d-41cb-b144-f0df7f3e72f7 None admin] RBAC: Authorizing `identity:get_user(user_id=1dd842221d5d48c99a39ab10b215384d)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:06.349419 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01eb0e-9e9d-41cb-b144-f0df7f3e72f7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:06.352227 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 61/109] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:06 2022] GET /identity/v3/users/1dd842221d5d48c99a39ab10b215384d => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:06.354169 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e074957-e658-4e55-abc9-57748d91609c None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:06.354453 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e074957-e658-4e55-abc9-57748d91609c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:06.354757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e074957-e658-4e55-abc9-57748d91609c None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:06.356738 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 62/110] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:06.363456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e074957-e658-4e55-abc9-57748d91609c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:06.487905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:06.497544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:06.499629 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e074957-e658-4e55-abc9-57748d91609c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:06.507476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5824b-7bb6-45a2-b6f7-8af093f4aba1 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:06.541222 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc251a6b-a2d4-422a-af8d-fe9e72d365d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:06.542135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc251a6b-a2d4-422a-af8d-fe9e72d365d1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:06.542355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc251a6b-a2d4-422a-af8d-fe9e72d365d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:06.542707 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc251a6b-a2d4-422a-af8d-fe9e72d365d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:06.548175 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016d3e6-372a-4924-94e6-c7e6e69a07b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:06.549100 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016d3e6-372a-4924-94e6-c7e6e69a07b4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:06.549460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016d3e6-372a-4924-94e6-c7e6e69a07b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:06.549744 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016d3e6-372a-4924-94e6-c7e6e69a07b4 None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:06.551003 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016d3e6-372a-4924-94e6-c7e6e69a07b4 None admin] RBAC: Authorizing `identity:get_project(project_id=4c9b1fef5ff14878b0fe811a533eb847)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:06.552502 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016d3e6-372a-4924-94e6-c7e6e69a07b4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:06.554426 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 49/111] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:06 2022] GET /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:06.555512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cce8c3-490c-48aa-9484-1ac5824aa39c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:06.555787 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cce8c3-490c-48aa-9484-1ac5824aa39c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:06.556069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cce8c3-490c-48aa-9484-1ac5824aa39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:06.573925 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b5cce8c3-490c-48aa-9484-1ac5824aa39c None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:06.575368 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b5cce8c3-490c-48aa-9484-1ac5824aa39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:06.628879 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc251a6b-a2d4-422a-af8d-fe9e72d365d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:06.631079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc251a6b-a2d4-422a-af8d-fe9e72d365d1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:06.651004 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 50/112] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:06.651937 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cce8c3-490c-48aa-9484-1ac5824aa39c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:06.743353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:06.753007 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 63/113] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:06.754439 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a447f-b75b-49d8-8909-857a0cbbabde None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:06.754761 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a447f-b75b-49d8-8909-857a0cbbabde None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:06.754991 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a447f-b75b-49d8-8909-857a0cbbabde None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:06.756755 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 64/114] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:06.757448 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d5183-0541-494a-92ec-6d84e83b1f6a None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:06.757757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d5183-0541-494a-92ec-6d84e83b1f6a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:06.758078 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d5183-0541-494a-92ec-6d84e83b1f6a None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:06.759325 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 65/115] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:06.760089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d5183-0541-494a-92ec-6d84e83b1f6a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:06.787636 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:06.796306 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cce8c3-490c-48aa-9484-1ac5824aa39c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:06.833313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544126b-3afd-42e7-b765-7204d23438df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:06.834132 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544126b-3afd-42e7-b765-7204d23438df None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:06.834416 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544126b-3afd-42e7-b765-7204d23438df None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:06.834691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544126b-3afd-42e7-b765-7204d23438df None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:06.835876 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544126b-3afd-42e7-b765-7204d23438df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:06.837382 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544126b-3afd-42e7-b765-7204d23438df None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:06.839193 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 51/116] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:06.840045 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544126b-3afd-42e7-b765-7204d23438df None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:06.901598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d5183-0541-494a-92ec-6d84e83b1f6a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:06.945030 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b3841-959c-41b4-a91f-01e4b1233fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:06.946104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b3841-959c-41b4-a91f-01e4b1233fba None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:06.946402 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b3841-959c-41b4-a91f-01e4b1233fba None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:06.946706 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b3841-959c-41b4-a91f-01e4b1233fba None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847/users/a4e1397234b748429b5677746ccbc985/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:06.949375 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b3841-959c-41b4-a91f-01e4b1233fba None admin] RBAC: Authorizing `identity:create_grant(project_id=4c9b1fef5ff14878b0fe811a533eb847, user_id=a4e1397234b748429b5677746ccbc985, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:06.951017 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b3841-959c-41b4-a91f-01e4b1233fba None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:06.952610 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544126b-3afd-42e7-b765-7204d23438df None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:06.973989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 66/117] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:51:06 2022] PUT /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847/users/a4e1397234b748429b5677746ccbc985/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:51:06.975047 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b3841-959c-41b4-a91f-01e4b1233fba None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:07.001707 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4d4e3-4696-452a-af1b-2338dff518d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:07.002736 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4d4e3-4696-452a-af1b-2338dff518d7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:07.003159 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4d4e3-4696-452a-af1b-2338dff518d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:07.003472 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4d4e3-4696-452a-af1b-2338dff518d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:07.017447 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4d4e3-4696-452a-af1b-2338dff518d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:07.028201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-bbd4d4e3-4696-452a-af1b-2338dff518d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:07.028201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:07.028201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:07.028201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:07.028201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:07.028201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:07.028201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:07.028201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:07.028201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:07.028201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:07.028201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:07.028201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:07.028201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:07.028201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:07.028201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:07.028201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:07.029266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:07.029266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:07.029266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:07.029266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:07.029266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:07.029266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:07.029266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:07.029266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:07.029266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:07.029266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:07.029266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:07.029266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:07.029266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:07.029266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:07.029266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:07.029266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:07.030017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:07.030017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:07.030017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:07.030017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:07.030017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:07.030017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:07.030017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:07.030017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:07.030017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:07.030017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:07.030017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:07.030017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:07.030017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 52/118] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 19 10:51:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:07.031364 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740aa47e-c258-4b83-9295-3c24da50c5f2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:07.031800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740aa47e-c258-4b83-9295-3c24da50c5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:07.032113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740aa47e-c258-4b83-9295-3c24da50c5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:07.052327 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-740aa47e-c258-4b83-9295-3c24da50c5f2 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:07.053809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-740aa47e-c258-4b83-9295-3c24da50c5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:07.067962 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:07.078117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:07.152426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b3841-959c-41b4-a91f-01e4b1233fba None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:07.159750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 53/119] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:07.167948 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5d57a-9632-4f55-a47c-3f111997508a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:07.168436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5d57a-9632-4f55-a47c-3f111997508a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:07.169437 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5d57a-9632-4f55-a47c-3f111997508a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:07.190573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a0e5d57a-9632-4f55-a47c-3f111997508a None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:07.191860 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a0e5d57a-9632-4f55-a47c-3f111997508a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:07.195208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcce977-1231-44be-a56f-5c834b38748e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:07.196119 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcce977-1231-44be-a56f-5c834b38748e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:07.196395 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcce977-1231-44be-a56f-5c834b38748e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:07.196760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcce977-1231-44be-a56f-5c834b38748e None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:07.198195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcce977-1231-44be-a56f-5c834b38748e None admin] RBAC: Authorizing `identity:get_project(project_id=4c9b1fef5ff14878b0fe811a533eb847)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:07.199790 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcce977-1231-44be-a56f-5c834b38748e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:07.202159 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 67/120] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:06 2022] GET /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:07.202767 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcce977-1231-44be-a56f-5c834b38748e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:07.268049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 54/121] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:07.270871 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5d57a-9632-4f55-a47c-3f111997508a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:07.365137 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcce977-1231-44be-a56f-5c834b38748e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:07.373363 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:07.396851 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5d57a-9632-4f55-a47c-3f111997508a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:07.397442 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:07.412924 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6b028-653c-43f0-a1f6-0494c4931219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:07.413613 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6b028-653c-43f0-a1f6-0494c4931219 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:07.413892 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6b028-653c-43f0-a1f6-0494c4931219 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:07.414196 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6b028-653c-43f0-a1f6-0494c4931219 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:07.414883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6b028-653c-43f0-a1f6-0494c4931219 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:07.416403 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6b028-653c-43f0-a1f6-0494c4931219 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:07.454044 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 68/122] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 19 10:51:07 2022] POST /identity/v3/projects => generated 302 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:51:07.455544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7539c-fd99-43e6-9dd8-98b0e5927a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:07.456695 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7539c-fd99-43e6-9dd8-98b0e5927a94 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:07.457062 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7539c-fd99-43e6-9dd8-98b0e5927a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:07.457570 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7539c-fd99-43e6-9dd8-98b0e5927a94 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:07.458870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7539c-fd99-43e6-9dd8-98b0e5927a94 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:07.459454 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7539c-fd99-43e6-9dd8-98b0e5927a94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:07.462978 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7539c-fd99-43e6-9dd8-98b0e5927a94 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:07.465763 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6b028-653c-43f0-a1f6-0494c4931219 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:07.478556 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 55/123] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:51:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:07.479866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7539c-fd99-43e6-9dd8-98b0e5927a94 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:07.624906 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6b028-653c-43f0-a1f6-0494c4931219 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:07.642690 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7539c-fd99-43e6-9dd8-98b0e5927a94 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:07.689469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ac9aa-34f7-4b2c-8aae-372febd1e9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:07.691130 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ac9aa-34f7-4b2c-8aae-372febd1e9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:07.691445 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ac9aa-34f7-4b2c-8aae-372febd1e9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:07.691719 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ac9aa-34f7-4b2c-8aae-372febd1e9d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:07.696474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548b49f-307f-42df-a282-4392c92917ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:07.697245 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548b49f-307f-42df-a282-4392c92917ae None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:07.697571 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548b49f-307f-42df-a282-4392c92917ae None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:07.697851 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548b49f-307f-42df-a282-4392c92917ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:07.698770 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548b49f-307f-42df-a282-4392c92917ae None admin] RBAC: Adding query filter params (role.id=86a8e86138e340409f4f8986321ed53d, scope.project.id=4c9b1fef5ff14878b0fe811a533eb847, user.id=1dd842221d5d48c99a39ab10b215384d) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:07.699082 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548b49f-307f-42df-a282-4392c92917ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:07.700636 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548b49f-307f-42df-a282-4392c92917ae None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:07.707170 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 56/124] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:51:07 2022] GET /identity/v3/role_assignments?user.id=1dd842221d5d48c99a39ab10b215384d&scope.project.id=4c9b1fef5ff14878b0fe811a533eb847&role.id=86a8e86138e340409f4f8986321ed53d => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:07.707664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ac9aa-34f7-4b2c-8aae-372febd1e9d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:07.710022 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548b49f-307f-42df-a282-4392c92917ae None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:07.716470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-e67ac9aa-34f7-4b2c-8aae-372febd1e9d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:07.716470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:07.716470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:07.716470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:07.716470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:07.716470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:07.716470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:07.716470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:07.716470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:07.716470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:07.716470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:07.716470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:07.716470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:07.716470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:07.716470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:07.716470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:07.717518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:07.717518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:07.717518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:07.717518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:07.717518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:07.717518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:07.717518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:07.717518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:07.717518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:07.717518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:07.717518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:07.717518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:07.717518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:07.717518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:07.717518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:07.717518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:07.718404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:07.718404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:07.718404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:07.718404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:07.718404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:07.718404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:07.718404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:07.718404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:07.718404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:07.718404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:07.718404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:07.718404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:07.724661 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 69/125] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:51:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:07.725941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ac9aa-34f7-4b2c-8aae-372febd1e9d4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:07.736947 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:07.774456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:07.867274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ac9aa-34f7-4b2c-8aae-372febd1e9d4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:07.908471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d55e6-a59b-4338-a295-041ff381e065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:07.909687 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d55e6-a59b-4338-a295-041ff381e065 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:07.910140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d55e6-a59b-4338-a295-041ff381e065 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:07.910559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d55e6-a59b-4338-a295-041ff381e065 None admin] PATH_INFO: `/v3/users/a4e1397234b748429b5677746ccbc985` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:07.912080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d55e6-a59b-4338-a295-041ff381e065 None admin] RBAC: Authorizing `identity:get_user(user_id=a4e1397234b748429b5677746ccbc985)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:07.913781 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d55e6-a59b-4338-a295-041ff381e065 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:07.915717 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 70/126] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:07 2022] GET /identity/v3/users/a4e1397234b748429b5677746ccbc985 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:07.921957 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d55e6-a59b-4338-a295-041ff381e065 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:07.988474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548b49f-307f-42df-a282-4392c92917ae None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:08.036227 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d55e6-a59b-4338-a295-041ff381e065 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:08.038425 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:08.049537 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00cdc6-d6df-43fb-91ef-71a70c9c2a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:08.050948 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00cdc6-d6df-43fb-91ef-71a70c9c2a65 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:08.050948 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00cdc6-d6df-43fb-91ef-71a70c9c2a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:08.051427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00cdc6-d6df-43fb-91ef-71a70c9c2a65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:08.064440 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00cdc6-d6df-43fb-91ef-71a70c9c2a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:08.073113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-ef00cdc6-d6df-43fb-91ef-71a70c9c2a65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:08.073113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:08.073113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:08.073113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:08.073113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:08.073113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:08.073113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:08.073113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:08.073113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:08.073113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:08.073113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:08.073113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:08.073113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:08.073113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:08.073113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:08.073113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:08.074907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:08.074907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:08.074907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:08.074907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:08.074907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:08.074907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:08.074907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:08.074907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:08.074907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:08.074907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:08.074907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:08.074907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:08.074907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:08.074907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:08.074907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:08.074907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:08.076465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:08.076465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:08.076465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:08.076465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:08.076465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:08.076465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:08.076465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:08.076465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:08.076465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:08.076465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:08.076465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:08.076465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:08.077728 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 57/127] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:08.078646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00cdc6-d6df-43fb-91ef-71a70c9c2a65 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:08.101501 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47566c5-d67f-41b8-8e85-be5faa6f6a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:08.102531 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47566c5-d67f-41b8-8e85-be5faa6f6a20 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:08.103003 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47566c5-d67f-41b8-8e85-be5faa6f6a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:08.103482 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47566c5-d67f-41b8-8e85-be5faa6f6a20 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:08.107107 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47566c5-d67f-41b8-8e85-be5faa6f6a20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:08.107632 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47566c5-d67f-41b8-8e85-be5faa6f6a20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:08.109253 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47566c5-d67f-41b8-8e85-be5faa6f6a20 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:08.123250 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 71/128] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:08.126350 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47566c5-d67f-41b8-8e85-be5faa6f6a20 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:08.187388 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:08.223543 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00cdc6-d6df-43fb-91ef-71a70c9c2a65 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:08.268342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83830d33-510c-4229-b422-c60b75907949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:08.269303 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83830d33-510c-4229-b422-c60b75907949 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:08.269605 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83830d33-510c-4229-b422-c60b75907949 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:08.269941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83830d33-510c-4229-b422-c60b75907949 None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:08.271369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83830d33-510c-4229-b422-c60b75907949 None admin] RBAC: Authorizing `identity:get_project(project_id=4c9b1fef5ff14878b0fe811a533eb847)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:08.272894 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83830d33-510c-4229-b422-c60b75907949 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:08.275493 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 58/129] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:08 2022] GET /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:08.281186 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83830d33-510c-4229-b422-c60b75907949 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:08.394335 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83830d33-510c-4229-b422-c60b75907949 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:08.440991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9b637-9e93-4599-a3da-f8d1835dfda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:08.441827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9b637-9e93-4599-a3da-f8d1835dfda9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:08.442117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9b637-9e93-4599-a3da-f8d1835dfda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:08.442403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9b637-9e93-4599-a3da-f8d1835dfda9 None admin] PATH_INFO: `/v3/users/2c3f1716e28a48c696a1d4a7994e37ba` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:08.446011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47566c5-d67f-41b8-8e85-be5faa6f6a20 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:08.448675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9b637-9e93-4599-a3da-f8d1835dfda9 None admin] RBAC: Authorizing `identity:get_user(user_id=2c3f1716e28a48c696a1d4a7994e37ba)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:08.450288 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9b637-9e93-4599-a3da-f8d1835dfda9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:08.452360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 59/130] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:08 2022] GET /identity/v3/users/2c3f1716e28a48c696a1d4a7994e37ba => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:08.457690 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9b637-9e93-4599-a3da-f8d1835dfda9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:08.475722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:08.513133 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31947a6c-6099-4b5e-a00d-f76df51ee1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:08.514355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31947a6c-6099-4b5e-a00d-f76df51ee1ad None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:08.514953 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31947a6c-6099-4b5e-a00d-f76df51ee1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:08.515237 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31947a6c-6099-4b5e-a00d-f76df51ee1ad None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:08.516103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31947a6c-6099-4b5e-a00d-f76df51ee1ad None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:08.516420 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31947a6c-6099-4b5e-a00d-f76df51ee1ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:08.517879 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31947a6c-6099-4b5e-a00d-f76df51ee1ad None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:08.528478 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 72/131] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:08.529548 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31947a6c-6099-4b5e-a00d-f76df51ee1ad None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:08.562669 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:08.653643 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31947a6c-6099-4b5e-a00d-f76df51ee1ad None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:08.710660 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee923c8e-6561-4b8b-bc63-cbcd3fce59bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:08.711529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee923c8e-6561-4b8b-bc63-cbcd3fce59bf None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:08.711813 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee923c8e-6561-4b8b-bc63-cbcd3fce59bf None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:08.712086 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee923c8e-6561-4b8b-bc63-cbcd3fce59bf None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:08.714379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee923c8e-6561-4b8b-bc63-cbcd3fce59bf None admin] RBAC: Authorizing `identity:get_project(project_id=4c9b1fef5ff14878b0fe811a533eb847)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:08.715855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee923c8e-6561-4b8b-bc63-cbcd3fce59bf None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:08.718532 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 73/132] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:08 2022] GET /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:08.719342 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee923c8e-6561-4b8b-bc63-cbcd3fce59bf None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:08.764752 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9b637-9e93-4599-a3da-f8d1835dfda9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:08.835321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4a8ca-c93b-4b0d-b894-e4029a95babe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:08.836240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4a8ca-c93b-4b0d-b894-e4029a95babe None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:08.836534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4a8ca-c93b-4b0d-b894-e4029a95babe None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:08.836845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4a8ca-c93b-4b0d-b894-e4029a95babe None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847/users/a4e1397234b748429b5677746ccbc985/roles/0a734da5c17d4cd39ea84b75878e55f1` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:08.840976 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4a8ca-c93b-4b0d-b894-e4029a95babe None admin] RBAC: Authorizing `identity:create_grant(project_id=4c9b1fef5ff14878b0fe811a533eb847, user_id=a4e1397234b748429b5677746ccbc985, role_id=0a734da5c17d4cd39ea84b75878e55f1)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:08.842476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4a8ca-c93b-4b0d-b894-e4029a95babe None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:08.872889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 60/133] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:51:08 2022] PUT /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847/users/a4e1397234b748429b5677746ccbc985/roles/0a734da5c17d4cd39ea84b75878e55f1 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:51:08.878053 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4a8ca-c93b-4b0d-b894-e4029a95babe None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:08.908763 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:08.919841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee923c8e-6561-4b8b-bc63-cbcd3fce59bf None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:08.981610 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e39c2b-fb08-4846-9d4f-7ff555c3c646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:08.982972 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e39c2b-fb08-4846-9d4f-7ff555c3c646 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:08.983260 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e39c2b-fb08-4846-9d4f-7ff555c3c646 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:08.983568 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e39c2b-fb08-4846-9d4f-7ff555c3c646 None admin] PATH_INFO: `/v3/users/a4e1397234b748429b5677746ccbc985` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:08.985154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e39c2b-fb08-4846-9d4f-7ff555c3c646 None admin] RBAC: Authorizing `identity:get_user(user_id=a4e1397234b748429b5677746ccbc985)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:08.987043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e39c2b-fb08-4846-9d4f-7ff555c3c646 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:08.991042 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 74/134] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:08 2022] GET /identity/v3/users/a4e1397234b748429b5677746ccbc985 => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:09.002694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e39c2b-fb08-4846-9d4f-7ff555c3c646 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:09.026999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:09.128932 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4a8ca-c93b-4b0d-b894-e4029a95babe None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:09.199127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e39c2b-fb08-4846-9d4f-7ff555c3c646 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:09.206054 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d80818-0421-42d8-b69f-2bc33e31def1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:09.207289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d80818-0421-42d8-b69f-2bc33e31def1 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:09.207781 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d80818-0421-42d8-b69f-2bc33e31def1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:09.208242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d80818-0421-42d8-b69f-2bc33e31def1 None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847/users/2c3f1716e28a48c696a1d4a7994e37ba/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:09.214183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d80818-0421-42d8-b69f-2bc33e31def1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c9b1fef5ff14878b0fe811a533eb847, user_id=2c3f1716e28a48c696a1d4a7994e37ba, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:09.215991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d80818-0421-42d8-b69f-2bc33e31def1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:09.235560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 61/135] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:51:08 2022] PUT /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847/users/2c3f1716e28a48c696a1d4a7994e37ba/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:51:09.265823 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31820053-4b1b-46c7-a2ce-dc36737b0c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:09.267549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31820053-4b1b-46c7-a2ce-dc36737b0c7f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:09.267850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31820053-4b1b-46c7-a2ce-dc36737b0c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:09.268245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31820053-4b1b-46c7-a2ce-dc36737b0c7f None admin] PATH_INFO: `/v3/projects/5d43746f642649cab2d3a0be97046cce` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:09.270101 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31820053-4b1b-46c7-a2ce-dc36737b0c7f None admin] RBAC: Authorizing `identity:get_project(project_id=5d43746f642649cab2d3a0be97046cce)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:09.271893 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31820053-4b1b-46c7-a2ce-dc36737b0c7f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:09.275209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 75/136] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:09 2022] GET /identity/v3/projects/5d43746f642649cab2d3a0be97046cce => generated 312 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:09.283532 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d80818-0421-42d8-b69f-2bc33e31def1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:09.442755 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d80818-0421-42d8-b69f-2bc33e31def1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:09.477181 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:09.493030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b7609-6661-4dce-b7b2-c7877992dd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:09.493981 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b7609-6661-4dce-b7b2-c7877992dd21 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:09.494266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b7609-6661-4dce-b7b2-c7877992dd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:09.494546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b7609-6661-4dce-b7b2-c7877992dd21 None admin] PATH_INFO: `/v3/projects/5d43746f642649cab2d3a0be97046cce/users/a4e1397234b748429b5677746ccbc985/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:09.496693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b7609-6661-4dce-b7b2-c7877992dd21 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d43746f642649cab2d3a0be97046cce, user_id=a4e1397234b748429b5677746ccbc985, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:09.498231 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b7609-6661-4dce-b7b2-c7877992dd21 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:09.515319 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 62/137] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:51:09 2022] PUT /identity/v3/projects/5d43746f642649cab2d3a0be97046cce/users/a4e1397234b748429b5677746ccbc985/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:51:09.754760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de0ac3-32d4-45d0-abfa-32d3f0797ff0 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:09.755653 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de0ac3-32d4-45d0-abfa-32d3f0797ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:09.756102 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de0ac3-32d4-45d0-abfa-32d3f0797ff0 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:09.757719 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 76/138] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:09.763659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42ae6e-ac50-4e0b-a295-b6175b153733 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:09.763926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42ae6e-ac50-4e0b-a295-b6175b153733 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:09.764206 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42ae6e-ac50-4e0b-a295-b6175b153733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:09.785854 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ab42ae6e-ac50-4e0b-a295-b6175b153733 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:09.787077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ab42ae6e-ac50-4e0b-a295-b6175b153733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:09.879355 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 63/139] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:09.915484 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de0ac3-32d4-45d0-abfa-32d3f0797ff0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:09.959072 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:10.043216 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de0ac3-32d4-45d0-abfa-32d3f0797ff0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:10.079346 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508402e4-93bc-4ecc-8128-481f804ad64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:10.080543 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508402e4-93bc-4ecc-8128-481f804ad64a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:10.081050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508402e4-93bc-4ecc-8128-481f804ad64a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:10.081530 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508402e4-93bc-4ecc-8128-481f804ad64a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:10.093319 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508402e4-93bc-4ecc-8128-481f804ad64a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:10.101444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-508402e4-93bc-4ecc-8128-481f804ad64a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:10.101444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:10.101444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:10.101444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:10.101444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:10.101444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:10.101444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:10.101444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:10.101444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:10.101444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:10.101444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:10.101444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:10.101444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:10.101444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:10.101444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:10.101444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:10.102289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:10.102289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:10.102289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:10.102289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:10.102289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:10.102289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:10.102289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:10.102289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:10.102289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:10.102289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:10.102289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:10.102289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:10.102289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:10.102289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:10.102289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:10.102289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:10.103041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:10.103041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:10.103041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:10.103041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:10.103041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:10.103041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:10.103041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:10.103041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:10.103041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:10.103041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:10.103041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:10.103041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:10.105858 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 77/140] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:51:10.114200 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42ae6e-ac50-4e0b-a295-b6175b153733 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:10.271190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42ae6e-ac50-4e0b-a295-b6175b153733 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:10.286235 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:10.316263 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bf999-1353-4746-8feb-15f55ad8e6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:10.316932 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bf999-1353-4746-8feb-15f55ad8e6ca None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:10.317225 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bf999-1353-4746-8feb-15f55ad8e6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:10.317501 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bf999-1353-4746-8feb-15f55ad8e6ca None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:10.318257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bf999-1353-4746-8feb-15f55ad8e6ca None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:10.318563 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bf999-1353-4746-8feb-15f55ad8e6ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:10.319957 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bf999-1353-4746-8feb-15f55ad8e6ca None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:10.329341 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 64/141] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:10.337936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508402e4-93bc-4ecc-8128-481f804ad64a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:10.493099 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:10.497599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508402e4-93bc-4ecc-8128-481f804ad64a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:10.534781 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a12ed-50b6-4aba-bb1b-1ac35a900b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:10.535761 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a12ed-50b6-4aba-bb1b-1ac35a900b95 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:10.536036 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a12ed-50b6-4aba-bb1b-1ac35a900b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:10.536305 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a12ed-50b6-4aba-bb1b-1ac35a900b95 None admin] PATH_INFO: `/v3/users/a4e1397234b748429b5677746ccbc985` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:10.537761 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a12ed-50b6-4aba-bb1b-1ac35a900b95 None admin] RBAC: Authorizing `identity:get_user(user_id=a4e1397234b748429b5677746ccbc985)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:10.539246 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a12ed-50b6-4aba-bb1b-1ac35a900b95 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:10.541959 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 78/142] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:10 2022] GET /identity/v3/users/a4e1397234b748429b5677746ccbc985 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:10.547148 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bf999-1353-4746-8feb-15f55ad8e6ca None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:10.554010 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cebf88-d4dc-4d7b-abb3-47fc1be6886b None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:10.554375 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cebf88-d4dc-4d7b-abb3-47fc1be6886b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:10.554653 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cebf88-d4dc-4d7b-abb3-47fc1be6886b None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:10.556467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 79/143] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:51:10.562168 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ea29d-6ca6-40ea-80b1-0a307615e44c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:10.562499 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ea29d-6ca6-40ea-80b1-0a307615e44c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:10.562862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ea29d-6ca6-40ea-80b1-0a307615e44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:10.581659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4e5ea29d-6ca6-40ea-80b1-0a307615e44c None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:10.582795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4e5ea29d-6ca6-40ea-80b1-0a307615e44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:10.671211 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 80/144] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:51:10.719488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ea29d-6ca6-40ea-80b1-0a307615e44c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:10.752569 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bf999-1353-4746-8feb-15f55ad8e6ca None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:10.802073 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33f964-b7db-47f2-a35c-a928a9695793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:10.803121 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33f964-b7db-47f2-a35c-a928a9695793 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:10.803621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33f964-b7db-47f2-a35c-a928a9695793 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:10.804323 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33f964-b7db-47f2-a35c-a928a9695793 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:10.881582 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:10.886939 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:10.906994 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ea29d-6ca6-40ea-80b1-0a307615e44c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:10.924542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33f964-b7db-47f2-a35c-a928a9695793 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:10.930327 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33f964-b7db-47f2-a35c-a928a9695793 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:10.969588 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebece376-49a3-4e59-9425-14857de4a8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:10.970926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebece376-49a3-4e59-9425-14857de4a8dc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:10.971488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebece376-49a3-4e59-9425-14857de4a8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:10.971959 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebece376-49a3-4e59-9425-14857de4a8dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:10.999622 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebece376-49a3-4e59-9425-14857de4a8dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:11.007711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-ebece376-49a3-4e59-9425-14857de4a8dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:51:11.007711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:11.007711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:11.007711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:11.007711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:11.007711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:11.007711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:11.007711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:11.007711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:11.007711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:11.007711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:11.007711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:11.007711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:11.007711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:11.007711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:11.007711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:11.008559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:11.008559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:11.008559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:11.008559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:11.008559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:11.008559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:11.008559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:11.008559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:11.008559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:11.008559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:11.008559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:11.008559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:11.008559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:11.008559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:11.008559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:11.008559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:11.009387 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:11.009387 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:11.009387 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:11.009387 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:11.009387 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:11.009387 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:11.009387 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:11.009387 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:11.009387 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:11.009387 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:11.009387 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:51:11.009387 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:11.009387 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 81/145] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:11.015998 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5522d-dc68-4495-bd32-878d70a914f0 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:11.016499 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5522d-dc68-4495-bd32-878d70a914f0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:11.017031 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5522d-dc68-4495-bd32-878d70a914f0 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:11.019687 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 82/146] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:11.021629 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5522d-dc68-4495-bd32-878d70a914f0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:11.127358 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 65/147] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:11.128678 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc4d71-d9b0-480e-a8a9-46701c6dcab5 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:11.128994 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc4d71-d9b0-480e-a8a9-46701c6dcab5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:11.129269 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc4d71-d9b0-480e-a8a9-46701c6dcab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:11.161874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8abc4d71-d9b0-480e-a8a9-46701c6dcab5 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:11.162978 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8abc4d71-d9b0-480e-a8a9-46701c6dcab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:11.224533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5522d-dc68-4495-bd32-878d70a914f0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:11.293342 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb3054-19ce-4318-a78e-db7d8e2bd017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:11.294549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb3054-19ce-4318-a78e-db7d8e2bd017 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:11.295057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb3054-19ce-4318-a78e-db7d8e2bd017 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:11.295619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb3054-19ce-4318-a78e-db7d8e2bd017 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:11.297136 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb3054-19ce-4318-a78e-db7d8e2bd017 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:11.297701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb3054-19ce-4318-a78e-db7d8e2bd017 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:11.300361 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb3054-19ce-4318-a78e-db7d8e2bd017 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:11.320686 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 83/148] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:11.323620 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb3054-19ce-4318-a78e-db7d8e2bd017 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:11.331639 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 66/149] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:11.333337 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc4d71-d9b0-480e-a8a9-46701c6dcab5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:11.349103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:11.355390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:11.527599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb3054-19ce-4318-a78e-db7d8e2bd017 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:11.553892 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc4d71-d9b0-480e-a8a9-46701c6dcab5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:11.588226 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3106c6-1b3c-44c9-ab8e-2c626c03369b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:11.589487 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3106c6-1b3c-44c9-ab8e-2c626c03369b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:11.591467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3106c6-1b3c-44c9-ab8e-2c626c03369b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:11.591962 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3106c6-1b3c-44c9-ab8e-2c626c03369b None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:11.593448 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3106c6-1b3c-44c9-ab8e-2c626c03369b None admin] RBAC: Authorizing `identity:get_project(project_id=4c9b1fef5ff14878b0fe811a533eb847)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:11.599390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3106c6-1b3c-44c9-ab8e-2c626c03369b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:11.603014 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 84/150] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:11 2022] GET /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:11.604420 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3106c6-1b3c-44c9-ab8e-2c626c03369b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:11.629242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07bb32-0d77-45f7-89f5-a355e4a0db29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:11.631947 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07bb32-0d77-45f7-89f5-a355e4a0db29 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:11.633672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07bb32-0d77-45f7-89f5-a355e4a0db29 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:11.634155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07bb32-0d77-45f7-89f5-a355e4a0db29 None admin] PATH_INFO: `/v3/users/1dd842221d5d48c99a39ab10b215384d` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:11.637251 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07bb32-0d77-45f7-89f5-a355e4a0db29 None admin] RBAC: Authorizing `identity:get_user(user_id=1dd842221d5d48c99a39ab10b215384d)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:11.638954 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07bb32-0d77-45f7-89f5-a355e4a0db29 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:11.641073 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 67/151] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:11 2022] GET /identity/v3/users/1dd842221d5d48c99a39ab10b215384d => generated 289 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:11.642041 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07bb32-0d77-45f7-89f5-a355e4a0db29 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:11.718119 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:11.748752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3106c6-1b3c-44c9-ab8e-2c626c03369b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:11.785350 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:11.807407 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07bb32-0d77-45f7-89f5-a355e4a0db29 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:11.834240 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e455ea-49e7-45d3-a4af-4e30553116fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:11.835573 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e455ea-49e7-45d3-a4af-4e30553116fc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:11.836057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e455ea-49e7-45d3-a4af-4e30553116fc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:11.836522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e455ea-49e7-45d3-a4af-4e30553116fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:11.841561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e455ea-49e7-45d3-a4af-4e30553116fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:11.843551 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e455ea-49e7-45d3-a4af-4e30553116fc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:11.845878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 85/152] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:11.846952 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e455ea-49e7-45d3-a4af-4e30553116fc None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:11.854105 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ccbae-941a-42bf-92ad-7bf9c1f84cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:11.854789 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ccbae-941a-42bf-92ad-7bf9c1f84cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:11.855076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ccbae-941a-42bf-92ad-7bf9c1f84cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:11.855355 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ccbae-941a-42bf-92ad-7bf9c1f84cf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:11.856210 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ccbae-941a-42bf-92ad-7bf9c1f84cf7 None admin] RBAC: Adding query filter params (role.id=6ff885694ad84e4cb935ef1c1f001858, scope.project.id=4c9b1fef5ff14878b0fe811a533eb847, user.id=a4e1397234b748429b5677746ccbc985) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:11.856525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ccbae-941a-42bf-92ad-7bf9c1f84cf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:11.858087 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ccbae-941a-42bf-92ad-7bf9c1f84cf7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:11.868215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 68/153] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:51:11 2022] GET /identity/v3/role_assignments?user.id=a4e1397234b748429b5677746ccbc985&scope.project.id=4c9b1fef5ff14878b0fe811a533eb847&role.id=6ff885694ad84e4cb935ef1c1f001858 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:11.868215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ccbae-941a-42bf-92ad-7bf9c1f84cf7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:12.011879 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e455ea-49e7-45d3-a4af-4e30553116fc None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:12.012775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ccbae-941a-42bf-92ad-7bf9c1f84cf7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:12.054146 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2def05-fcbf-4c52-88fe-2b25c6eafa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:12.054847 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2def05-fcbf-4c52-88fe-2b25c6eafa48 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:12.055134 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2def05-fcbf-4c52-88fe-2b25c6eafa48 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:12.055426 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2def05-fcbf-4c52-88fe-2b25c6eafa48 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:12.056196 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2def05-fcbf-4c52-88fe-2b25c6eafa48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:12.057868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2def05-fcbf-4c52-88fe-2b25c6eafa48 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:12.067830 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:12.095445 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 69/154] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 19 10:51:11 2022] POST /identity/v3/users => generated 283 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:51:12.100762 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6b74b-ad7e-4ff4-9eed-76a3d843fb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:12.102337 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6b74b-ad7e-4ff4-9eed-76a3d843fb7c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:12.102951 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6b74b-ad7e-4ff4-9eed-76a3d843fb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:12.103860 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6b74b-ad7e-4ff4-9eed-76a3d843fb7c None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:12.105802 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6b74b-ad7e-4ff4-9eed-76a3d843fb7c None admin] RBAC: Authorizing `identity:get_project(project_id=4c9b1fef5ff14878b0fe811a533eb847)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:12.107869 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6b74b-ad7e-4ff4-9eed-76a3d843fb7c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:12.110571 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 86/155] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:11 2022] GET /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:12.117344 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2def05-fcbf-4c52-88fe-2b25c6eafa48 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:12.161955 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f47c0-a472-45d6-8260-6d144c0fa27a None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:12.163677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f47c0-a472-45d6-8260-6d144c0fa27a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:12.164237 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f47c0-a472-45d6-8260-6d144c0fa27a None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:12.166097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 87/156] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:51:12.178586 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189180d8-140e-4914-8530-f9b345610768 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:12.178893 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189180d8-140e-4914-8530-f9b345610768 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:12.179126 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189180d8-140e-4914-8530-f9b345610768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:12.214688 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-189180d8-140e-4914-8530-f9b345610768 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:12.216007 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-189180d8-140e-4914-8530-f9b345610768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:12.247901 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:12.307354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2def05-fcbf-4c52-88fe-2b25c6eafa48 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:12.354481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768add46-01a1-4281-a6a2-3a8e9e6e868c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:12.354481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768add46-01a1-4281-a6a2-3a8e9e6e868c None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:12.354481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768add46-01a1-4281-a6a2-3a8e9e6e868c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:12.355009 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768add46-01a1-4281-a6a2-3a8e9e6e868c None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847/users/1dd842221d5d48c99a39ab10b215384d/roles/86a8e86138e340409f4f8986321ed53d` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:12.356893 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768add46-01a1-4281-a6a2-3a8e9e6e868c None admin] RBAC: Authorizing `identity:create_grant(project_id=4c9b1fef5ff14878b0fe811a533eb847, user_id=1dd842221d5d48c99a39ab10b215384d, role_id=86a8e86138e340409f4f8986321ed53d)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:12.358502 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768add46-01a1-4281-a6a2-3a8e9e6e868c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:12.367362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 88/157] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:51:12.375316 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 70/158] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:51:12 2022] PUT /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847/users/1dd842221d5d48c99a39ab10b215384d/roles/86a8e86138e340409f4f8986321ed53d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:51:12.399004 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189180d8-140e-4914-8530-f9b345610768 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:12.502856 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885580c-3175-4c23-856d-f9b9e493bd6c None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:12.503173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885580c-3175-4c23-856d-f9b9e493bd6c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:12.503414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885580c-3175-4c23-856d-f9b9e493bd6c None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:12.505049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 71/159] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:51:12.512079 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af99df5-001b-4318-bf41-9db1f8617e76 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:12.512799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af99df5-001b-4318-bf41-9db1f8617e76 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:12.513556 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af99df5-001b-4318-bf41-9db1f8617e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:12.537959 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189180d8-140e-4914-8530-f9b345610768 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:12.538154 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-0af99df5-001b-4318-bf41-9db1f8617e76 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:12.540074 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0af99df5-001b-4318-bf41-9db1f8617e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:12.581459 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc806881-3087-4bdb-b903-e9f321d5dcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:12.582619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc806881-3087-4bdb-b903-e9f321d5dcfd None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:12.583108 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc806881-3087-4bdb-b903-e9f321d5dcfd None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:12.583559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc806881-3087-4bdb-b903-e9f321d5dcfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:12.595983 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc806881-3087-4bdb-b903-e9f321d5dcfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:12.604630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-fc806881-3087-4bdb-b903-e9f321d5dcfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:12.604630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:12.604630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:12.604630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:12.604630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:12.604630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:12.604630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:12.604630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:12.604630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:12.604630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:12.604630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:12.604630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:12.604630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:12.604630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:12.604630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:12.604630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:12.605561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:12.605561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:12.605561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:12.605561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:12.605561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:12.605561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:12.605561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:12.605561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:12.605561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:12.605561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:12.605561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:12.605561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:12.605561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:12.605561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:12.605561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:12.605561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:12.606330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:12.606330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:12.606330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:12.606330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:12.606330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:12.606330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:12.606330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:12.606330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:12.606330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:12.606330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:12.606330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:12.606330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:12.608668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 89/160] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:51:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:12.610419 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:12.617223 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc806881-3087-4bdb-b903-e9f321d5dcfd None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:12.623884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:12.637912 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 72/161] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:51:12.668933 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af99df5-001b-4318-bf41-9db1f8617e76 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:12.768178 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc806881-3087-4bdb-b903-e9f321d5dcfd None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:12.825153 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ec3a8-34ec-4edf-937d-6a1286e22ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:12.825841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ec3a8-34ec-4edf-937d-6a1286e22ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:12.826120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ec3a8-34ec-4edf-937d-6a1286e22ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:12.826392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ec3a8-34ec-4edf-937d-6a1286e22ac2 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:12.827153 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ec3a8-34ec-4edf-937d-6a1286e22ac2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:12.827457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ec3a8-34ec-4edf-937d-6a1286e22ac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:12.828899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ec3a8-34ec-4edf-937d-6a1286e22ac2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:12.840317 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 90/162] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:12.844567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce62eac-d078-421d-83b4-7a8eee6cee35 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:12.844883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce62eac-d078-421d-83b4-7a8eee6cee35 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:12.845281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce62eac-d078-421d-83b4-7a8eee6cee35 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:12.847043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 91/163] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:12.847860 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce62eac-d078-421d-83b4-7a8eee6cee35 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:12.858876 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af99df5-001b-4318-bf41-9db1f8617e76 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:12.911116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ff7d8-ee52-4969-9bdc-1c5bb2720020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:12.913192 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ff7d8-ee52-4969-9bdc-1c5bb2720020 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:12.913688 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ff7d8-ee52-4969-9bdc-1c5bb2720020 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:12.914428 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ff7d8-ee52-4969-9bdc-1c5bb2720020 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:12.931192 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ff7d8-ee52-4969-9bdc-1c5bb2720020 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:12.933106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:12.943247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-b83ff7d8-ee52-4969-9bdc-1c5bb2720020 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:12.943247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:12.943247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:12.943247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:12.943247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:12.943247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:12.943247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:12.943247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:12.943247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:12.943247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:12.943247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:12.943247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:12.943247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:12.943247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:12.943247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:12.943247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:12.944180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:12.944180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:12.944180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:12.944180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:12.944180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:12.944180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:12.944180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:12.944180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:12.944180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:12.944180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:12.944180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:12.944180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:12.944180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:12.944180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:12.944180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:12.944180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:12.944985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:12.944985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:12.944985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:12.944985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:12.944985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:12.944985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:12.944985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:12.944985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:12.944985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:12.944985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:12.944985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:12.944985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:12.947665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 73/164] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 19 10:51:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:12.949623 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4236c-ccc9-4708-b428-27e0c27bce3b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:12.950143 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4236c-ccc9-4708-b428-27e0c27bce3b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:12.950636 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4236c-ccc9-4708-b428-27e0c27bce3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:12.972360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-17e4236c-ccc9-4708-b428-27e0c27bce3b None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:12.974404 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-17e4236c-ccc9-4708-b428-27e0c27bce3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:12.979413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce62eac-d078-421d-83b4-7a8eee6cee35 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:13.021837 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06170e-2128-4e3f-a4ea-d9e3257fc5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:13.022876 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06170e-2128-4e3f-a4ea-d9e3257fc5cc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:13.023056 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06170e-2128-4e3f-a4ea-d9e3257fc5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:13.023348 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06170e-2128-4e3f-a4ea-d9e3257fc5cc None admin] PATH_INFO: `/v3/users/2c3f1716e28a48c696a1d4a7994e37ba` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:13.025709 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06170e-2128-4e3f-a4ea-d9e3257fc5cc None admin] RBAC: Authorizing `identity:get_user(user_id=2c3f1716e28a48c696a1d4a7994e37ba)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:13.027304 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06170e-2128-4e3f-a4ea-d9e3257fc5cc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:13.029031 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 92/165] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:12 2022] GET /identity/v3/users/2c3f1716e28a48c696a1d4a7994e37ba => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:13.030002 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06170e-2128-4e3f-a4ea-d9e3257fc5cc None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:13.032399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:13.072815 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 74/166] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:13.073946 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4236c-ccc9-4708-b428-27e0c27bce3b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:13.178529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06170e-2128-4e3f-a4ea-d9e3257fc5cc None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:13.219004 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a6494-915b-49e1-a9c5-b569107333e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:13.220069 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a6494-915b-49e1-a9c5-b569107333e2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:13.220562 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a6494-915b-49e1-a9c5-b569107333e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:13.221064 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a6494-915b-49e1-a9c5-b569107333e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:13.222058 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a6494-915b-49e1-a9c5-b569107333e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:13.222555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a6494-915b-49e1-a9c5-b569107333e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:13.224256 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a6494-915b-49e1-a9c5-b569107333e2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:13.226736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:13.233352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4236c-ccc9-4708-b428-27e0c27bce3b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:13.235531 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 93/167] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:51:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:13.236571 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a6494-915b-49e1-a9c5-b569107333e2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:13.278044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11d861-578d-4c49-9248-6d168d7ed92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:13.278713 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11d861-578d-4c49-9248-6d168d7ed92e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:13.279000 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11d861-578d-4c49-9248-6d168d7ed92e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:13.279283 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11d861-578d-4c49-9248-6d168d7ed92e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:13.338236 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:13.367196 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11d861-578d-4c49-9248-6d168d7ed92e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:13.369385 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11d861-578d-4c49-9248-6d168d7ed92e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:13.375280 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a6494-915b-49e1-a9c5-b569107333e2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:13.440300 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218c467-e250-49dc-a561-5e5e51d7cca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:13.441537 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218c467-e250-49dc-a561-5e5e51d7cca3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:13.442009 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218c467-e250-49dc-a561-5e5e51d7cca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:13.442482 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218c467-e250-49dc-a561-5e5e51d7cca3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:13.463889 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218c467-e250-49dc-a561-5e5e51d7cca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:13.471591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-a218c467-e250-49dc-a561-5e5e51d7cca3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:13.471591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:13.471591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:13.471591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:13.471591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:13.471591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:13.471591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:13.471591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:13.471591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:13.471591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:13.471591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:13.471591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:13.471591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:13.471591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:13.471591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:13.471591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:13.472567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:13.472567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:13.472567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:13.472567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:13.472567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:13.472567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:13.472567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:13.472567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:13.472567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:13.472567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:13.472567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:13.472567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:13.472567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:13.472567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:13.472567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:13.472567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:13.473360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:13.473360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:13.473360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:13.473360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:13.473360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:13.473360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:13.473360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:13.473360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:13.473360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:13.473360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:13.473360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:13.473360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:13.473938 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 94/168] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:13.479799 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218c467-e250-49dc-a561-5e5e51d7cca3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:13.579989 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 75/169] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:13.581329 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11d861-578d-4c49-9248-6d168d7ed92e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:13.617189 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:13.696192 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218c467-e250-49dc-a561-5e5e51d7cca3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:13.770531 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f9bc9-7281-4f7c-bc9d-e2cfb6ee7603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:13.771461 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f9bc9-7281-4f7c-bc9d-e2cfb6ee7603 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:13.771897 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f9bc9-7281-4f7c-bc9d-e2cfb6ee7603 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:13.772256 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f9bc9-7281-4f7c-bc9d-e2cfb6ee7603 None admin] PATH_INFO: `/v3/users/a4e1397234b748429b5677746ccbc985` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:13.779113 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f9bc9-7281-4f7c-bc9d-e2cfb6ee7603 None admin] RBAC: Authorizing `identity:get_user(user_id=a4e1397234b748429b5677746ccbc985)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:13.780738 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f9bc9-7281-4f7c-bc9d-e2cfb6ee7603 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:13.782778 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 95/170] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:13 2022] GET /identity/v3/users/a4e1397234b748429b5677746ccbc985 => generated 275 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:13.783569 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:13.789227 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f9bc9-7281-4f7c-bc9d-e2cfb6ee7603 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:13.838746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11d861-578d-4c49-9248-6d168d7ed92e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:13.909539 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5200b5-9aaa-44cd-be4e-43d5ecd69fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:13.910226 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5200b5-9aaa-44cd-be4e-43d5ecd69fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:13.910511 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5200b5-9aaa-44cd-be4e-43d5ecd69fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:13.910786 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5200b5-9aaa-44cd-be4e-43d5ecd69fd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:13.911589 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5200b5-9aaa-44cd-be4e-43d5ecd69fd3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:13.911896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5200b5-9aaa-44cd-be4e-43d5ecd69fd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:13.913518 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5200b5-9aaa-44cd-be4e-43d5ecd69fd3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:13.923797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 76/171] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:13.924769 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5200b5-9aaa-44cd-be4e-43d5ecd69fd3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:13.984687 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f9bc9-7281-4f7c-bc9d-e2cfb6ee7603 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:14.023411 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:14.049909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcc3d0-cabf-4acf-908d-135347403770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:14.050797 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcc3d0-cabf-4acf-908d-135347403770 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:14.051070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcc3d0-cabf-4acf-908d-135347403770 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:14.051357 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcc3d0-cabf-4acf-908d-135347403770 None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:14.053777 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bcc3d0-cabf-4acf-908d-135347403770 None admin] RBAC: Authorizing `identity:get_project(project_id=4c9b1fef5ff14878b0fe811a533eb847)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:14.056615 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bcc3d0-cabf-4acf-908d-135347403770 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:14.058426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 96/172] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:13 2022] GET /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:14.059237 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcc3d0-cabf-4acf-908d-135347403770 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:14.161567 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5200b5-9aaa-44cd-be4e-43d5ecd69fd3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:14.184650 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcc3d0-cabf-4acf-908d-135347403770 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:14.229344 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1021059-4bf8-4b84-bf98-5f0636f39b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:14.230602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1021059-4bf8-4b84-bf98-5f0636f39b89 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:14.231082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1021059-4bf8-4b84-bf98-5f0636f39b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:14.236836 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1021059-4bf8-4b84-bf98-5f0636f39b89 None admin] PATH_INFO: `/v3/users/a4e1397234b748429b5677746ccbc985` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:14.236836 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1021059-4bf8-4b84-bf98-5f0636f39b89 None admin] RBAC: Authorizing `identity:get_user(user_id=a4e1397234b748429b5677746ccbc985)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:14.236836 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1021059-4bf8-4b84-bf98-5f0636f39b89 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:14.237728 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 97/173] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:14 2022] GET /identity/v3/users/a4e1397234b748429b5677746ccbc985 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:14.238546 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1021059-4bf8-4b84-bf98-5f0636f39b89 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:14.256744 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb184f3-5a08-4706-b3fb-7eb2174a0142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:14.256744 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb184f3-5a08-4706-b3fb-7eb2174a0142 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:14.256744 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb184f3-5a08-4706-b3fb-7eb2174a0142 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:14.257370 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb184f3-5a08-4706-b3fb-7eb2174a0142 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:14.270236 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:14.385199 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:14.446067 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb184f3-5a08-4706-b3fb-7eb2174a0142 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:14.447780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb184f3-5a08-4706-b3fb-7eb2174a0142 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:14.492951 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1021059-4bf8-4b84-bf98-5f0636f39b89 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:14.569969 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bd124-cb4c-4a98-ab5b-9ffca5780d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:14.570673 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bd124-cb4c-4a98-ab5b-9ffca5780d19 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:14.570949 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bd124-cb4c-4a98-ab5b-9ffca5780d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:14.571221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bd124-cb4c-4a98-ab5b-9ffca5780d19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:14.572231 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bd124-cb4c-4a98-ab5b-9ffca5780d19 None admin] RBAC: Adding query filter params (role.id=3f9528e7a7914797a4635aa6b536b7ff, scope.project.id=4c9b1fef5ff14878b0fe811a533eb847, user.id=2c3f1716e28a48c696a1d4a7994e37ba) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:14.572540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bd124-cb4c-4a98-ab5b-9ffca5780d19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:14.574042 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bd124-cb4c-4a98-ab5b-9ffca5780d19 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:14.586819 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 98/174] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:51:14 2022] GET /identity/v3/role_assignments?user.id=2c3f1716e28a48c696a1d4a7994e37ba&scope.project.id=4c9b1fef5ff14878b0fe811a533eb847&role.id=3f9528e7a7914797a4635aa6b536b7ff => generated 608 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:14.587712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bd124-cb4c-4a98-ab5b-9ffca5780d19 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:14.681121 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 77/175] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:14.695159 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb184f3-5a08-4706-b3fb-7eb2174a0142 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:14.771579 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:14.861603 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bd124-cb4c-4a98-ab5b-9ffca5780d19 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:14.928674 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:14.954617 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb184f3-5a08-4706-b3fb-7eb2174a0142 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:14.970522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e18643-cbb8-4fdf-b2b8-762054d91c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:14.971197 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e18643-cbb8-4fdf-b2b8-762054d91c8e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:14.971475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e18643-cbb8-4fdf-b2b8-762054d91c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:14.971745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e18643-cbb8-4fdf-b2b8-762054d91c8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:15.053075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e686e-e917-49d5-9072-56bd96a16440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:15.054518 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e686e-e917-49d5-9072-56bd96a16440 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:15.055003 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e686e-e917-49d5-9072-56bd96a16440 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:15.055485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e686e-e917-49d5-9072-56bd96a16440 None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:15.061534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e686e-e917-49d5-9072-56bd96a16440 None admin] RBAC: Authorizing `identity:get_project(project_id=4c9b1fef5ff14878b0fe811a533eb847)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:15.063338 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e686e-e917-49d5-9072-56bd96a16440 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:15.065398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 78/176] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:14 2022] GET /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847 => generated 298 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:15.087694 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e686e-e917-49d5-9072-56bd96a16440 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:15.131061 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e18643-cbb8-4fdf-b2b8-762054d91c8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:15.132692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e18643-cbb8-4fdf-b2b8-762054d91c8e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:15.259780 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 99/177] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:15.261685 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecef2d-e632-4399-b558-821e129e90a2 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:15.261973 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecef2d-e632-4399-b558-821e129e90a2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:15.262248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecef2d-e632-4399-b558-821e129e90a2 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:15.264069 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 100/178] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:15.268250 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecef2d-e632-4399-b558-821e129e90a2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:15.305932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:15.318998 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e686e-e917-49d5-9072-56bd96a16440 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:15.326810 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:15.393206 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecef2d-e632-4399-b558-821e129e90a2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:15.393640 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa894e7-2082-4daf-bcdb-2d6b0aeaaa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:15.394552 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa894e7-2082-4daf-bcdb-2d6b0aeaaa39 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:15.395083 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa894e7-2082-4daf-bcdb-2d6b0aeaaa39 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:15.395635 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa894e7-2082-4daf-bcdb-2d6b0aeaaa39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:15.396679 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa894e7-2082-4daf-bcdb-2d6b0aeaaa39 None admin] RBAC: Adding query filter params (role.id=0a734da5c17d4cd39ea84b75878e55f1, scope.project.id=4c9b1fef5ff14878b0fe811a533eb847, user.id=a4e1397234b748429b5677746ccbc985) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:15.397227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa894e7-2082-4daf-bcdb-2d6b0aeaaa39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:15.398886 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa894e7-2082-4daf-bcdb-2d6b0aeaaa39 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:15.409983 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 79/179] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:51:15 2022] GET /identity/v3/role_assignments?user.id=a4e1397234b748429b5677746ccbc985&scope.project.id=4c9b1fef5ff14878b0fe811a533eb847&role.id=0a734da5c17d4cd39ea84b75878e55f1 => generated 608 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:15.411607 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706b6de-3228-4a90-b69a-d8db79aa5a83 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:15.412120 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706b6de-3228-4a90-b69a-d8db79aa5a83 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:15.412677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706b6de-3228-4a90-b69a-d8db79aa5a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:15.440862 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6706b6de-3228-4a90-b69a-d8db79aa5a83 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:15.442111 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6706b6de-3228-4a90-b69a-d8db79aa5a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:15.446233 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849f87d-c5f4-4589-b502-c10a06adcf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:15.447203 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849f87d-c5f4-4589-b502-c10a06adcf14 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:15.447484 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849f87d-c5f4-4589-b502-c10a06adcf14 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:15.447758 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849f87d-c5f4-4589-b502-c10a06adcf14 None admin] PATH_INFO: `/v3/projects/5d43746f642649cab2d3a0be97046cce` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:15.449171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849f87d-c5f4-4589-b502-c10a06adcf14 None admin] RBAC: Authorizing `identity:get_project(project_id=5d43746f642649cab2d3a0be97046cce)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:15.450696 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849f87d-c5f4-4589-b502-c10a06adcf14 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:15.452560 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 101/180] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:15 2022] GET /identity/v3/projects/5d43746f642649cab2d3a0be97046cce => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:15.458978 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db256a9f-fe00-45aa-91ad-c94336683650 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:15.459261 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db256a9f-fe00-45aa-91ad-c94336683650 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:15.459538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db256a9f-fe00-45aa-91ad-c94336683650 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:15.469194 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 102/181] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:15 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:15.470211 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db256a9f-fe00-45aa-91ad-c94336683650 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:15.527585 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 80/182] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:15.529029 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c4677-e32b-4579-ad8d-7ac329fb533b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:15.529357 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c4677-e32b-4579-ad8d-7ac329fb533b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:15.529634 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c4677-e32b-4579-ad8d-7ac329fb533b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:15.560396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5a5c4677-e32b-4579-ad8d-7ac329fb533b None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:15.561581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5a5c4677-e32b-4579-ad8d-7ac329fb533b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:15.667365 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 81/183] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:15.668529 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c4677-e32b-4579-ad8d-7ac329fb533b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:15.703492 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db256a9f-fe00-45aa-91ad-c94336683650 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:15.708513 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:15.717106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:15.744193 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cbf89-93c4-44fc-b1a1-4ca5a2be0a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:15.744932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cbf89-93c4-44fc-b1a1-4ca5a2be0a99 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:15.745182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cbf89-93c4-44fc-b1a1-4ca5a2be0a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:15.745502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cbf89-93c4-44fc-b1a1-4ca5a2be0a99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:15.746338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9cbf89-93c4-44fc-b1a1-4ca5a2be0a99 None admin] RBAC: Adding query filter params (role.id=6ff885694ad84e4cb935ef1c1f001858, scope.project.id=5d43746f642649cab2d3a0be97046cce, user.id=a4e1397234b748429b5677746ccbc985) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:15.746654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9cbf89-93c4-44fc-b1a1-4ca5a2be0a99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:15.748293 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9cbf89-93c4-44fc-b1a1-4ca5a2be0a99 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:15.756342 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 103/184] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:51:15 2022] GET /identity/v3/role_assignments?user.id=a4e1397234b748429b5677746ccbc985&scope.project.id=5d43746f642649cab2d3a0be97046cce&role.id=6ff885694ad84e4cb935ef1c1f001858 => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:15.757221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cbf89-93c4-44fc-b1a1-4ca5a2be0a99 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:15.839084 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c4677-e32b-4579-ad8d-7ac329fb533b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:15.895535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cbf89-93c4-44fc-b1a1-4ca5a2be0a99 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:15.941465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3e2a1-0bee-43d4-a190-8d3cca44ac70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:15.942324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3e2a1-0bee-43d4-a190-8d3cca44ac70 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:15.942611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3e2a1-0bee-43d4-a190-8d3cca44ac70 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:15.942892 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3e2a1-0bee-43d4-a190-8d3cca44ac70 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:15.956318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3e2a1-0bee-43d4-a190-8d3cca44ac70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:15.959067 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5c189-9e5f-45dc-81cf-cb149bf4b333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:15.960106 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5c189-9e5f-45dc-81cf-cb149bf4b333 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:15.960394 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5c189-9e5f-45dc-81cf-cb149bf4b333 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:15.960675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5c189-9e5f-45dc-81cf-cb149bf4b333 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:15.966426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-17a3e2a1-0bee-43d4-a190-8d3cca44ac70 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:51:15.966426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:15.966426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:15.966426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:15.966426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:15.966426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:15.966426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:15.966426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:15.966426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:15.966426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:15.966426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:15.966426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:15.966426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:15.966426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:15.966426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:15.966426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:15.967362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:15.967362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:15.967362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:15.967362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:15.967362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:15.967362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:15.967362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:15.967362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:15.967362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:15.967362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:15.967362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:15.967362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:15.967362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:15.967362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:15.967362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:15.967362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:15.968125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:15.968125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:15.968125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:15.968125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:15.968125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:15.968125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:15.968125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:15.968125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:15.968125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:15.968125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:15.968125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:51:15.968125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:15.968705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 104/185] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:15.975606 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3e2a1-0bee-43d4-a190-8d3cca44ac70 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:15.997368 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5c189-9e5f-45dc-81cf-cb149bf4b333 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:16.006417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-83c5c189-9e5f-45dc-81cf-cb149bf4b333 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:16.006417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:16.006417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:16.006417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:16.006417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:16.006417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:16.006417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:16.006417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:16.006417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:16.006417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:16.006417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:16.006417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:16.006417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:16.006417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:16.006417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:16.006417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:16.008558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:16.008558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:16.008558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:16.008558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:16.008558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:16.008558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:16.008558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:16.008558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:16.008558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:16.008558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:16.008558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:16.008558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:16.008558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:16.008558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:16.008558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:16.008558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:16.010480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:16.010480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:16.010480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:16.010480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:16.010480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:16.010480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:16.010480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:16.010480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:16.010480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:16.010480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:16.010480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:16.010480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:16.010480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 82/186] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:51:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:16.012359 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:16.015020 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5c189-9e5f-45dc-81cf-cb149bf4b333 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:16.113355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3e2a1-0bee-43d4-a190-8d3cca44ac70 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:16.126999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:16.144933 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5c189-9e5f-45dc-81cf-cb149bf4b333 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:16.156891 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5db68-6b41-48d5-908b-7d2fe7054ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:16.162060 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5db68-6b41-48d5-908b-7d2fe7054ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:16.162353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5db68-6b41-48d5-908b-7d2fe7054ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:16.162630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5db68-6b41-48d5-908b-7d2fe7054ec0 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:16.163419 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c5db68-6b41-48d5-908b-7d2fe7054ec0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:16.163718 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c5db68-6b41-48d5-908b-7d2fe7054ec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:16.165764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c5db68-6b41-48d5-908b-7d2fe7054ec0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:16.176508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 105/187] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:16.182986 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5db68-6b41-48d5-908b-7d2fe7054ec0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:16.193437 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c679f-4fb7-4b3b-a909-5b3033c4b869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:16.194613 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c679f-4fb7-4b3b-a909-5b3033c4b869 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:16.195138 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c679f-4fb7-4b3b-a909-5b3033c4b869 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:16.195579 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c679f-4fb7-4b3b-a909-5b3033c4b869 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:16.196594 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c679f-4fb7-4b3b-a909-5b3033c4b869 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:16.197201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c679f-4fb7-4b3b-a909-5b3033c4b869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:16.199233 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c679f-4fb7-4b3b-a909-5b3033c4b869 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:16.210592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 83/188] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:16.217302 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c679f-4fb7-4b3b-a909-5b3033c4b869 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:16.272665 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:16.296985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5db68-6b41-48d5-908b-7d2fe7054ec0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:16.324960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c679f-4fb7-4b3b-a909-5b3033c4b869 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:16.334284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fbed1-408d-4fc2-9642-7d64c7d14793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:16.335551 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fbed1-408d-4fc2-9642-7d64c7d14793 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:16.336049 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fbed1-408d-4fc2-9642-7d64c7d14793 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:16.336496 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fbed1-408d-4fc2-9642-7d64c7d14793 None admin] PATH_INFO: `/v3/users/1dd842221d5d48c99a39ab10b215384d` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:16.338045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fbed1-408d-4fc2-9642-7d64c7d14793 None admin] RBAC: Authorizing `identity:get_user(user_id=1dd842221d5d48c99a39ab10b215384d)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:16.339674 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fbed1-408d-4fc2-9642-7d64c7d14793 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:16.341563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 106/189] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:16 2022] GET /identity/v3/users/1dd842221d5d48c99a39ab10b215384d => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:16.348843 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fbed1-408d-4fc2-9642-7d64c7d14793 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:16.360846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09849387-ce67-46c3-b37e-153de153be35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:16.361732 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09849387-ce67-46c3-b37e-153de153be35 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:16.362011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09849387-ce67-46c3-b37e-153de153be35 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:16.362282 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09849387-ce67-46c3-b37e-153de153be35 None admin] PATH_INFO: `/v3/users/dd8f35f356824171aa9612d39c1ec616` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:16.376453 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09849387-ce67-46c3-b37e-153de153be35 None admin] RBAC: Authorizing `identity:get_user(user_id=dd8f35f356824171aa9612d39c1ec616)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:16.377876 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09849387-ce67-46c3-b37e-153de153be35 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:16.379796 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 84/190] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:16 2022] GET /identity/v3/users/dd8f35f356824171aa9612d39c1ec616 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:16.384974 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09849387-ce67-46c3-b37e-153de153be35 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:16.395580 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:16.479826 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fbed1-408d-4fc2-9642-7d64c7d14793 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:16.507905 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09849387-ce67-46c3-b37e-153de153be35 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:16.516783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7746f8f-4148-4d5b-b27b-3b30f158d2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:16.517474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7746f8f-4148-4d5b-b27b-3b30f158d2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:16.517752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7746f8f-4148-4d5b-b27b-3b30f158d2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:16.518068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7746f8f-4148-4d5b-b27b-3b30f158d2f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:16.535407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:16.557494 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5716ab8-ed14-4405-8058-776feb84570a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:16.558179 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5716ab8-ed14-4405-8058-776feb84570a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:16.558458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5716ab8-ed14-4405-8058-776feb84570a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:16.558733 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5716ab8-ed14-4405-8058-776feb84570a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:16.598982 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7746f8f-4148-4d5b-b27b-3b30f158d2f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:16.600465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7746f8f-4148-4d5b-b27b-3b30f158d2f9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:16.632078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5716ab8-ed14-4405-8058-776feb84570a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:16.633503 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5716ab8-ed14-4405-8058-776feb84570a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:16.644164 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:16.704306 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 107/191] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:16.706479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a5012-d229-410a-b31a-43a7dd999bbd None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:16.706765 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a5012-d229-410a-b31a-43a7dd999bbd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:16.707036 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a5012-d229-410a-b31a-43a7dd999bbd None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:16.712366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 108/192] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:16.713682 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323c567-ca40-4156-aa41-0a599cc64fd8 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:16.713960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323c567-ca40-4156-aa41-0a599cc64fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:16.714229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323c567-ca40-4156-aa41-0a599cc64fd8 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:16.715511 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 109/193] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:16.716186 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323c567-ca40-4156-aa41-0a599cc64fd8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:16.748252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 85/194] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 10:51:16.749394 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7b045-9256-480d-b588-49b0707acecb None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:16.749678 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7b045-9256-480d-b588-49b0707acecb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:16.749954 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7b045-9256-480d-b588-49b0707acecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:16.766562 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-add7b045-9256-480d-b588-49b0707acecb None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:16.767786 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-add7b045-9256-480d-b588-49b0707acecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:16.771571 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:16.830423 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323c567-ca40-4156-aa41-0a599cc64fd8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:16.838347 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 86/195] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:16.839679 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a9401-48cf-4ba7-a4cb-85eff55dbbac None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:16.839966 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a9401-48cf-4ba7-a4cb-85eff55dbbac None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:16.840245 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a9401-48cf-4ba7-a4cb-85eff55dbbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:16.857221 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-228a9401-48cf-4ba7-a4cb-85eff55dbbac None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:16.858473 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-228a9401-48cf-4ba7-a4cb-85eff55dbbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:16.867352 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179e657-4e32-4322-ab54-b8853905f6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:16.868334 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179e657-4e32-4322-ab54-b8853905f6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:16.868651 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179e657-4e32-4322-ab54-b8853905f6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:16.868965 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179e657-4e32-4322-ab54-b8853905f6c8 None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:16.870168 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179e657-4e32-4322-ab54-b8853905f6c8 None admin] RBAC: Authorizing `identity:get_project(project_id=4c9b1fef5ff14878b0fe811a533eb847)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:16.871607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179e657-4e32-4322-ab54-b8853905f6c8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:16.873336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 110/196] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:16 2022] GET /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:16.874101 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179e657-4e32-4322-ab54-b8853905f6c8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:16.889198 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:16.927870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 87/197] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:16.928738 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a9401-48cf-4ba7-a4cb-85eff55dbbac None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:16.988021 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179e657-4e32-4322-ab54-b8853905f6c8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:17.002526 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:17.025715 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8a320-019b-42a3-8148-dbb373529037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:17.025715 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8a320-019b-42a3-8148-dbb373529037 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:17.025715 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8a320-019b-42a3-8148-dbb373529037 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:17.025715 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8a320-019b-42a3-8148-dbb373529037 None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:17.026452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8a320-019b-42a3-8148-dbb373529037 None admin] RBAC: Authorizing `identity:get_project(project_id=5c8bef8162de48719c2febf3564c7269)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:17.027617 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8a320-019b-42a3-8148-dbb373529037 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:17.029405 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 111/198] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:16 2022] GET /identity/v3/projects/5c8bef8162de48719c2febf3564c7269 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:17.030176 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8a320-019b-42a3-8148-dbb373529037 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:17.042185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a9401-48cf-4ba7-a4cb-85eff55dbbac None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:17.082466 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab8fe5-8325-460a-b8f6-ea256d3d5f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:17.083330 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab8fe5-8325-460a-b8f6-ea256d3d5f4b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:17.083607 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab8fe5-8325-460a-b8f6-ea256d3d5f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:17.083876 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab8fe5-8325-460a-b8f6-ea256d3d5f4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:17.096753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab8fe5-8325-460a-b8f6-ea256d3d5f4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:17.105721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-2eab8fe5-8325-460a-b8f6-ea256d3d5f4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:17.105721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:17.105721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:17.105721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:17.105721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:17.105721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:17.105721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:17.105721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:17.105721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:17.105721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:17.105721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:17.105721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:17.105721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:17.105721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:17.105721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:17.105721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:17.106691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:17.106691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:17.106691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:17.106691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:17.106691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:17.106691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:17.106691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:17.106691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:17.106691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:17.106691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:17.106691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:17.106691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:17.106691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:17.106691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:17.106691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:17.106691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:17.107464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:17.107464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:17.107464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:17.107464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:17.107464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:17.107464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:17.107464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:17.107464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:17.107464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:17.107464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:17.107464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:17.107464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:17.107464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 88/199] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 19 10:51:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:17.108433 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab8fe5-8325-460a-b8f6-ea256d3d5f4b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:17.137250 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8a320-019b-42a3-8148-dbb373529037 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:17.139841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:17.171288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcead7d5-735e-4779-b994-c86ff66a05f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:17.171954 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcead7d5-735e-4779-b994-c86ff66a05f5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:17.172233 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcead7d5-735e-4779-b994-c86ff66a05f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:17.172510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcead7d5-735e-4779-b994-c86ff66a05f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:17.173381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcead7d5-735e-4779-b994-c86ff66a05f5 None admin] RBAC: Adding query filter params (role.id=86a8e86138e340409f4f8986321ed53d, scope.project.id=4c9b1fef5ff14878b0fe811a533eb847, user.id=1dd842221d5d48c99a39ab10b215384d) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:17.173703 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcead7d5-735e-4779-b994-c86ff66a05f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:17.175144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcead7d5-735e-4779-b994-c86ff66a05f5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:17.181338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 112/200] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:51:17 2022] GET /identity/v3/role_assignments?user.id=1dd842221d5d48c99a39ab10b215384d&scope.project.id=4c9b1fef5ff14878b0fe811a533eb847&role.id=86a8e86138e340409f4f8986321ed53d => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:17.182037 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcead7d5-735e-4779-b994-c86ff66a05f5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:17.222320 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab8fe5-8325-460a-b8f6-ea256d3d5f4b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:17.238043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:17.261147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31065d83-1d47-4466-9cc8-56ac45f26479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:17.261978 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31065d83-1d47-4466-9cc8-56ac45f26479 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:17.262259 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31065d83-1d47-4466-9cc8-56ac45f26479 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:17.262538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31065d83-1d47-4466-9cc8-56ac45f26479 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:17.263826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31065d83-1d47-4466-9cc8-56ac45f26479 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:17.265404 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31065d83-1d47-4466-9cc8-56ac45f26479 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:17.267139 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 89/201] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:17.271664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31065d83-1d47-4466-9cc8-56ac45f26479 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:17.311675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcead7d5-735e-4779-b994-c86ff66a05f5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:17.358049 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e73a8-acdc-483f-8739-cd84fe4b0077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:17.358720 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e73a8-acdc-483f-8739-cd84fe4b0077 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:17.359007 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e73a8-acdc-483f-8739-cd84fe4b0077 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:17.359280 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e73a8-acdc-483f-8739-cd84fe4b0077 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:17.360138 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e73a8-acdc-483f-8739-cd84fe4b0077 None admin] RBAC: Adding query filter params (role.id=3f9528e7a7914797a4635aa6b536b7ff, scope.project.id=5c8bef8162de48719c2febf3564c7269, user.id=dd8f35f356824171aa9612d39c1ec616) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:17.360443 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e73a8-acdc-483f-8739-cd84fe4b0077 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:17.361979 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e73a8-acdc-483f-8739-cd84fe4b0077 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:17.368670 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 113/202] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:51:17 2022] GET /identity/v3/role_assignments?user.id=dd8f35f356824171aa9612d39c1ec616&scope.project.id=5c8bef8162de48719c2febf3564c7269&role.id=3f9528e7a7914797a4635aa6b536b7ff => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:17.368901 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e73a8-acdc-483f-8739-cd84fe4b0077 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:17.393997 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:17.403687 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31065d83-1d47-4466-9cc8-56ac45f26479 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:17.454828 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8dbe55-8b6b-4650-ad84-b2fb47284f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:17.455526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dbe55-8b6b-4650-ad84-b2fb47284f99 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:17.455815 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dbe55-8b6b-4650-ad84-b2fb47284f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:17.456095 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dbe55-8b6b-4650-ad84-b2fb47284f99 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:17.456911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8dbe55-8b6b-4650-ad84-b2fb47284f99 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:17.457467 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8dbe55-8b6b-4650-ad84-b2fb47284f99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:17.459008 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8dbe55-8b6b-4650-ad84-b2fb47284f99 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:17.470853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 90/203] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:51:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:17.477036 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8dbe55-8b6b-4650-ad84-b2fb47284f99 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:17.512940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e73a8-acdc-483f-8739-cd84fe4b0077 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:17.524787 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:17.554131 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d72c9-3d4d-4424-a634-47895edeb203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:17.554558 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d72c9-3d4d-4424-a634-47895edeb203 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:17.554736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d72c9-3d4d-4424-a634-47895edeb203 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:17.555026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d72c9-3d4d-4424-a634-47895edeb203 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:17.555745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d72c9-3d4d-4424-a634-47895edeb203 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:17.557286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d72c9-3d4d-4424-a634-47895edeb203 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:17.592746 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 114/204] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 19 10:51:17 2022] POST /identity/v3/users => generated 297 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:51:17.608569 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8dbe55-8b6b-4650-ad84-b2fb47284f99 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:17.652414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4790b27-4393-4bc8-9b08-ef62cb7e6088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:17.653279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4790b27-4393-4bc8-9b08-ef62cb7e6088 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:17.653559 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4790b27-4393-4bc8-9b08-ef62cb7e6088 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:17.653829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4790b27-4393-4bc8-9b08-ef62cb7e6088 None admin] PATH_INFO: `/v3/users/dd8f35f356824171aa9612d39c1ec616` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:17.655154 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4790b27-4393-4bc8-9b08-ef62cb7e6088 None admin] RBAC: Authorizing `identity:get_user(user_id=dd8f35f356824171aa9612d39c1ec616)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:17.656656 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4790b27-4393-4bc8-9b08-ef62cb7e6088 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:17.658680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 91/205] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:17 2022] GET /identity/v3/users/dd8f35f356824171aa9612d39c1ec616 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:17.664236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d72c9-3d4d-4424-a634-47895edeb203 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:17.780678 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d72c9-3d4d-4424-a634-47895edeb203 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:17.819951 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a949d-20a9-41fc-a666-b173da702540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:17.820613 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a949d-20a9-41fc-a666-b173da702540 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:17.820924 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a949d-20a9-41fc-a666-b173da702540 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:17.821323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a949d-20a9-41fc-a666-b173da702540 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:17.863566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:17.902013 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a949d-20a9-41fc-a666-b173da702540 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:17.903857 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a949d-20a9-41fc-a666-b173da702540 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:18.007444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 115/206] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:18.013012 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4790b27-4393-4bc8-9b08-ef62cb7e6088 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:18.043708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:18.125850 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4790b27-4393-4bc8-9b08-ef62cb7e6088 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:18.162227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783e626-2063-4346-90f5-f4f25950a706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:18.163025 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783e626-2063-4346-90f5-f4f25950a706 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:18.163308 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783e626-2063-4346-90f5-f4f25950a706 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:18.163583 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783e626-2063-4346-90f5-f4f25950a706 None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:18.164824 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783e626-2063-4346-90f5-f4f25950a706 None admin] RBAC: Authorizing `identity:get_project(project_id=5c8bef8162de48719c2febf3564c7269)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:18.166422 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783e626-2063-4346-90f5-f4f25950a706 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:18.168537 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 92/207] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:18 2022] GET /identity/v3/projects/5c8bef8162de48719c2febf3564c7269 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:18.174322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a949d-20a9-41fc-a666-b173da702540 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:18.247536 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:18.285121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a949d-20a9-41fc-a666-b173da702540 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:18.321569 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c314d-a553-44da-b795-19115e6dc564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:18.322576 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c314d-a553-44da-b795-19115e6dc564 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:18.323052 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c314d-a553-44da-b795-19115e6dc564 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:18.323543 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c314d-a553-44da-b795-19115e6dc564 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:18.324566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c314d-a553-44da-b795-19115e6dc564 None admin] RBAC: Adding query filter params (role.id=0a734da5c17d4cd39ea84b75878e55f1, scope.project.id=5c8bef8162de48719c2febf3564c7269, user.id=dd8f35f356824171aa9612d39c1ec616) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:18.325172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c314d-a553-44da-b795-19115e6dc564 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:18.326885 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c314d-a553-44da-b795-19115e6dc564 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:18.333532 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 116/208] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:51:18 2022] GET /identity/v3/role_assignments?user.id=dd8f35f356824171aa9612d39c1ec616&scope.project.id=5c8bef8162de48719c2febf3564c7269&role.id=0a734da5c17d4cd39ea84b75878e55f1 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:19.433153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8f766-cf59-405c-951c-196ceedc6bd7 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:19.433693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8f766-cf59-405c-951c-196ceedc6bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:19.433693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8f766-cf59-405c-951c-196ceedc6bd7 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:19.435486 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 93/209] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:19.441310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f6be8-7154-4e3f-a3d8-dacb01eb6cf0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:19.441807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f6be8-7154-4e3f-a3d8-dacb01eb6cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:19.441878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f6be8-7154-4e3f-a3d8-dacb01eb6cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:19.459664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8f0f6be8-7154-4e3f-a3d8-dacb01eb6cf0 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:19.461224 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8f0f6be8-7154-4e3f-a3d8-dacb01eb6cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:19.534542 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 117/210] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:19.556684 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8f766-cf59-405c-951c-196ceedc6bd7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:19.663733 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:19.676620 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8f766-cf59-405c-951c-196ceedc6bd7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:19.715099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d136135-6fe4-40c1-9836-5ca55fe63d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:19.715812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d136135-6fe4-40c1-9836-5ca55fe63d6e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:19.716097 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d136135-6fe4-40c1-9836-5ca55fe63d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:19.716370 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d136135-6fe4-40c1-9836-5ca55fe63d6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:19.728799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d136135-6fe4-40c1-9836-5ca55fe63d6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:19.736560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-9d136135-6fe4-40c1-9836-5ca55fe63d6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:19.736560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:19.736560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:19.736560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:19.736560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:19.736560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:19.736560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:19.736560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:19.736560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:19.736560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:19.736560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:19.736560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:19.736560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:19.736560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:19.736560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:19.736560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:19.737468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:19.737468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:19.737468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:19.737468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:19.737468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:19.737468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:19.737468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:19.737468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:19.737468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:19.737468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:19.737468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:19.737468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:19.737468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:19.737468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:19.737468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:19.737468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:19.738240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:19.738240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:19.738240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:19.738240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:19.738240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:19.738240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:19.738240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:19.738240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:19.738240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:19.738240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:19.738240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:19.738240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:19.738240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 94/211] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:51:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:19.744070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f6be8-7154-4e3f-a3d8-dacb01eb6cf0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:19.765239 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444aa72-20f4-4e0d-abc0-6f9cd22b6da6 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:19.765819 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444aa72-20f4-4e0d-abc0-6f9cd22b6da6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:19.766299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444aa72-20f4-4e0d-abc0-6f9cd22b6da6 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:19.768120 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 95/212] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:51:19.773120 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7d1d7-1881-49f4-ad68-2ba807e79cbd None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:19.773403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7d1d7-1881-49f4-ad68-2ba807e79cbd None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:19.773682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7d1d7-1881-49f4-ad68-2ba807e79cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:19.795311 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b4d7d1d7-1881-49f4-ad68-2ba807e79cbd None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:19.796539 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b4d7d1d7-1881-49f4-ad68-2ba807e79cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:19.807608 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:19.852617 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f6be8-7154-4e3f-a3d8-dacb01eb6cf0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:19.883642 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 96/213] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:19.893581 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f729c9-03ed-4f97-a24b-1d42822008ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:19.894282 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f729c9-03ed-4f97-a24b-1d42822008ce None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:19.894560 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f729c9-03ed-4f97-a24b-1d42822008ce None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:19.894832 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f729c9-03ed-4f97-a24b-1d42822008ce None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:19.895604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f729c9-03ed-4f97-a24b-1d42822008ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:19.895912 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f729c9-03ed-4f97-a24b-1d42822008ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:19.899993 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f729c9-03ed-4f97-a24b-1d42822008ce None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:19.910689 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7d1d7-1881-49f4-ad68-2ba807e79cbd None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:19.911116 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 118/214] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:19.917895 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f729c9-03ed-4f97-a24b-1d42822008ce None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:20.008334 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:20.028914 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7d1d7-1881-49f4-ad68-2ba807e79cbd None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:20.034808 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f729c9-03ed-4f97-a24b-1d42822008ce None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:20.064249 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:20.069984 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09548f-c385-496f-85db-6f14975f7f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:20.070803 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09548f-c385-496f-85db-6f14975f7f6a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:20.071101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09548f-c385-496f-85db-6f14975f7f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:20.071402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09548f-c385-496f-85db-6f14975f7f6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:20.077337 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3dba21-13bb-441f-b498-317073b78678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:20.078514 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dba21-13bb-441f-b498-317073b78678 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:20.078796 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dba21-13bb-441f-b498-317073b78678 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:20.079066 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dba21-13bb-441f-b498-317073b78678 None admin] PATH_INFO: `/v3/users/dd8f35f356824171aa9612d39c1ec616` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:20.080329 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3dba21-13bb-441f-b498-317073b78678 None admin] RBAC: Authorizing `identity:get_user(user_id=dd8f35f356824171aa9612d39c1ec616)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:20.081845 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3dba21-13bb-441f-b498-317073b78678 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:20.092955 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 119/215] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:19 2022] GET /identity/v3/users/dd8f35f356824171aa9612d39c1ec616 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:20.092955 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889a365-5f2a-4a8c-8c1b-56ce4a5aaedd None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:20.092955 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889a365-5f2a-4a8c-8c1b-56ce4a5aaedd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:20.092955 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889a365-5f2a-4a8c-8c1b-56ce4a5aaedd None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:20.092955 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 120/216] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:20.092955 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889a365-5f2a-4a8c-8c1b-56ce4a5aaedd None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:20.094421 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09548f-c385-496f-85db-6f14975f7f6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:20.102268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-cf09548f-c385-496f-85db-6f14975f7f6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:20.102268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:20.102268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:20.102268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:20.102268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:20.102268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:20.102268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:20.102268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:20.102268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:20.102268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:20.102268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:20.102268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:20.102268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:20.102268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:20.102268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:20.102268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:20.103644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:20.103644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:20.103644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:20.103644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:20.103644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:20.103644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:20.103644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:20.103644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:20.103644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:20.103644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:20.103644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:20.103644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:20.103644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:20.103644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:20.103644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:20.103644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:20.104405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:20.104405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:20.104405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:20.104405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:20.104405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:20.104405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:20.104405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:20.104405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:20.104405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:20.104405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:20.104405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:20.104405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:20.104405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 97/217] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:51:20.105601 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e811f-26cf-4b50-91e4-7551e8bc03de None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:20.105666 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e811f-26cf-4b50-91e4-7551e8bc03de None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:20.105948 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e811f-26cf-4b50-91e4-7551e8bc03de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:20.124218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-966e811f-26cf-4b50-91e4-7551e8bc03de None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:20.125436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-966e811f-26cf-4b50-91e4-7551e8bc03de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:20.212744 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 98/218] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:20.212744 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e811f-26cf-4b50-91e4-7551e8bc03de None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:20.236696 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889a365-5f2a-4a8c-8c1b-56ce4a5aaedd None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:20.288348 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2beaf4b-fb9f-498a-90c4-79add08a8989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:20.289174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2beaf4b-fb9f-498a-90c4-79add08a8989 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:20.289458 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2beaf4b-fb9f-498a-90c4-79add08a8989 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:20.289733 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2beaf4b-fb9f-498a-90c4-79add08a8989 None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:20.291037 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2beaf4b-fb9f-498a-90c4-79add08a8989 None admin] RBAC: Authorizing `identity:get_project(project_id=5c8bef8162de48719c2febf3564c7269)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:20.292490 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2beaf4b-fb9f-498a-90c4-79add08a8989 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:20.298796 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 121/219] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:20 2022] GET /identity/v3/projects/5c8bef8162de48719c2febf3564c7269 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:20.298796 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2beaf4b-fb9f-498a-90c4-79add08a8989 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:20.323339 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:20.352496 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e811f-26cf-4b50-91e4-7551e8bc03de None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:20.355964 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:20.391569 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15c914-5451-42f2-91a9-126d7e977a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:20.392244 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15c914-5451-42f2-91a9-126d7e977a93 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:20.392520 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15c914-5451-42f2-91a9-126d7e977a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:20.392983 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15c914-5451-42f2-91a9-126d7e977a93 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:20.393565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15c914-5451-42f2-91a9-126d7e977a93 None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:20.394217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15c914-5451-42f2-91a9-126d7e977a93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:20.395474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15c914-5451-42f2-91a9-126d7e977a93 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:20.402048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2beaf4b-fb9f-498a-90c4-79add08a8989 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:20.403631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 99/220] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:20.404388 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15c914-5451-42f2-91a9-126d7e977a93 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:20.438281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268c6c2-43d5-4754-a6ca-82d40a93a23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:20.439088 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268c6c2-43d5-4754-a6ca-82d40a93a23b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:20.439365 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268c6c2-43d5-4754-a6ca-82d40a93a23b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:20.439639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268c6c2-43d5-4754-a6ca-82d40a93a23b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:20.443110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268c6c2-43d5-4754-a6ca-82d40a93a23b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:20.445125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268c6c2-43d5-4754-a6ca-82d40a93a23b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:20.447642 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 122/221] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:20.449280 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345108d-5c00-4207-a3e0-733923b0f297 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:20.449565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345108d-5c00-4207-a3e0-733923b0f297 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:20.449833 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345108d-5c00-4207-a3e0-733923b0f297 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:20.451917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 123/222] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:20.452681 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345108d-5c00-4207-a3e0-733923b0f297 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:20.508679 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15c914-5451-42f2-91a9-126d7e977a93 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:20.542120 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51357585-7828-4044-8c70-61fec6a8409e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:20.542932 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51357585-7828-4044-8c70-61fec6a8409e None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:20.543207 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51357585-7828-4044-8c70-61fec6a8409e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:20.543479 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51357585-7828-4044-8c70-61fec6a8409e None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269/users/dd8f35f356824171aa9612d39c1ec616/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:20.545457 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51357585-7828-4044-8c70-61fec6a8409e None admin] RBAC: Authorizing `identity:create_grant(project_id=5c8bef8162de48719c2febf3564c7269, user_id=dd8f35f356824171aa9612d39c1ec616, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:20.547429 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51357585-7828-4044-8c70-61fec6a8409e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:20.550284 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:20.556996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345108d-5c00-4207-a3e0-733923b0f297 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:20.567993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 100/223] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:51:20 2022] PUT /identity/v3/projects/5c8bef8162de48719c2febf3564c7269/users/dd8f35f356824171aa9612d39c1ec616/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:51:20.568851 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51357585-7828-4044-8c70-61fec6a8409e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:20.587975 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:20.597395 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daddb0-0396-4aec-8365-36acbfdc0336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:20.599053 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daddb0-0396-4aec-8365-36acbfdc0336 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:20.599053 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daddb0-0396-4aec-8365-36acbfdc0336 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:20.599053 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daddb0-0396-4aec-8365-36acbfdc0336 None admin] PATH_INFO: `/v3/users/672d12d81cd8460b8a2de7fd5b989af3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:20.614568 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9daddb0-0396-4aec-8365-36acbfdc0336 None admin] RBAC: Authorizing `identity:get_user(user_id=672d12d81cd8460b8a2de7fd5b989af3)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:20.616050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9daddb0-0396-4aec-8365-36acbfdc0336 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:20.617870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 124/224] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:20 2022] GET /identity/v3/users/672d12d81cd8460b8a2de7fd5b989af3 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:20.619396 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97541f5c-5910-4393-af53-958cd5fdeae9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:20.619690 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97541f5c-5910-4393-af53-958cd5fdeae9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:20.619960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97541f5c-5910-4393-af53-958cd5fdeae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:20.637610 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-97541f5c-5910-4393-af53-958cd5fdeae9 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:20.638910 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-97541f5c-5910-4393-af53-958cd5fdeae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:20.713980 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51357585-7828-4044-8c70-61fec6a8409e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:20.726261 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 125/225] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:20.727209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97541f5c-5910-4393-af53-958cd5fdeae9 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:20.763218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95698f82-d3e1-4cef-869a-af6d813d2be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:20.764343 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95698f82-d3e1-4cef-869a-af6d813d2be6 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:20.764644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95698f82-d3e1-4cef-869a-af6d813d2be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:20.765094 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95698f82-d3e1-4cef-869a-af6d813d2be6 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:20.765925 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95698f82-d3e1-4cef-869a-af6d813d2be6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:20.768110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95698f82-d3e1-4cef-869a-af6d813d2be6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:20.789401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 101/226] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 19 10:51:20 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:51:20.790267 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95698f82-d3e1-4cef-869a-af6d813d2be6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:20.870087 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:20.886052 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97541f5c-5910-4393-af53-958cd5fdeae9 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:20.910948 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:20.935968 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95698f82-d3e1-4cef-869a-af6d813d2be6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:20.942828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c4079-ad92-4e38-b5e7-38acfb7f0854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:20.943805 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c4079-ad92-4e38-b5e7-38acfb7f0854 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:20.944971 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c4079-ad92-4e38-b5e7-38acfb7f0854 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:20.947394 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c4079-ad92-4e38-b5e7-38acfb7f0854 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:20.992049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fe837-b11b-4d4a-85ef-f3320c808d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:20.992959 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fe837-b11b-4d4a-85ef-f3320c808d09 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:20.993318 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fe837-b11b-4d4a-85ef-f3320c808d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:20.993599 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fe837-b11b-4d4a-85ef-f3320c808d09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:21.020505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0fe837-b11b-4d4a-85ef-f3320c808d09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:21.031185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-0f0fe837-b11b-4d4a-85ef-f3320c808d09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:21.031185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:21.031185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:21.031185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:21.031185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:21.031185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:21.031185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:21.031185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:21.031185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:21.031185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:21.031185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:21.031185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:21.031185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:21.031185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:21.031185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:21.031185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:21.032124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:21.032124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:21.032124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:21.032124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:21.032124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:21.032124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:21.032124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:21.032124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:21.032124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:21.032124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:21.032124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:21.032124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:21.032124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:21.032124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:21.032124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:21.032124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:21.032945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:21.032945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:21.032945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:21.032945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:21.032945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:21.032945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:21.032945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:21.032945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:21.032945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:21.032945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:21.032945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:21.032945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:21.036978 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 102/227] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 19 10:51:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:21.038767 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fe837-b11b-4d4a-85ef-f3320c808d09 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:21.061983 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c4079-ad92-4e38-b5e7-38acfb7f0854 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:21.063790 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c4079-ad92-4e38-b5e7-38acfb7f0854 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:21.211607 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fe837-b11b-4d4a-85ef-f3320c808d09 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:21.234823 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 126/228] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:21.236495 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:21.240650 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c4079-ad92-4e38-b5e7-38acfb7f0854 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:21.269881 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:21.271588 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381acb57-ab2c-4a11-9523-c9c408b52b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:21.272492 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381acb57-ab2c-4a11-9523-c9c408b52b14 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:21.273176 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381acb57-ab2c-4a11-9523-c9c408b52b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:21.273735 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381acb57-ab2c-4a11-9523-c9c408b52b14 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:21.275535 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381acb57-ab2c-4a11-9523-c9c408b52b14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:21.276182 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381acb57-ab2c-4a11-9523-c9c408b52b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:21.279146 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381acb57-ab2c-4a11-9523-c9c408b52b14 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:21.294127 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 103/229] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:51:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:21.302834 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381acb57-ab2c-4a11-9523-c9c408b52b14 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:21.414483 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c4079-ad92-4e38-b5e7-38acfb7f0854 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:21.439668 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381acb57-ab2c-4a11-9523-c9c408b52b14 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:21.459760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bce26e-28c3-4bfa-87d0-b018540b986a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:21.460645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bce26e-28c3-4bfa-87d0-b018540b986a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:21.460949 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bce26e-28c3-4bfa-87d0-b018540b986a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:21.461227 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bce26e-28c3-4bfa-87d0-b018540b986a None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:21.462972 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bce26e-28c3-4bfa-87d0-b018540b986a None admin] RBAC: Authorizing `identity:get_project(project_id=5c8bef8162de48719c2febf3564c7269)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:21.464370 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bce26e-28c3-4bfa-87d0-b018540b986a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:21.466783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 127/230] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:21 2022] GET /identity/v3/projects/5c8bef8162de48719c2febf3564c7269 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:21.473665 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bce26e-28c3-4bfa-87d0-b018540b986a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:21.491360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38866822-e03c-44ba-bb0b-74f3366ba6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:21.492650 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38866822-e03c-44ba-bb0b-74f3366ba6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:21.493138 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38866822-e03c-44ba-bb0b-74f3366ba6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:21.493697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38866822-e03c-44ba-bb0b-74f3366ba6c4 None admin] PATH_INFO: `/v3/users/dd8f35f356824171aa9612d39c1ec616` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:21.496505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38866822-e03c-44ba-bb0b-74f3366ba6c4 None admin] RBAC: Authorizing `identity:get_user(user_id=dd8f35f356824171aa9612d39c1ec616)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:21.498657 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38866822-e03c-44ba-bb0b-74f3366ba6c4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:21.503879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 104/231] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:21 2022] GET /identity/v3/users/dd8f35f356824171aa9612d39c1ec616 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:21.514573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38866822-e03c-44ba-bb0b-74f3366ba6c4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:21.584151 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:21.657197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38866822-e03c-44ba-bb0b-74f3366ba6c4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:21.694619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:21.703406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921535f-50aa-4226-ac31-1bc8434bf3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:21.704804 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921535f-50aa-4226-ac31-1bc8434bf3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:21.705369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921535f-50aa-4226-ac31-1bc8434bf3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:21.705865 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921535f-50aa-4226-ac31-1bc8434bf3c4 None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:21.707581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921535f-50aa-4226-ac31-1bc8434bf3c4 None admin] RBAC: Authorizing `identity:get_project(project_id=5c8bef8162de48719c2febf3564c7269)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:21.710260 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921535f-50aa-4226-ac31-1bc8434bf3c4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:21.713488 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 105/232] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:21 2022] GET /identity/v3/projects/5c8bef8162de48719c2febf3564c7269 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:21.719246 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921535f-50aa-4226-ac31-1bc8434bf3c4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:21.740566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bce26e-28c3-4bfa-87d0-b018540b986a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:21.798275 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea0d9c-f587-4217-9a71-564001f726ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:21.799585 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea0d9c-f587-4217-9a71-564001f726ec None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:21.800056 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea0d9c-f587-4217-9a71-564001f726ec None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:21.800564 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea0d9c-f587-4217-9a71-564001f726ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:21.801671 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea0d9c-f587-4217-9a71-564001f726ec None admin] RBAC: Adding query filter params (role.id=6ff885694ad84e4cb935ef1c1f001858, scope.project.id=5c8bef8162de48719c2febf3564c7269, user.id=672d12d81cd8460b8a2de7fd5b989af3) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:21.802189 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea0d9c-f587-4217-9a71-564001f726ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:21.803833 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea0d9c-f587-4217-9a71-564001f726ec None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:21.811263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 128/233] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:51:21 2022] GET /identity/v3/role_assignments?user.id=672d12d81cd8460b8a2de7fd5b989af3&scope.project.id=5c8bef8162de48719c2febf3564c7269&role.id=6ff885694ad84e4cb935ef1c1f001858 => generated 259 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:21.894186 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921535f-50aa-4226-ac31-1bc8434bf3c4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:21.907266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:21.934504 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdeb82-37f0-4be7-80fb-53fd2a75fd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:21.935456 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdeb82-37f0-4be7-80fb-53fd2a75fd21 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:21.935739 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdeb82-37f0-4be7-80fb-53fd2a75fd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:21.936013 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdeb82-37f0-4be7-80fb-53fd2a75fd21 None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269/users/dd8f35f356824171aa9612d39c1ec616/roles/0a734da5c17d4cd39ea84b75878e55f1` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:21.938326 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdeb82-37f0-4be7-80fb-53fd2a75fd21 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c8bef8162de48719c2febf3564c7269, user_id=dd8f35f356824171aa9612d39c1ec616, role_id=0a734da5c17d4cd39ea84b75878e55f1)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:21.939932 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdeb82-37f0-4be7-80fb-53fd2a75fd21 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:21.956276 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 106/234] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:51:21 2022] PUT /identity/v3/projects/5c8bef8162de48719c2febf3564c7269/users/dd8f35f356824171aa9612d39c1ec616/roles/0a734da5c17d4cd39ea84b75878e55f1 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:51:22.999660 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51dad6-2e40-4043-8571-985fff51756f None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:23.000691 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51dad6-2e40-4043-8571-985fff51756f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:23.001214 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51dad6-2e40-4043-8571-985fff51756f None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:23.002831 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 129/235] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:23.008933 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c86be-64a0-4d27-8434-82e3dfe744da None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:23.009818 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c86be-64a0-4d27-8434-82e3dfe744da None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:23.010284 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c86be-64a0-4d27-8434-82e3dfe744da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:23.031389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-db5c86be-64a0-4d27-8434-82e3dfe744da None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:23.032983 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-db5c86be-64a0-4d27-8434-82e3dfe744da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:23.126392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 107/236] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:23.162050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51dad6-2e40-4043-8571-985fff51756f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:23.284922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51dad6-2e40-4043-8571-985fff51756f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:23.321521 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf390bba-fd27-4bf2-81d7-70a1adc415f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:23.322752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf390bba-fd27-4bf2-81d7-70a1adc415f6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:23.323222 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf390bba-fd27-4bf2-81d7-70a1adc415f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:23.323681 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf390bba-fd27-4bf2-81d7-70a1adc415f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:23.335236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf390bba-fd27-4bf2-81d7-70a1adc415f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:23.343285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-bf390bba-fd27-4bf2-81d7-70a1adc415f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:23.343285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:23.343285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:23.343285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:23.343285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:23.343285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:23.343285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:23.343285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:23.343285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:23.343285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:23.343285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:23.343285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:23.343285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:23.343285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:23.343285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:23.343285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:23.344120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:23.344120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:23.344120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:23.344120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:23.344120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:23.344120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:23.344120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:23.344120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:23.344120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:23.344120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:23.344120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:23.344120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:23.344120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:23.344120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:23.344120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:23.344120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:23.344922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:23.344922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:23.344922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:23.344922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:23.344922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:23.344922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:23.344922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:23.344922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:23.344922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:23.344922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:23.344922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:23.344922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:23.347265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 130/237] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:51:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:23.353714 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c86be-64a0-4d27-8434-82e3dfe744da None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:23.463112 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786ccb3-309c-4b68-9325-b3593119322a None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:23.463448 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786ccb3-309c-4b68-9325-b3593119322a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:23.463664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786ccb3-309c-4b68-9325-b3593119322a None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:23.465067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 131/238] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:51:23.470279 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358a72c-4a56-40fa-ac1d-9ef7653aa50c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:23.470823 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358a72c-4a56-40fa-ac1d-9ef7653aa50c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:23.471293 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358a72c-4a56-40fa-ac1d-9ef7653aa50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:23.484203 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:23.488217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c86be-64a0-4d27-8434-82e3dfe744da None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:23.500632 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:23.512258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4358a72c-4a56-40fa-ac1d-9ef7653aa50c None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:23.513483 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4358a72c-4a56-40fa-ac1d-9ef7653aa50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:23.558956 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca523cf-ec6b-4dff-b1b9-db6f876c3faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:23.560016 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca523cf-ec6b-4dff-b1b9-db6f876c3faf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:23.560501 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca523cf-ec6b-4dff-b1b9-db6f876c3faf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:23.561010 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca523cf-ec6b-4dff-b1b9-db6f876c3faf None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:23.561993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca523cf-ec6b-4dff-b1b9-db6f876c3faf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:23.562530 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca523cf-ec6b-4dff-b1b9-db6f876c3faf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:23.564212 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca523cf-ec6b-4dff-b1b9-db6f876c3faf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:23.587415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 108/239] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:23.592499 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca523cf-ec6b-4dff-b1b9-db6f876c3faf None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:23.599039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 132/240] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:51:23.611892 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe728c-c541-4c9e-a463-9f2392514bb5 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:23.612187 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe728c-c541-4c9e-a463-9f2392514bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:23.612429 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe728c-c541-4c9e-a463-9f2392514bb5 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:23.614001 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 133/241] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:51:23.620184 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7809dad-2642-475a-b438-8424dadf1010 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:23.620460 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7809dad-2642-475a-b438-8424dadf1010 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:23.620741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7809dad-2642-475a-b438-8424dadf1010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:23.640910 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b7809dad-2642-475a-b438-8424dadf1010 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:23.642205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b7809dad-2642-475a-b438-8424dadf1010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:23.728811 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 134/242] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:51:23.730052 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7809dad-2642-475a-b438-8424dadf1010 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:23.744435 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca523cf-ec6b-4dff-b1b9-db6f876c3faf None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:23.791163 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42584bc1-fb13-4bea-99b5-2f24545e2e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:23.793074 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42584bc1-fb13-4bea-99b5-2f24545e2e56 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:23.793565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42584bc1-fb13-4bea-99b5-2f24545e2e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:23.794059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42584bc1-fb13-4bea-99b5-2f24545e2e56 None admin] PATH_INFO: `/v3/users/dd8f35f356824171aa9612d39c1ec616` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:23.795988 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42584bc1-fb13-4bea-99b5-2f24545e2e56 None admin] RBAC: Authorizing `identity:get_user(user_id=dd8f35f356824171aa9612d39c1ec616)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:23.798380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42584bc1-fb13-4bea-99b5-2f24545e2e56 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:23.801851 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 109/243] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:23 2022] GET /identity/v3/users/dd8f35f356824171aa9612d39c1ec616 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:23.803215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42584bc1-fb13-4bea-99b5-2f24545e2e56 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:23.828362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:23.839050 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:23.874953 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7809dad-2642-475a-b438-8424dadf1010 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:23.917404 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42584bc1-fb13-4bea-99b5-2f24545e2e56 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:23.919781 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c40db9-c2fa-4939-b918-b37ebf982fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:23.921503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c40db9-c2fa-4939-b918-b37ebf982fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:23.921787 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c40db9-c2fa-4939-b918-b37ebf982fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:23.922061 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c40db9-c2fa-4939-b918-b37ebf982fc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:23.925426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c40db9-c2fa-4939-b918-b37ebf982fc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:23.927556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c40db9-c2fa-4939-b918-b37ebf982fc0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:23.930215 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 135/244] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:23.931304 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c40db9-c2fa-4939-b918-b37ebf982fc0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:23.960670 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c80f4-5f7d-43d3-89a9-f164c84edfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:23.961536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c80f4-5f7d-43d3-89a9-f164c84edfe6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:23.962334 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c80f4-5f7d-43d3-89a9-f164c84edfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:23.962334 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c80f4-5f7d-43d3-89a9-f164c84edfe6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:23.974517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c80f4-5f7d-43d3-89a9-f164c84edfe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:23.983548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-2a2c80f4-5f7d-43d3-89a9-f164c84edfe6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:51:23.983548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:23.983548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:23.983548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:23.983548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:23.983548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:23.983548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:23.983548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:23.983548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:23.983548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:23.983548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:23.983548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:23.983548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:23.983548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:23.983548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:23.983548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:23.984498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:23.984498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:23.984498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:23.984498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:23.984498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:23.984498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:23.984498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:23.984498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:23.984498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:23.984498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:23.984498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:23.984498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:23.984498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:23.984498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:23.984498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:23.984498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:23.985774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:23.985774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:23.985774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:23.985774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:23.985774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:23.985774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:23.985774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:23.985774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:23.985774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:23.985774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:23.985774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:51:23.985774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:23.985774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 110/245] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:23.986440 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c80f4-5f7d-43d3-89a9-f164c84edfe6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:24.065371 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c40db9-c2fa-4939-b918-b37ebf982fc0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:24.106195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c87c4b-930a-499c-907c-cca0e7b7df39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:24.106914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c87c4b-930a-499c-907c-cca0e7b7df39 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:24.107154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c87c4b-930a-499c-907c-cca0e7b7df39 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:24.107430 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c87c4b-930a-499c-907c-cca0e7b7df39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:24.110482 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:24.118134 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:24.131214 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c80f4-5f7d-43d3-89a9-f164c84edfe6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:24.169235 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09be0bb-076e-4ac8-82eb-f309dc9dcee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:24.169928 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09be0bb-076e-4ac8-82eb-f309dc9dcee0 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:24.170211 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09be0bb-076e-4ac8-82eb-f309dc9dcee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:24.170550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09be0bb-076e-4ac8-82eb-f309dc9dcee0 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:24.171378 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09be0bb-076e-4ac8-82eb-f309dc9dcee0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:24.172938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09be0bb-076e-4ac8-82eb-f309dc9dcee0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:24.196635 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c87c4b-930a-499c-907c-cca0e7b7df39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:24.198486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c87c4b-930a-499c-907c-cca0e7b7df39 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:24.200970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 111/246] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 19 10:51:23 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:51:24.202231 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09be0bb-076e-4ac8-82eb-f309dc9dcee0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:24.401707 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 136/247] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:24.405030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09be0bb-076e-4ac8-82eb-f309dc9dcee0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:24.407199 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c87c4b-930a-499c-907c-cca0e7b7df39 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:24.464930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:24.467589 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9a821-87fb-4da4-8a4f-d4a81f264277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:24.468506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9a821-87fb-4da4-8a4f-d4a81f264277 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:24.469200 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9a821-87fb-4da4-8a4f-d4a81f264277 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:24.469673 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9a821-87fb-4da4-8a4f-d4a81f264277 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:24.470656 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9a821-87fb-4da4-8a4f-d4a81f264277 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:24.471165 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9a821-87fb-4da4-8a4f-d4a81f264277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:24.472857 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9a821-87fb-4da4-8a4f-d4a81f264277 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:24.483880 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 112/248] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:24.489921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9a821-87fb-4da4-8a4f-d4a81f264277 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:24.503848 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:24.546746 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c87c4b-930a-499c-907c-cca0e7b7df39 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:24.583452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb97d1c-43ec-400e-acd3-0a91cebff132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:24.584345 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb97d1c-43ec-400e-acd3-0a91cebff132 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:24.584628 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb97d1c-43ec-400e-acd3-0a91cebff132 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:24.584938 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb97d1c-43ec-400e-acd3-0a91cebff132 None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:24.586177 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb97d1c-43ec-400e-acd3-0a91cebff132 None admin] RBAC: Authorizing `identity:get_project(project_id=5c8bef8162de48719c2febf3564c7269)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:24.587733 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb97d1c-43ec-400e-acd3-0a91cebff132 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:24.589898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 137/249] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:24 2022] GET /identity/v3/projects/5c8bef8162de48719c2febf3564c7269 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:24.591226 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25936bf-bedd-44a2-b566-a2e160ceda30 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:24.591512 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25936bf-bedd-44a2-b566-a2e160ceda30 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:24.591787 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25936bf-bedd-44a2-b566-a2e160ceda30 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:24.593154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 138/250] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:24.598404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25936bf-bedd-44a2-b566-a2e160ceda30 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:24.615033 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9a821-87fb-4da4-8a4f-d4a81f264277 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:24.659224 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febdd81-49c4-4729-92ab-a963fae2e868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:24.660045 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febdd81-49c4-4729-92ab-a963fae2e868 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:24.660326 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febdd81-49c4-4729-92ab-a963fae2e868 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:24.660600 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febdd81-49c4-4729-92ab-a963fae2e868 None admin] PATH_INFO: `/v3/users/81220503fc364937b18ce19bc0784aa8` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:24.678805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febdd81-49c4-4729-92ab-a963fae2e868 None admin] RBAC: Authorizing `identity:get_user(user_id=81220503fc364937b18ce19bc0784aa8)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:24.680300 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febdd81-49c4-4729-92ab-a963fae2e868 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:24.682942 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 113/251] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:24 2022] GET /identity/v3/users/81220503fc364937b18ce19bc0784aa8 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:24.683434 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea5a14-b8b0-4ca6-9f99-32e200baa107 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:24.685093 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea5a14-b8b0-4ca6-9f99-32e200baa107 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:24.685601 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea5a14-b8b0-4ca6-9f99-32e200baa107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:24.710395 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-20ea5a14-b8b0-4ca6-9f99-32e200baa107 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:24.712642 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-20ea5a14-b8b0-4ca6-9f99-32e200baa107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:24.716086 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25936bf-bedd-44a2-b566-a2e160ceda30 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:24.718164 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:24.760748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af150ece-5de8-4c20-afeb-6289a9fbcda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:24.760748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af150ece-5de8-4c20-afeb-6289a9fbcda7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:24.760748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af150ece-5de8-4c20-afeb-6289a9fbcda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:24.760748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af150ece-5de8-4c20-afeb-6289a9fbcda7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:24.761309 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af150ece-5de8-4c20-afeb-6289a9fbcda7 None admin] RBAC: Adding query filter params (role.id=3f9528e7a7914797a4635aa6b536b7ff, scope.project.id=5c8bef8162de48719c2febf3564c7269, user.id=dd8f35f356824171aa9612d39c1ec616) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:24.761309 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af150ece-5de8-4c20-afeb-6289a9fbcda7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:24.761309 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af150ece-5de8-4c20-afeb-6289a9fbcda7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:24.767995 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 139/252] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:51:24 2022] GET /identity/v3/role_assignments?user.id=dd8f35f356824171aa9612d39c1ec616&scope.project.id=5c8bef8162de48719c2febf3564c7269&role.id=3f9528e7a7914797a4635aa6b536b7ff => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:24.768880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af150ece-5de8-4c20-afeb-6289a9fbcda7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:24.805677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:24.818042 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 114/253] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:24.827703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0aa99b-4772-4c39-8c8e-003a427fa082 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:24.828051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0aa99b-4772-4c39-8c8e-003a427fa082 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:24.828269 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0aa99b-4772-4c39-8c8e-003a427fa082 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:24.829996 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 115/254] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:24 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:24.836578 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fa43f-cb4a-4d1a-b6e4-3867a4d90af5 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:24.836966 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fa43f-cb4a-4d1a-b6e4-3867a4d90af5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:24.837208 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fa43f-cb4a-4d1a-b6e4-3867a4d90af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:24.888175 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-230fa43f-cb4a-4d1a-b6e4-3867a4d90af5 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:24.889449 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-230fa43f-cb4a-4d1a-b6e4-3867a4d90af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:24.978715 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af150ece-5de8-4c20-afeb-6289a9fbcda7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:25.011134 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 116/255] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:25.012184 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230fa43f-cb4a-4d1a-b6e4-3867a4d90af5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:25.016081 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79787585-becf-441a-9e08-4b070d8a654b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:25.016780 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79787585-becf-441a-9e08-4b070d8a654b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:25.017067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79787585-becf-441a-9e08-4b070d8a654b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:25.017340 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79787585-becf-441a-9e08-4b070d8a654b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:25.074486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:25.114597 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79787585-becf-441a-9e08-4b070d8a654b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:25.116640 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79787585-becf-441a-9e08-4b070d8a654b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:25.163666 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230fa43f-cb4a-4d1a-b6e4-3867a4d90af5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:25.194111 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:25.219607 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e732d9a-765b-40a9-b454-c8f891d10287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:25.220883 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e732d9a-765b-40a9-b454-c8f891d10287 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:25.221367 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e732d9a-765b-40a9-b454-c8f891d10287 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:25.221837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e732d9a-765b-40a9-b454-c8f891d10287 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:25.236247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e732d9a-765b-40a9-b454-c8f891d10287 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:25.244870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-9e732d9a-765b-40a9-b454-c8f891d10287 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:25.244870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:25.244870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:25.244870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:25.244870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:25.244870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:25.244870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:25.244870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:25.244870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:25.244870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:25.244870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:25.244870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:25.244870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:25.244870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:25.244870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:25.244870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:25.245837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:25.245837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:25.245837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:25.245837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:25.245837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:25.245837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:25.245837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:25.245837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:25.245837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:25.245837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:25.245837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:25.245837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:25.245837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:25.245837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:25.245837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:25.245837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:25.246775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:25.246775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:25.246775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:25.246775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:25.246775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:25.246775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:25.246775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:25.246775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:25.246775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:25.246775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:25.246775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:25.246775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:25.247403 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 140/256] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:25.247403 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79787585-becf-441a-9e08-4b070d8a654b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:25.253841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 117/257] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:25.254981 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e732d9a-765b-40a9-b454-c8f891d10287 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:25.327086 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:25.373545 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e732d9a-765b-40a9-b454-c8f891d10287 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:25.373749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79787585-becf-441a-9e08-4b070d8a654b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:25.416617 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdd9a7-3f8d-472b-b069-560df7a5b5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:25.417480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdd9a7-3f8d-472b-b069-560df7a5b5ee None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:25.417762 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdd9a7-3f8d-472b-b069-560df7a5b5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:25.418175 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdd9a7-3f8d-472b-b069-560df7a5b5ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:25.421497 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357e1d7-a106-42fd-adf9-df701309d10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:25.422521 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357e1d7-a106-42fd-adf9-df701309d10d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:25.422935 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357e1d7-a106-42fd-adf9-df701309d10d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:25.423598 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357e1d7-a106-42fd-adf9-df701309d10d None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:25.429832 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357e1d7-a106-42fd-adf9-df701309d10d None admin] RBAC: Authorizing `identity:get_project(project_id=5c8bef8162de48719c2febf3564c7269)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:25.431385 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357e1d7-a106-42fd-adf9-df701309d10d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:25.433310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdd9a7-3f8d-472b-b069-560df7a5b5ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:25.433434 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 118/258] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:25 2022] GET /identity/v3/projects/5c8bef8162de48719c2febf3564c7269 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:25.434226 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357e1d7-a106-42fd-adf9-df701309d10d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:25.442417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-49bdd9a7-3f8d-472b-b069-560df7a5b5ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:25.442417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:25.442417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:25.442417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:25.442417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:25.442417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:25.442417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:25.442417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:25.442417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:25.442417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:25.442417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:25.442417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:25.442417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:25.442417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:25.442417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:25.442417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:25.443331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:25.443331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:25.443331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:25.443331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:25.443331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:25.443331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:25.443331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:25.443331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:25.443331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:25.443331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:25.443331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:25.443331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:25.443331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:25.443331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:25.443331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:25.443331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:25.444097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:25.444097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:25.444097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:25.444097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:25.444097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:25.444097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:25.444097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:25.444097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:25.444097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:25.444097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:25.444097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:25.444097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:25.447401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 141/259] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 19 10:51:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:25.448571 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdd9a7-3f8d-472b-b069-560df7a5b5ee None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:25.495248 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:25.543125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357e1d7-a106-42fd-adf9-df701309d10d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:25.554756 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdd9a7-3f8d-472b-b069-560df7a5b5ee None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:25.579031 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e5564-9f3b-46ae-87dd-e57aa8556755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:25.579762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e5564-9f3b-46ae-87dd-e57aa8556755 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:25.580068 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e5564-9f3b-46ae-87dd-e57aa8556755 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:25.580565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e5564-9f3b-46ae-87dd-e57aa8556755 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:25.581211 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e5564-9f3b-46ae-87dd-e57aa8556755 None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:25.581521 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e5564-9f3b-46ae-87dd-e57aa8556755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:25.582966 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e5564-9f3b-46ae-87dd-e57aa8556755 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:25.583615 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:25.593189 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6c943-3d8b-4893-af31-18a1ffa75064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:25.594168 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6c943-3d8b-4893-af31-18a1ffa75064 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:25.599047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 119/260] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:25.599047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e5564-9f3b-46ae-87dd-e57aa8556755 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:25.599250 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6c943-3d8b-4893-af31-18a1ffa75064 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:25.599250 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6c943-3d8b-4893-af31-18a1ffa75064 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:25.599250 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6c943-3d8b-4893-af31-18a1ffa75064 None admin] RBAC: Adding query filter params (role.id=86a8e86138e340409f4f8986321ed53d, scope.project.id=5c8bef8162de48719c2febf3564c7269, user.id=81220503fc364937b18ce19bc0784aa8) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:25.599250 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6c943-3d8b-4893-af31-18a1ffa75064 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:25.600036 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6c943-3d8b-4893-af31-18a1ffa75064 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:25.608503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 142/261] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:51:25 2022] GET /identity/v3/role_assignments?user.id=81220503fc364937b18ce19bc0784aa8&scope.project.id=5c8bef8162de48719c2febf3564c7269&role.id=86a8e86138e340409f4f8986321ed53d => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:25.609651 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6c943-3d8b-4893-af31-18a1ffa75064 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:25.737503 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e5564-9f3b-46ae-87dd-e57aa8556755 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:25.755342 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6c943-3d8b-4893-af31-18a1ffa75064 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:25.783030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:25.803121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc9512-2ffb-460d-b16b-5f6c397b2da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:25.804212 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc9512-2ffb-460d-b16b-5f6c397b2da7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:25.804500 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc9512-2ffb-460d-b16b-5f6c397b2da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:25.805055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc9512-2ffb-460d-b16b-5f6c397b2da7 None admin] PATH_INFO: `/v3/users/672d12d81cd8460b8a2de7fd5b989af3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:25.806350 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc9512-2ffb-460d-b16b-5f6c397b2da7 None admin] RBAC: Authorizing `identity:get_user(user_id=672d12d81cd8460b8a2de7fd5b989af3)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:25.810015 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc9512-2ffb-460d-b16b-5f6c397b2da7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:25.810200 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 143/262] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:25 2022] GET /identity/v3/users/672d12d81cd8460b8a2de7fd5b989af3 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:25.818703 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc9512-2ffb-460d-b16b-5f6c397b2da7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:25.829802 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585c0f7-8e4a-4676-9100-49a9e60a3d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:25.830496 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585c0f7-8e4a-4676-9100-49a9e60a3d1e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:25.830782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585c0f7-8e4a-4676-9100-49a9e60a3d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:25.831059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585c0f7-8e4a-4676-9100-49a9e60a3d1e None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:25.831820 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585c0f7-8e4a-4676-9100-49a9e60a3d1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:25.832127 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585c0f7-8e4a-4676-9100-49a9e60a3d1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:25.834218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585c0f7-8e4a-4676-9100-49a9e60a3d1e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:25.843690 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 120/263] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:51:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:25.849754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585c0f7-8e4a-4676-9100-49a9e60a3d1e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:25.892746 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:25.939596 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc9512-2ffb-460d-b16b-5f6c397b2da7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:25.984739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8101ed-a770-4135-b3f3-473454c8c1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:25.984739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8101ed-a770-4135-b3f3-473454c8c1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:25.984739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8101ed-a770-4135-b3f3-473454c8c1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:25.984739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8101ed-a770-4135-b3f3-473454c8c1a8 None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:25.985139 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8101ed-a770-4135-b3f3-473454c8c1a8 None admin] RBAC: Authorizing `identity:get_project(project_id=5c8bef8162de48719c2febf3564c7269)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:25.986769 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8101ed-a770-4135-b3f3-473454c8c1a8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:25.989125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 144/264] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:25 2022] GET /identity/v3/projects/5c8bef8162de48719c2febf3564c7269 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:25.997773 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8101ed-a770-4135-b3f3-473454c8c1a8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:26.005568 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585c0f7-8e4a-4676-9100-49a9e60a3d1e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:26.049283 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d800f4b-5d58-4e61-a98a-52990de458b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:26.050557 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d800f4b-5d58-4e61-a98a-52990de458b7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:26.051105 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d800f4b-5d58-4e61-a98a-52990de458b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:26.051563 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d800f4b-5d58-4e61-a98a-52990de458b7 None admin] PATH_INFO: `/v3/users/dd8f35f356824171aa9612d39c1ec616` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:26.053752 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d800f4b-5d58-4e61-a98a-52990de458b7 None admin] RBAC: Authorizing `identity:get_user(user_id=dd8f35f356824171aa9612d39c1ec616)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:26.055502 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d800f4b-5d58-4e61-a98a-52990de458b7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:26.058565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 121/265] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:25 2022] GET /identity/v3/users/dd8f35f356824171aa9612d39c1ec616 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:26.064080 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d800f4b-5d58-4e61-a98a-52990de458b7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:26.161466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8101ed-a770-4135-b3f3-473454c8c1a8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:26.177296 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:26.205166 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:26.223482 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b58a8-62ae-479e-990f-6be1ac6a91e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:26.224397 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b58a8-62ae-479e-990f-6be1ac6a91e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:26.224674 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b58a8-62ae-479e-990f-6be1ac6a91e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:26.224969 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b58a8-62ae-479e-990f-6be1ac6a91e7 None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269/users/672d12d81cd8460b8a2de7fd5b989af3/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:26.228886 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b58a8-62ae-479e-990f-6be1ac6a91e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c8bef8162de48719c2febf3564c7269, user_id=672d12d81cd8460b8a2de7fd5b989af3, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:26.230344 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b58a8-62ae-479e-990f-6be1ac6a91e7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:26.255259 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d800f4b-5d58-4e61-a98a-52990de458b7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:26.256953 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 145/266] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:51:25 2022] PUT /identity/v3/projects/5c8bef8162de48719c2febf3564c7269/users/672d12d81cd8460b8a2de7fd5b989af3/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:51:26.326831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3394f6c-5860-4f0f-90e1-13530176acb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:26.327522 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3394f6c-5860-4f0f-90e1-13530176acb7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:26.327810 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3394f6c-5860-4f0f-90e1-13530176acb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:26.328089 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3394f6c-5860-4f0f-90e1-13530176acb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:26.438308 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3394f6c-5860-4f0f-90e1-13530176acb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:26.440355 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3394f6c-5860-4f0f-90e1-13530176acb7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:26.493008 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:26.552997 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 122/267] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:26.558897 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b58a8-62ae-479e-990f-6be1ac6a91e7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:26.687584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b58a8-62ae-479e-990f-6be1ac6a91e7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:26.740618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b605f-d0c4-4620-8140-acfc5a326c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:26.741841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b605f-d0c4-4620-8140-acfc5a326c4f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:26.742297 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b605f-d0c4-4620-8140-acfc5a326c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:26.742784 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b605f-d0c4-4620-8140-acfc5a326c4f None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:26.744243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b605f-d0c4-4620-8140-acfc5a326c4f None admin] RBAC: Authorizing `identity:get_project(project_id=5c8bef8162de48719c2febf3564c7269)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:26.745908 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b605f-d0c4-4620-8140-acfc5a326c4f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:26.748232 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 146/268] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:26 2022] GET /identity/v3/projects/5c8bef8162de48719c2febf3564c7269 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:26.753788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3394f6c-5860-4f0f-90e1-13530176acb7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:26.899036 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3394f6c-5860-4f0f-90e1-13530176acb7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:26.953073 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4f995-3627-4196-a15c-3a013a3e95f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:26.954117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4f995-3627-4196-a15c-3a013a3e95f7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:26.954575 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4f995-3627-4196-a15c-3a013a3e95f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:26.955016 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4f995-3627-4196-a15c-3a013a3e95f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:26.956127 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4f995-3627-4196-a15c-3a013a3e95f7 None admin] RBAC: Adding query filter params (role.id=0a734da5c17d4cd39ea84b75878e55f1, scope.project.id=5c8bef8162de48719c2febf3564c7269, user.id=dd8f35f356824171aa9612d39c1ec616) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:26.956645 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4f995-3627-4196-a15c-3a013a3e95f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:26.960469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010324b8-acbb-4c8e-9eaa-7ad701117f32 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:26.960659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010324b8-acbb-4c8e-9eaa-7ad701117f32 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:26.960888 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010324b8-acbb-4c8e-9eaa-7ad701117f32 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:26.961277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4f995-3627-4196-a15c-3a013a3e95f7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:26.962764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 147/269] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:26.969288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92846239-148d-418e-bb4e-562672505f22 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:26.969578 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92846239-148d-418e-bb4e-562672505f22 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:26.969863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92846239-148d-418e-bb4e-562672505f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:26.973378 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 123/270] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:51:26 2022] GET /identity/v3/role_assignments?user.id=dd8f35f356824171aa9612d39c1ec616&scope.project.id=5c8bef8162de48719c2febf3564c7269&role.id=0a734da5c17d4cd39ea84b75878e55f1 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:26.994354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-92846239-148d-418e-bb4e-562672505f22 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:26.995903 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-92846239-148d-418e-bb4e-562672505f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:27.045110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62072c9-d381-4df1-beb6-08e67e3493ec None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:27.045308 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62072c9-d381-4df1-beb6-08e67e3493ec None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:27.045547 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62072c9-d381-4df1-beb6-08e67e3493ec None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:27.047325 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 124/271] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:51:27.054136 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:27.054321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943dae0-efa5-40ad-8323-86a03dce3192 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:27.054479 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943dae0-efa5-40ad-8323-86a03dce3192 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:27.054749 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943dae0-efa5-40ad-8323-86a03dce3192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:27.074727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 148/272] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:27.087645 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1943dae0-efa5-40ad-8323-86a03dce3192 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:27.089104 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1943dae0-efa5-40ad-8323-86a03dce3192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:27.093102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:27.122555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92846239-148d-418e-bb4e-562672505f22 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:27.205875 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 125/273] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:27.246566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92846239-148d-418e-bb4e-562672505f22 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:27.247353 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943dae0-efa5-40ad-8323-86a03dce3192 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:27.299676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62368acb-e18a-4254-992e-e12262e96478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:27.301054 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62368acb-e18a-4254-992e-e12262e96478 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:27.301502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62368acb-e18a-4254-992e-e12262e96478 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:27.302701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62368acb-e18a-4254-992e-e12262e96478 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:27.304193 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62368acb-e18a-4254-992e-e12262e96478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:27.305915 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62368acb-e18a-4254-992e-e12262e96478 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:27.307749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 149/274] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:27.313910 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62368acb-e18a-4254-992e-e12262e96478 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:27.381624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:27.387009 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943dae0-efa5-40ad-8323-86a03dce3192 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:27.431823 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956f57e-59b4-4607-82e5-d357e84893d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:27.433466 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956f57e-59b4-4607-82e5-d357e84893d2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:27.433904 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956f57e-59b4-4607-82e5-d357e84893d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:27.434361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956f57e-59b4-4607-82e5-d357e84893d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:27.444529 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:27.449219 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956f57e-59b4-4607-82e5-d357e84893d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:27.457757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62368acb-e18a-4254-992e-e12262e96478 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:27.459788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-0956f57e-59b4-4607-82e5-d357e84893d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:27.459788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:27.459788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:27.459788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:27.459788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:27.459788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:27.459788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:27.459788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:27.459788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:27.459788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:27.459788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:27.459788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:27.459788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:27.459788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:27.459788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:27.459788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:27.460788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:27.460788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:27.460788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:27.460788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:27.460788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:27.460788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:27.460788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:27.460788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:27.460788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:27.460788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:27.460788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:27.460788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:27.460788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:27.460788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:27.460788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:27.460788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:27.461991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:27.461991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:27.461991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:27.461991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:27.461991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:27.461991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:27.461991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:27.461991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:27.461991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:27.461991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:27.461991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:27.461991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:27.461991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 126/275] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:51:27.470612 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956f57e-59b4-4607-82e5-d357e84893d2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:27.513131 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b265f-3310-41b5-b0a5-cc1f0ee1ce1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:27.514814 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b265f-3310-41b5-b0a5-cc1f0ee1ce1e None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:27.515604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b265f-3310-41b5-b0a5-cc1f0ee1ce1e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:27.516425 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b265f-3310-41b5-b0a5-cc1f0ee1ce1e None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:27.517828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b265f-3310-41b5-b0a5-cc1f0ee1ce1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:27.520640 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b265f-3310-41b5-b0a5-cc1f0ee1ce1e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:27.556364 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 150/276] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 19 10:51:27 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 10:51:27.625811 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956f57e-59b4-4607-82e5-d357e84893d2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:27.670959 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea187a25-eaed-4d74-b9f9-8ec37f4b2386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:27.672016 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea187a25-eaed-4d74-b9f9-8ec37f4b2386 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:27.672498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea187a25-eaed-4d74-b9f9-8ec37f4b2386 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:27.673043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea187a25-eaed-4d74-b9f9-8ec37f4b2386 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:27.674114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea187a25-eaed-4d74-b9f9-8ec37f4b2386 None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:27.674661 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea187a25-eaed-4d74-b9f9-8ec37f4b2386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:27.676451 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea187a25-eaed-4d74-b9f9-8ec37f4b2386 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:27.687525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 127/277] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:27.693713 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b265f-3310-41b5-b0a5-cc1f0ee1ce1e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:27.811375 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b265f-3310-41b5-b0a5-cc1f0ee1ce1e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:27.824759 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:27.859196 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d037a8b-8bdd-4302-9c84-df5ee3113f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:27.860479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d037a8b-8bdd-4302-9c84-df5ee3113f52 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:27.861101 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d037a8b-8bdd-4302-9c84-df5ee3113f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:27.861595 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d037a8b-8bdd-4302-9c84-df5ee3113f52 None admin] PATH_INFO: `/v3/users/fd96582bf6ec49cfb5825b79bac7508f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:27.879297 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d037a8b-8bdd-4302-9c84-df5ee3113f52 None admin] RBAC: Authorizing `identity:get_user(user_id=fd96582bf6ec49cfb5825b79bac7508f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:27.880453 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d037a8b-8bdd-4302-9c84-df5ee3113f52 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:27.882408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 151/278] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:27 2022] GET /identity/v3/users/fd96582bf6ec49cfb5825b79bac7508f => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:27.888982 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea187a25-eaed-4d74-b9f9-8ec37f4b2386 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:27.973958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:28.018943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea187a25-eaed-4d74-b9f9-8ec37f4b2386 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:28.056077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f83a18-9a47-450c-a096-c4b07560211c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:28.057207 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f83a18-9a47-450c-a096-c4b07560211c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:28.057693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f83a18-9a47-450c-a096-c4b07560211c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:28.058240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f83a18-9a47-450c-a096-c4b07560211c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:28.059283 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f83a18-9a47-450c-a096-c4b07560211c None admin] RBAC: Adding query filter params (role.id=6ff885694ad84e4cb935ef1c1f001858, user.id=fd96582bf6ec49cfb5825b79bac7508f, scope.system=all) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:28.059799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f83a18-9a47-450c-a096-c4b07560211c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:28.061613 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f83a18-9a47-450c-a096-c4b07560211c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:28.068015 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 128/279] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Jul 19 10:51:27 2022] GET /identity/v3/role_assignments?user.id=fd96582bf6ec49cfb5825b79bac7508f&scope.system=all&role.id=6ff885694ad84e4cb935ef1c1f001858 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:28.098102 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67541f5e-5f83-43fa-a249-a3bdc63151e3 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:28.098440 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67541f5e-5f83-43fa-a249-a3bdc63151e3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:28.098650 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67541f5e-5f83-43fa-a249-a3bdc63151e3 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:28.100417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 152/280] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:28.107111 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7743d5-8221-423a-815d-4d1914128405 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:28.107759 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7743d5-8221-423a-815d-4d1914128405 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:28.108239 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7743d5-8221-423a-815d-4d1914128405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:28.130452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1c7743d5-8221-423a-815d-4d1914128405 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:28.132104 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1c7743d5-8221-423a-815d-4d1914128405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:28.222708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 129/281] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:28.246687 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67541f5e-5f83-43fa-a249-a3bdc63151e3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:28.360678 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67541f5e-5f83-43fa-a249-a3bdc63151e3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:28.400822 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d43a64-010b-429c-a7bb-9a5c06e61d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:28.402270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d43a64-010b-429c-a7bb-9a5c06e61d8d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:28.402749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d43a64-010b-429c-a7bb-9a5c06e61d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:28.403241 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d43a64-010b-429c-a7bb-9a5c06e61d8d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:28.415013 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d43a64-010b-429c-a7bb-9a5c06e61d8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:28.423666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-08d43a64-010b-429c-a7bb-9a5c06e61d8d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:51:28.423666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:28.423666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:28.423666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:28.423666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:28.423666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:28.423666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:28.423666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:28.423666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:28.423666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:28.423666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:28.423666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:28.423666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:28.423666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:28.423666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:28.423666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:28.424604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:28.424604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:28.424604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:28.424604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:28.424604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:28.424604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:28.424604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:28.424604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:28.424604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:28.424604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:28.424604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:28.424604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:28.424604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:28.424604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:28.424604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:28.424604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:28.425418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:28.425418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:28.425418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:28.425418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:28.425418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:28.425418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:28.425418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:28.425418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:28.425418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:28.425418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:28.425418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:51:28.425418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:28.428247 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 153/282] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:28.434691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7743d5-8221-423a-815d-4d1914128405 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:28.514228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:28.558776 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7743d5-8221-423a-815d-4d1914128405 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:28.596747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e0232-2cf7-4ab7-a29e-eed4fb0c7e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:28.597444 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e0232-2cf7-4ab7-a29e-eed4fb0c7e7a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:28.597729 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e0232-2cf7-4ab7-a29e-eed4fb0c7e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:28.598005 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e0232-2cf7-4ab7-a29e-eed4fb0c7e7a None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:28.598763 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e0232-2cf7-4ab7-a29e-eed4fb0c7e7a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:28.599070 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e0232-2cf7-4ab7-a29e-eed4fb0c7e7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:28.600468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e0232-2cf7-4ab7-a29e-eed4fb0c7e7a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:28.610014 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 130/283] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:28.615349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d43a64-010b-429c-a7bb-9a5c06e61d8d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:28.659690 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:28.758566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d43a64-010b-429c-a7bb-9a5c06e61d8d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:28.796997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a6ff2-4e78-4988-a230-ecc8baa4b830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:28.797889 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a6ff2-4e78-4988-a230-ecc8baa4b830 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:28.798169 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a6ff2-4e78-4988-a230-ecc8baa4b830 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:28.798446 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a6ff2-4e78-4988-a230-ecc8baa4b830 None admin] PATH_INFO: `/v3/users/81220503fc364937b18ce19bc0784aa8` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:28.799655 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a6ff2-4e78-4988-a230-ecc8baa4b830 None admin] RBAC: Authorizing `identity:get_user(user_id=81220503fc364937b18ce19bc0784aa8)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:28.801241 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a6ff2-4e78-4988-a230-ecc8baa4b830 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:28.802896 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 154/284] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:28 2022] GET /identity/v3/users/81220503fc364937b18ce19bc0784aa8 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:28.808572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e0232-2cf7-4ab7-a29e-eed4fb0c7e7a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:28.872380 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40347302-89d2-4bcd-9a6d-06829e0fa867 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:28.872563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40347302-89d2-4bcd-9a6d-06829e0fa867 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:28.872869 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40347302-89d2-4bcd-9a6d-06829e0fa867 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:28.874405 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 155/285] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:28.879935 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4cf76-55bc-41ef-b9f3-5054a18b0874 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:28.880537 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4cf76-55bc-41ef-b9f3-5054a18b0874 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:28.881038 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4cf76-55bc-41ef-b9f3-5054a18b0874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:28.917762 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e8b4cf76-55bc-41ef-b9f3-5054a18b0874 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:28.919308 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e8b4cf76-55bc-41ef-b9f3-5054a18b0874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:28.949353 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e0232-2cf7-4ab7-a29e-eed4fb0c7e7a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:28.984733 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:29.016225 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834eaa4-d746-4084-95a3-e2cb125465b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:29.017141 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834eaa4-d746-4084-95a3-e2cb125465b7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:29.017422 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834eaa4-d746-4084-95a3-e2cb125465b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:29.017695 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834eaa4-d746-4084-95a3-e2cb125465b7 None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:29.018904 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834eaa4-d746-4084-95a3-e2cb125465b7 None admin] RBAC: Authorizing `identity:get_project(project_id=5c8bef8162de48719c2febf3564c7269)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:29.020362 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834eaa4-d746-4084-95a3-e2cb125465b7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:29.022291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 131/286] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:28 2022] GET /identity/v3/projects/5c8bef8162de48719c2febf3564c7269 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:29.031023 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834eaa4-d746-4084-95a3-e2cb125465b7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:29.032832 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 156/287] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:51:29.071982 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4cf76-55bc-41ef-b9f3-5054a18b0874 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:29.121092 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:29.153431 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834eaa4-d746-4084-95a3-e2cb125465b7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:29.209201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4cf76-55bc-41ef-b9f3-5054a18b0874 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:29.216086 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d745e44-fcf3-486a-a660-b948798c7058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:29.217027 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d745e44-fcf3-486a-a660-b948798c7058 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:29.217310 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d745e44-fcf3-486a-a660-b948798c7058 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:29.217585 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d745e44-fcf3-486a-a660-b948798c7058 None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269/users/81220503fc364937b18ce19bc0784aa8/roles/86a8e86138e340409f4f8986321ed53d` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:29.219554 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d745e44-fcf3-486a-a660-b948798c7058 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c8bef8162de48719c2febf3564c7269, user_id=81220503fc364937b18ce19bc0784aa8, role_id=86a8e86138e340409f4f8986321ed53d)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:29.221037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d745e44-fcf3-486a-a660-b948798c7058 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:29.249338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fff0cc-00f9-40eb-9a45-2bafedf4795c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:29.250209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fff0cc-00f9-40eb-9a45-2bafedf4795c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:29.250497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fff0cc-00f9-40eb-9a45-2bafedf4795c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:29.250776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fff0cc-00f9-40eb-9a45-2bafedf4795c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:29.254014 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 132/288] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:51:29 2022] PUT /identity/v3/projects/5c8bef8162de48719c2febf3564c7269/users/81220503fc364937b18ce19bc0784aa8/roles/86a8e86138e340409f4f8986321ed53d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 10:51:29.272366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fff0cc-00f9-40eb-9a45-2bafedf4795c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:29.280544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-b4fff0cc-00f9-40eb-9a45-2bafedf4795c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:29.280544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:29.280544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:29.280544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:29.280544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:29.280544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:29.280544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:29.280544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:29.280544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:29.280544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:29.280544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:29.280544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:29.280544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:29.280544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:29.280544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:29.280544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:29.281444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:29.281444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:29.281444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:29.281444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:29.281444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:29.281444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:29.281444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:29.281444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:29.281444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:29.281444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:29.281444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:29.281444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:29.281444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:29.281444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:29.281444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:29.281444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:29.282239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:29.282239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:29.282239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:29.282239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:29.282239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:29.282239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:29.282239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:29.282239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:29.282239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:29.282239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:29.282239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:29.282239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:29.286497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 157/289] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:51:29.292766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d745e44-fcf3-486a-a660-b948798c7058 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:29.368623 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:29.453007 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d745e44-fcf3-486a-a660-b948798c7058 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:29.491785 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a1853-7490-4737-9b7a-3d38be954ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:29.492473 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a1853-7490-4737-9b7a-3d38be954ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:29.492825 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a1853-7490-4737-9b7a-3d38be954ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:29.493109 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a1853-7490-4737-9b7a-3d38be954ce4 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:29.493882 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a1853-7490-4737-9b7a-3d38be954ce4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:29.494190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a1853-7490-4737-9b7a-3d38be954ce4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:29.495591 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a1853-7490-4737-9b7a-3d38be954ce4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:29.505188 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 133/290] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:29.510754 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fff0cc-00f9-40eb-9a45-2bafedf4795c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:29.603951 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:29.622015 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fff0cc-00f9-40eb-9a45-2bafedf4795c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:29.657478 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4290ad5-965f-4f95-ab62-ae74580e0a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:29.658366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4290ad5-965f-4f95-ab62-ae74580e0a77 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:29.658648 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4290ad5-965f-4f95-ab62-ae74580e0a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:29.658921 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4290ad5-965f-4f95-ab62-ae74580e0a77 None admin] PATH_INFO: `/v3/users/672d12d81cd8460b8a2de7fd5b989af3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:29.660125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4290ad5-965f-4f95-ab62-ae74580e0a77 None admin] RBAC: Authorizing `identity:get_user(user_id=672d12d81cd8460b8a2de7fd5b989af3)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:29.661613 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4290ad5-965f-4f95-ab62-ae74580e0a77 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:29.663331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 158/291] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:29 2022] GET /identity/v3/users/672d12d81cd8460b8a2de7fd5b989af3 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:29.668997 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a1853-7490-4737-9b7a-3d38be954ce4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:29.790075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a1853-7490-4737-9b7a-3d38be954ce4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:29.806730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:29.835660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fca7b-e8af-41a5-bca9-17a667231713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:29.836331 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fca7b-e8af-41a5-bca9-17a667231713 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:29.836678 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fca7b-e8af-41a5-bca9-17a667231713 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:29.836990 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fca7b-e8af-41a5-bca9-17a667231713 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:29.926655 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fca7b-e8af-41a5-bca9-17a667231713 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:29.926655 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fca7b-e8af-41a5-bca9-17a667231713 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:30.029140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 134/292] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 10:51:30.036739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4290ad5-965f-4f95-ab62-ae74580e0a77 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:30.186673 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4290ad5-965f-4f95-ab62-ae74580e0a77 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:30.222739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9679c7-fd36-4615-beec-812cc68be8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:30.223626 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9679c7-fd36-4615-beec-812cc68be8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:30.223907 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9679c7-fd36-4615-beec-812cc68be8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:30.224182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9679c7-fd36-4615-beec-812cc68be8a0 None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:30.225410 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9679c7-fd36-4615-beec-812cc68be8a0 None admin] RBAC: Authorizing `identity:get_project(project_id=5c8bef8162de48719c2febf3564c7269)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:30.226864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9679c7-fd36-4615-beec-812cc68be8a0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:30.229324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 159/293] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:30 2022] GET /identity/v3/projects/5c8bef8162de48719c2febf3564c7269 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:30.235234 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fca7b-e8af-41a5-bca9-17a667231713 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:30.245818 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:30.358441 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fca7b-e8af-41a5-bca9-17a667231713 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:30.370812 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde98e7b-fd94-490e-990b-3470219efad9 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:30.371313 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde98e7b-fd94-490e-990b-3470219efad9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:30.371384 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde98e7b-fd94-490e-990b-3470219efad9 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:30.372888 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 160/294] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:51:30.386248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7418a6-d7a0-4662-9a88-44a1f83d890a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:30.386532 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7418a6-d7a0-4662-9a88-44a1f83d890a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:30.386812 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7418a6-d7a0-4662-9a88-44a1f83d890a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:30.420666 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08df42-8eba-47f6-b2f9-cbfe0bb422f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:30.420920 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2a7418a6-d7a0-4662-9a88-44a1f83d890a None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:30.421001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08df42-8eba-47f6-b2f9-cbfe0bb422f4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:30.421001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08df42-8eba-47f6-b2f9-cbfe0bb422f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:30.421120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2a7418a6-d7a0-4662-9a88-44a1f83d890a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:30.421195 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08df42-8eba-47f6-b2f9-cbfe0bb422f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:30.421195 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08df42-8eba-47f6-b2f9-cbfe0bb422f4 None admin] RBAC: Adding query filter params (role.id=6ff885694ad84e4cb935ef1c1f001858, scope.project.id=5c8bef8162de48719c2febf3564c7269, user.id=672d12d81cd8460b8a2de7fd5b989af3) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:30.421195 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08df42-8eba-47f6-b2f9-cbfe0bb422f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:30.421798 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08df42-8eba-47f6-b2f9-cbfe0bb422f4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:30.438847 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 135/295] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:51:30 2022] GET /identity/v3/role_assignments?user.id=672d12d81cd8460b8a2de7fd5b989af3&scope.project.id=5c8bef8162de48719c2febf3564c7269&role.id=6ff885694ad84e4cb935ef1c1f001858 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:30.448184 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:30.463783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd507788-2bb4-4ad4-b6b3-59d9bebf1c02 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:30.464098 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd507788-2bb4-4ad4-b6b3-59d9bebf1c02 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:30.464350 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd507788-2bb4-4ad4-b6b3-59d9bebf1c02 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:30.466364 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 136/296] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:51:30.474697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4e950-fefa-4dc5-9635-5335d731f98b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:30.475162 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4e950-fefa-4dc5-9635-5335d731f98b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:30.475504 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4e950-fefa-4dc5-9635-5335d731f98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:30.510481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-05a4e950-fefa-4dc5-9635-5335d731f98b None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:30.514042 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-05a4e950-fefa-4dc5-9635-5335d731f98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:30.561726 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 161/297] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:51:30.600700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7418a6-d7a0-4662-9a88-44a1f83d890a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:30.641464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 137/298] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:30.664858 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4e950-fefa-4dc5-9635-5335d731f98b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:30.667031 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:30.727553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7418a6-d7a0-4662-9a88-44a1f83d890a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:30.775414 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d92636-31e9-4232-a1e3-74cac26a8928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:30.776323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d92636-31e9-4232-a1e3-74cac26a8928 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:30.776601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d92636-31e9-4232-a1e3-74cac26a8928 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:30.776913 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d92636-31e9-4232-a1e3-74cac26a8928 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:30.789636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d92636-31e9-4232-a1e3-74cac26a8928 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:30.792335 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4e950-fefa-4dc5-9635-5335d731f98b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:30.798221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d3d92636-31e9-4232-a1e3-74cac26a8928 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:51:30.798221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:30.798221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:30.798221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:30.798221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:30.798221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:30.798221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:30.798221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:30.798221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:30.798221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:30.798221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:30.798221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:30.798221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:30.798221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:30.798221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:30.798221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:30.799091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:30.799091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:30.799091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:30.799091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:30.799091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:30.799091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:30.799091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:30.799091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:30.799091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:30.799091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:30.799091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:30.799091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:30.799091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:30.799091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:30.799091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:30.799091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:30.800335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:30.800335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:30.800335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:30.800335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:30.800335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:30.800335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:30.800335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:30.800335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:30.800335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:30.800335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:30.800335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:51:30.800335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:30.800335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 162/299] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:51:30.805122 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d92636-31e9-4232-a1e3-74cac26a8928 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:30.819400 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:30.833727 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e21f7-ead6-4165-8847-5c04b70507f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:30.834541 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e21f7-ead6-4165-8847-5c04b70507f8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:30.834826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e21f7-ead6-4165-8847-5c04b70507f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:30.835098 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e21f7-ead6-4165-8847-5c04b70507f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:30.849257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e21f7-ead6-4165-8847-5c04b70507f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:30.861415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-024e21f7-ead6-4165-8847-5c04b70507f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:30.861415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:30.861415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:30.861415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:30.861415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:30.861415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:30.861415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:30.861415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:30.861415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:30.861415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:30.861415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:30.861415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:30.861415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:30.861415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:30.861415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:30.861415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:30.862321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:30.862321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:30.862321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:30.862321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:30.862321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:30.862321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:30.862321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:30.862321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:30.862321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:30.862321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:30.862321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:30.862321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:30.862321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:30.862321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:30.862321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:30.862321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:30.863101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:30.863101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:30.863101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:30.863101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:30.863101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:30.863101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:30.863101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:30.863101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:30.863101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:30.863101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:30.863101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:30.863101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:30.863101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 138/300] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:51:30.863890 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc92876-d60f-4d00-bbd8-25db09c1e6e6 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:30.868967 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc92876-d60f-4d00-bbd8-25db09c1e6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:30.869276 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc92876-d60f-4d00-bbd8-25db09c1e6e6 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:30.870739 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 139/301] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:30.871310 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc92876-d60f-4d00-bbd8-25db09c1e6e6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:30.922428 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d92636-31e9-4232-a1e3-74cac26a8928 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:30.935782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:30.958038 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3505e9-0157-4680-a3c0-d8c7ab18215c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:30.958719 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3505e9-0157-4680-a3c0-d8c7ab18215c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:30.959005 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3505e9-0157-4680-a3c0-d8c7ab18215c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:30.959283 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3505e9-0157-4680-a3c0-d8c7ab18215c None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:30.960063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3505e9-0157-4680-a3c0-d8c7ab18215c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:30.960369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3505e9-0157-4680-a3c0-d8c7ab18215c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:30.961812 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3505e9-0157-4680-a3c0-d8c7ab18215c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:30.970571 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 163/302] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:30.971898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6207d-a96c-4456-9f17-e0b38aed1607 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:30.972188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6207d-a96c-4456-9f17-e0b38aed1607 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:30.972460 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6207d-a96c-4456-9f17-e0b38aed1607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:30.986106 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc92876-d60f-4d00-bbd8-25db09c1e6e6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:30.989747 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3dc6207d-a96c-4456-9f17-e0b38aed1607 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:30.990938 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3dc6207d-a96c-4456-9f17-e0b38aed1607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:31.023355 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534f8e3-5250-4405-8dec-25bd5241caa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:31.024382 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534f8e3-5250-4405-8dec-25bd5241caa2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:31.024856 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534f8e3-5250-4405-8dec-25bd5241caa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:31.025310 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534f8e3-5250-4405-8dec-25bd5241caa2 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:31.026289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534f8e3-5250-4405-8dec-25bd5241caa2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:31.026582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534f8e3-5250-4405-8dec-25bd5241caa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:31.028145 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534f8e3-5250-4405-8dec-25bd5241caa2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:31.038789 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 140/303] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:31.039737 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534f8e3-5250-4405-8dec-25bd5241caa2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:31.067103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 164/304] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:31.067967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6207d-a96c-4456-9f17-e0b38aed1607 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:31.070334 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:31.162248 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534f8e3-5250-4405-8dec-25bd5241caa2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:31.193712 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:31.194072 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6207d-a96c-4456-9f17-e0b38aed1607 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:31.205417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49787006-f71e-48b2-a229-2ddb172e89d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:31.206317 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49787006-f71e-48b2-a229-2ddb172e89d7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:31.206600 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49787006-f71e-48b2-a229-2ddb172e89d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:31.206874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49787006-f71e-48b2-a229-2ddb172e89d7 None admin] PATH_INFO: `/v3/users/a7a06876dc6d4a7788b69fb675af9859` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:31.220645 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49787006-f71e-48b2-a229-2ddb172e89d7 None admin] RBAC: Authorizing `identity:get_user(user_id=a7a06876dc6d4a7788b69fb675af9859)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:31.222168 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49787006-f71e-48b2-a229-2ddb172e89d7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:31.224061 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 141/305] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:31 2022] GET /identity/v3/users/a7a06876dc6d4a7788b69fb675af9859 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:31.224755 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49787006-f71e-48b2-a229-2ddb172e89d7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:31.241818 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba48752-73d7-437d-9bb4-ccd0b341d4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:31.242801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba48752-73d7-437d-9bb4-ccd0b341d4fa None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:31.243156 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba48752-73d7-437d-9bb4-ccd0b341d4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:31.243580 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba48752-73d7-437d-9bb4-ccd0b341d4fa None admin] PATH_INFO: `/v3/users/fd96582bf6ec49cfb5825b79bac7508f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:31.244801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba48752-73d7-437d-9bb4-ccd0b341d4fa None admin] RBAC: Authorizing `identity:get_user(user_id=fd96582bf6ec49cfb5825b79bac7508f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:31.246266 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba48752-73d7-437d-9bb4-ccd0b341d4fa None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:31.248091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 165/306] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:31 2022] GET /identity/v3/users/fd96582bf6ec49cfb5825b79bac7508f => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:31.248673 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba48752-73d7-437d-9bb4-ccd0b341d4fa None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:31.323848 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:31.340174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49787006-f71e-48b2-a229-2ddb172e89d7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:31.365443 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba48752-73d7-437d-9bb4-ccd0b341d4fa None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:31.383726 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363a8a9-ac03-4900-af09-bdb8faa2e635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:31.384674 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363a8a9-ac03-4900-af09-bdb8faa2e635 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:31.384983 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363a8a9-ac03-4900-af09-bdb8faa2e635 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:31.385254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363a8a9-ac03-4900-af09-bdb8faa2e635 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:31.386436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363a8a9-ac03-4900-af09-bdb8faa2e635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:31.392315 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363a8a9-ac03-4900-af09-bdb8faa2e635 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:31.394242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 142/307] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:31.394977 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363a8a9-ac03-4900-af09-bdb8faa2e635 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:31.408751 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a92f1-3772-47ef-8698-113feea6ec07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:31.410100 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a92f1-3772-47ef-8698-113feea6ec07 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:31.410572 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a92f1-3772-47ef-8698-113feea6ec07 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:31.411065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a92f1-3772-47ef-8698-113feea6ec07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:31.412072 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a92f1-3772-47ef-8698-113feea6ec07 None admin] RBAC: Adding query filter params (role.id=86a8e86138e340409f4f8986321ed53d, user.id=a7a06876dc6d4a7788b69fb675af9859, scope.system=all) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:31.412582 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a92f1-3772-47ef-8698-113feea6ec07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:31.414542 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a92f1-3772-47ef-8698-113feea6ec07 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:31.422688 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 166/308] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Jul 19 10:51:31 2022] GET /identity/v3/role_assignments?user.id=a7a06876dc6d4a7788b69fb675af9859&scope.system=all&role.id=86a8e86138e340409f4f8986321ed53d => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:31.423726 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a92f1-3772-47ef-8698-113feea6ec07 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:31.466333 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:31.537461 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363a8a9-ac03-4900-af09-bdb8faa2e635 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:31.553605 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a92f1-3772-47ef-8698-113feea6ec07 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:31.592930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428b9c3-bfe7-492b-8e2e-6313d52e5fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:31.593616 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428b9c3-bfe7-492b-8e2e-6313d52e5fcc None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:31.593893 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428b9c3-bfe7-492b-8e2e-6313d52e5fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:31.593993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615cec3-4800-4d98-b4e4-e992d9e5ecf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:31.594156 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428b9c3-bfe7-492b-8e2e-6313d52e5fcc None admin] PATH_INFO: `/v3/groups` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:31.594856 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428b9c3-bfe7-492b-8e2e-6313d52e5fcc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:31.595380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615cec3-4800-4d98-b4e4-e992d9e5ecf1 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:31.595844 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615cec3-4800-4d98-b4e4-e992d9e5ecf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:31.596287 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615cec3-4800-4d98-b4e4-e992d9e5ecf1 None admin] PATH_INFO: `/v3/system/users/fd96582bf6ec49cfb5825b79bac7508f/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:31.596384 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428b9c3-bfe7-492b-8e2e-6313d52e5fcc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:31.598204 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615cec3-4800-4d98-b4e4-e992d9e5ecf1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fd96582bf6ec49cfb5825b79bac7508f, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:31.599658 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:31.602095 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615cec3-4800-4d98-b4e4-e992d9e5ecf1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:31.616197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 143/309] 10.222.0.18 () {58 vars in 1334 bytes} [Tue Jul 19 10:51:31 2022] PUT /identity/v3/system/users/fd96582bf6ec49cfb5825b79bac7508f/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:51:31.624574 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 167/310] 10.222.0.18 () {60 vars in 1134 bytes} [Tue Jul 19 10:51:31 2022] POST /identity/v3/groups => generated 229 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:51:31.713202 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47781d7-41cb-4855-9de2-d2123601874f None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:31.713846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47781d7-41cb-4855-9de2-d2123601874f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:31.714313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47781d7-41cb-4855-9de2-d2123601874f None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:31.716629 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 144/311] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:31.722872 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907befb8-f2a8-4867-b73e-6ff6b269ca75 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:31.723161 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907befb8-f2a8-4867-b73e-6ff6b269ca75 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:31.723443 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907befb8-f2a8-4867-b73e-6ff6b269ca75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:31.750059 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-907befb8-f2a8-4867-b73e-6ff6b269ca75 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:31.751288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-907befb8-f2a8-4867-b73e-6ff6b269ca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:31.833425 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 168/312] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:31.857024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47781d7-41cb-4855-9de2-d2123601874f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:31.966156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47781d7-41cb-4855-9de2-d2123601874f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:31.981580 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:32.004799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2a8fa-d229-4d84-84fb-5bb882bb7e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:32.006041 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2a8fa-d229-4d84-84fb-5bb882bb7e04 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:32.006525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2a8fa-d229-4d84-84fb-5bb882bb7e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:32.006997 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2a8fa-d229-4d84-84fb-5bb882bb7e04 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:32.021502 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2a8fa-d229-4d84-84fb-5bb882bb7e04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:32.030921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-40d2a8fa-d229-4d84-84fb-5bb882bb7e04 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:51:32.030921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:32.030921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:32.030921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:32.030921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:32.030921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:32.030921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:32.030921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:32.030921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:32.030921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:32.030921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:32.030921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:32.030921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:32.030921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:32.030921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:32.030921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:32.031872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:32.031872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:32.031872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:32.031872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:32.031872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:32.031872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:32.031872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:32.031872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:32.031872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:32.031872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:32.031872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:32.031872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:32.031872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:32.031872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:32.031872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:32.031872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:32.032682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:32.032682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:32.032682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:32.032682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:32.032682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:32.032682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:32.032682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:32.032682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:32.032682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:32.032682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:32.032682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:51:32.032682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:32.035559 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 145/313] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:32.041653 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907befb8-f2a8-4867-b73e-6ff6b269ca75 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:32.151150 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907befb8-f2a8-4867-b73e-6ff6b269ca75 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:32.177228 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:32.188687 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab8868-50ed-4b40-acaa-8aacbe6cc9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:32.189496 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab8868-50ed-4b40-acaa-8aacbe6cc9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:32.189778 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab8868-50ed-4b40-acaa-8aacbe6cc9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:32.190077 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab8868-50ed-4b40-acaa-8aacbe6cc9f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:32.190871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab8868-50ed-4b40-acaa-8aacbe6cc9f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:32.191554 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab8868-50ed-4b40-acaa-8aacbe6cc9f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:32.193019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab8868-50ed-4b40-acaa-8aacbe6cc9f1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:32.202843 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 169/314] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:32.208177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2a8fa-d229-4d84-84fb-5bb882bb7e04 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:32.321693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2a8fa-d229-4d84-84fb-5bb882bb7e04 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:32.357414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a05cc-cb96-4323-a4db-1bad4864bf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:32.358722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a05cc-cb96-4323-a4db-1bad4864bf0a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:32.359197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a05cc-cb96-4323-a4db-1bad4864bf0a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:32.359658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a05cc-cb96-4323-a4db-1bad4864bf0a None admin] PATH_INFO: `/v3/users/81220503fc364937b18ce19bc0784aa8` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:32.361124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a05cc-cb96-4323-a4db-1bad4864bf0a None admin] RBAC: Authorizing `identity:get_user(user_id=81220503fc364937b18ce19bc0784aa8)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:32.362785 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a05cc-cb96-4323-a4db-1bad4864bf0a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:32.365095 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 146/315] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:32 2022] GET /identity/v3/users/81220503fc364937b18ce19bc0784aa8 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:32.372911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab8868-50ed-4b40-acaa-8aacbe6cc9f1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:32.490147 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab8868-50ed-4b40-acaa-8aacbe6cc9f1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:32.525878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91f89f-db80-473a-8c38-3cce8f86e64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:32.526541 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91f89f-db80-473a-8c38-3cce8f86e64e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:32.526823 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91f89f-db80-473a-8c38-3cce8f86e64e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:32.527099 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91f89f-db80-473a-8c38-3cce8f86e64e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:32.586644 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:32.600407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91f89f-db80-473a-8c38-3cce8f86e64e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:32.602337 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91f89f-db80-473a-8c38-3cce8f86e64e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:32.711058 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 170/316] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:32.716898 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a05cc-cb96-4323-a4db-1bad4864bf0a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:32.766814 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:32.827779 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a05cc-cb96-4323-a4db-1bad4864bf0a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:32.864575 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be921e-09ac-46a6-8c7b-cbf0322e62dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:32.865507 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be921e-09ac-46a6-8c7b-cbf0322e62dd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:32.865876 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be921e-09ac-46a6-8c7b-cbf0322e62dd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:32.866064 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be921e-09ac-46a6-8c7b-cbf0322e62dd None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:32.867403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be921e-09ac-46a6-8c7b-cbf0322e62dd None admin] RBAC: Authorizing `identity:get_project(project_id=5c8bef8162de48719c2febf3564c7269)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:32.869035 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be921e-09ac-46a6-8c7b-cbf0322e62dd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:32.871235 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 147/317] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:32 2022] GET /identity/v3/projects/5c8bef8162de48719c2febf3564c7269 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:32.878024 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91f89f-db80-473a-8c38-3cce8f86e64e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:32.979308 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:32.996640 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91f89f-db80-473a-8c38-3cce8f86e64e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:33.034642 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d548b-29da-44a7-a8bd-bae73977a18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:33.035326 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d548b-29da-44a7-a8bd-bae73977a18a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:33.035659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d548b-29da-44a7-a8bd-bae73977a18a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:33.035935 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d548b-29da-44a7-a8bd-bae73977a18a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:33.036826 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d548b-29da-44a7-a8bd-bae73977a18a None admin] RBAC: Adding query filter params (role.id=86a8e86138e340409f4f8986321ed53d, scope.project.id=5c8bef8162de48719c2febf3564c7269, user.id=81220503fc364937b18ce19bc0784aa8) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:33.037142 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d548b-29da-44a7-a8bd-bae73977a18a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:33.038633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d548b-29da-44a7-a8bd-bae73977a18a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:33.045772 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 171/318] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:51:32 2022] GET /identity/v3/role_assignments?user.id=81220503fc364937b18ce19bc0784aa8&scope.project.id=5c8bef8162de48719c2febf3564c7269&role.id=86a8e86138e340409f4f8986321ed53d => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:33.516039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c8009-4f4e-4c35-8a75-860bb16aae81 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:33.516278 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c8009-4f4e-4c35-8a75-860bb16aae81 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:33.516570 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c8009-4f4e-4c35-8a75-860bb16aae81 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:33.517955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 148/319] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:33.523674 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cc2bb-1c03-43df-a0f8-5e104d019c32 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:33.524209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cc2bb-1c03-43df-a0f8-5e104d019c32 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:33.524564 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cc2bb-1c03-43df-a0f8-5e104d019c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:33.541656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7a9cc2bb-1c03-43df-a0f8-5e104d019c32 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:33.542829 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7a9cc2bb-1c03-43df-a0f8-5e104d019c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:33.613963 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 172/320] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:33.635812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c8009-4f4e-4c35-8a75-860bb16aae81 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:33.743552 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c8009-4f4e-4c35-8a75-860bb16aae81 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:33.754497 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:33.780788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834beb9-424f-4a91-bb4a-4cc3c9336348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:33.781602 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834beb9-424f-4a91-bb4a-4cc3c9336348 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:33.781883 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834beb9-424f-4a91-bb4a-4cc3c9336348 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:33.782157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834beb9-424f-4a91-bb4a-4cc3c9336348 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:33.793621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834beb9-424f-4a91-bb4a-4cc3c9336348 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:33.801489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-a834beb9-424f-4a91-bb4a-4cc3c9336348 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:51:33.801489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:33.801489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:33.801489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:33.801489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:33.801489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:33.801489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:33.801489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:33.801489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:33.801489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:33.801489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:33.801489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:33.801489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:33.801489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:33.801489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:33.801489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:33.802360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:33.802360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:33.802360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:33.802360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:33.802360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:33.802360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:33.802360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:33.802360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:33.802360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:33.802360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:33.802360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:33.802360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:33.802360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:33.802360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:33.802360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:33.802360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:33.803140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:33.803140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:33.803140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:33.803140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:33.803140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:33.803140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:33.803140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:33.803140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:33.803140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:33.803140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:33.803140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:51:33.803140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:33.803140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 149/321] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:33.809968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cc2bb-1c03-43df-a0f8-5e104d019c32 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:33.830511 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823c319-c24f-4141-92e7-dc3b335d02c4 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:33.830805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823c319-c24f-4141-92e7-dc3b335d02c4 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:33.831064 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823c319-c24f-4141-92e7-dc3b335d02c4 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:33.832574 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 150/322] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:51:33.837546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddfa61-27fe-4cc7-aceb-beda65956a99 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:33.838054 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddfa61-27fe-4cc7-aceb-beda65956a99 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:33.838164 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddfa61-27fe-4cc7-aceb-beda65956a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:33.855526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-48ddfa61-27fe-4cc7-aceb-beda65956a99 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:33.856752 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-48ddfa61-27fe-4cc7-aceb-beda65956a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:33.896960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:33.918276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cc2bb-1c03-43df-a0f8-5e104d019c32 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:33.928768 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 151/323] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:33.930195 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162175e-fd1d-4dc5-b089-bd0ae926d202 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:33.930482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162175e-fd1d-4dc5-b089-bd0ae926d202 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:33.930757 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162175e-fd1d-4dc5-b089-bd0ae926d202 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:33.932172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 152/324] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:33.937479 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c0b28-bfc3-4b44-b5d3-39c0fb5bc37a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:33.937770 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c0b28-bfc3-4b44-b5d3-39c0fb5bc37a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:33.938051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c0b28-bfc3-4b44-b5d3-39c0fb5bc37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:33.954753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be760b-0059-4cff-8607-b31f6b4ba586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:33.955431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be760b-0059-4cff-8607-b31f6b4ba586 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:33.955712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be760b-0059-4cff-8607-b31f6b4ba586 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:33.955810 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-765c0b28-bfc3-4b44-b5d3-39c0fb5bc37a None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:33.955985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be760b-0059-4cff-8607-b31f6b4ba586 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:33.956753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be760b-0059-4cff-8607-b31f6b4ba586 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:33.956969 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-765c0b28-bfc3-4b44-b5d3-39c0fb5bc37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:33.957059 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be760b-0059-4cff-8607-b31f6b4ba586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:33.958433 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be760b-0059-4cff-8607-b31f6b4ba586 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:33.968745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 173/325] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:33.968745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be760b-0059-4cff-8607-b31f6b4ba586 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:34.032950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 153/326] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:51:34.032950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c0b28-bfc3-4b44-b5d3-39c0fb5bc37a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:34.061382 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:34.076312 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be760b-0059-4cff-8607-b31f6b4ba586 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:34.110714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e565907-76dc-4258-9d09-856a6621d3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:34.111544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e565907-76dc-4258-9d09-856a6621d3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:34.111826 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e565907-76dc-4258-9d09-856a6621d3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:34.112100 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e565907-76dc-4258-9d09-856a6621d3c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:34.122679 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e565907-76dc-4258-9d09-856a6621d3c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:34.130336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-6e565907-76dc-4258-9d09-856a6621d3c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:34.130336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:34.130336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:34.130336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:34.130336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:34.130336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:34.130336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:34.130336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:34.130336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:34.130336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:34.130336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:34.130336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:34.130336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:34.130336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:34.130336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:34.130336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:34.131248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:34.131248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:34.131248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:34.131248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:34.131248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:34.131248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:34.131248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:34.131248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:34.131248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:34.131248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:34.131248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:34.131248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:34.131248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:34.131248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:34.131248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:34.131248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:34.132025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:34.132025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:34.132025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:34.132025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:34.132025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:34.132025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:34.132025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:34.132025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:34.132025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:34.132025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:34.132025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:34.132025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:34.132630 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c0b28-bfc3-4b44-b5d3-39c0fb5bc37a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:34.132701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 174/327] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:34.132701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e565907-76dc-4258-9d09-856a6621d3c1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:34.135705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:34.166553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f4fea-c359-4fa0-b281-9754f8e3507d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:34.167533 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f4fea-c359-4fa0-b281-9754f8e3507d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:34.167818 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f4fea-c359-4fa0-b281-9754f8e3507d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:34.168090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f4fea-c359-4fa0-b281-9754f8e3507d None admin] PATH_INFO: `/v3/users/a7a06876dc6d4a7788b69fb675af9859` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:34.169338 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f4fea-c359-4fa0-b281-9754f8e3507d None admin] RBAC: Authorizing `identity:get_user(user_id=a7a06876dc6d4a7788b69fb675af9859)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:34.170794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f4fea-c359-4fa0-b281-9754f8e3507d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:34.172433 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 154/328] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:34 2022] GET /identity/v3/users/a7a06876dc6d4a7788b69fb675af9859 => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:34.173242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f4fea-c359-4fa0-b281-9754f8e3507d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:34.238323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e565907-76dc-4258-9d09-856a6621d3c1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:34.268976 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:34.272639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163028a-bbc4-468a-9d8c-3a0ff6b32ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:34.272954 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f4fea-c359-4fa0-b281-9754f8e3507d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:34.273474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163028a-bbc4-468a-9d8c-3a0ff6b32ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:34.273780 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163028a-bbc4-468a-9d8c-3a0ff6b32ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:34.274080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163028a-bbc4-468a-9d8c-3a0ff6b32ec1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:34.275250 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163028a-bbc4-468a-9d8c-3a0ff6b32ec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:34.276705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163028a-bbc4-468a-9d8c-3a0ff6b32ec1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:34.278350 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 175/329] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:34.283407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163028a-bbc4-468a-9d8c-3a0ff6b32ec1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:34.311187 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417f7b9-054a-42f9-b2d1-18ebd526a9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:34.311870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417f7b9-054a-42f9-b2d1-18ebd526a9b8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:34.312155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417f7b9-054a-42f9-b2d1-18ebd526a9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:34.312423 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417f7b9-054a-42f9-b2d1-18ebd526a9b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:34.313204 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417f7b9-054a-42f9-b2d1-18ebd526a9b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:34.313507 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417f7b9-054a-42f9-b2d1-18ebd526a9b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:34.314877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417f7b9-054a-42f9-b2d1-18ebd526a9b8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:34.323260 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 155/330] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:34.324038 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417f7b9-054a-42f9-b2d1-18ebd526a9b8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:34.349699 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:34.381227 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163028a-bbc4-468a-9d8c-3a0ff6b32ec1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:34.416486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b7c61-7f95-46aa-829f-057bd1e8c56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:34.417393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b7c61-7f95-46aa-829f-057bd1e8c56c None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:34.417668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b7c61-7f95-46aa-829f-057bd1e8c56c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:34.417937 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b7c61-7f95-46aa-829f-057bd1e8c56c None admin] PATH_INFO: `/v3/system/users/a7a06876dc6d4a7788b69fb675af9859/roles/86a8e86138e340409f4f8986321ed53d` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:34.419459 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b7c61-7f95-46aa-829f-057bd1e8c56c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a7a06876dc6d4a7788b69fb675af9859, role_id=86a8e86138e340409f4f8986321ed53d)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:34.420884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b7c61-7f95-46aa-829f-057bd1e8c56c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:34.424595 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417f7b9-054a-42f9-b2d1-18ebd526a9b8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:34.431288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 176/331] 10.222.0.18 () {58 vars in 1334 bytes} [Tue Jul 19 10:51:34 2022] PUT /identity/v3/system/users/a7a06876dc6d4a7788b69fb675af9859/roles/86a8e86138e340409f4f8986321ed53d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:51:34.432136 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b7c61-7f95-46aa-829f-057bd1e8c56c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:34.476005 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf962e1-c53a-42aa-b2cc-b56c71fe36a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:34.476919 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf962e1-c53a-42aa-b2cc-b56c71fe36a3 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:34.477202 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf962e1-c53a-42aa-b2cc-b56c71fe36a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:34.477480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf962e1-c53a-42aa-b2cc-b56c71fe36a3 None admin] PATH_INFO: `/v3/groups` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:34.478501 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf962e1-c53a-42aa-b2cc-b56c71fe36a3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:34.480036 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf962e1-c53a-42aa-b2cc-b56c71fe36a3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:34.508745 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 156/332] 10.222.0.18 () {60 vars in 1134 bytes} [Tue Jul 19 10:51:34 2022] POST /identity/v3/groups => generated 226 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:51:34.563051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b7c61-7f95-46aa-829f-057bd1e8c56c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:34.602041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964c386-c149-4d2e-b79f-da649defd1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:34.603301 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964c386-c149-4d2e-b79f-da649defd1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:34.603606 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964c386-c149-4d2e-b79f-da649defd1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:34.603850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964c386-c149-4d2e-b79f-da649defd1a5 None admin] PATH_INFO: `/v3/users/fd96582bf6ec49cfb5825b79bac7508f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:34.605133 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964c386-c149-4d2e-b79f-da649defd1a5 None admin] RBAC: Authorizing `identity:get_user(user_id=fd96582bf6ec49cfb5825b79bac7508f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:34.606657 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964c386-c149-4d2e-b79f-da649defd1a5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:34.608675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 177/333] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:34 2022] GET /identity/v3/users/fd96582bf6ec49cfb5825b79bac7508f => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:34.614394 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf962e1-c53a-42aa-b2cc-b56c71fe36a3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:34.639435 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:34.728748 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf962e1-c53a-42aa-b2cc-b56c71fe36a3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:34.766257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c00982-d903-4614-80ba-875a7597f167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:34.767017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c00982-d903-4614-80ba-875a7597f167 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:34.767194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c00982-d903-4614-80ba-875a7597f167 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:34.767466 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c00982-d903-4614-80ba-875a7597f167 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:34.768305 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c00982-d903-4614-80ba-875a7597f167 None admin] RBAC: Adding query filter params (role.id=6ff885694ad84e4cb935ef1c1f001858, user.id=fd96582bf6ec49cfb5825b79bac7508f, scope.system=all) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:34.768615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c00982-d903-4614-80ba-875a7597f167 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:34.770112 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c00982-d903-4614-80ba-875a7597f167 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:34.783141 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 157/334] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Jul 19 10:51:34 2022] GET /identity/v3/role_assignments?user.id=fd96582bf6ec49cfb5825b79bac7508f&scope.system=all&role.id=6ff885694ad84e4cb935ef1c1f001858 => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:36.617080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067cd85-262c-477b-a30f-cfdf7efc9a1f None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:36.618219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067cd85-262c-477b-a30f-cfdf7efc9a1f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:36.618719 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067cd85-262c-477b-a30f-cfdf7efc9a1f None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:36.620565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 178/335] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:51:36.626021 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4888f77-ff53-4c34-b75d-9d330b9126ab None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:36.626922 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4888f77-ff53-4c34-b75d-9d330b9126ab None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:36.627394 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4888f77-ff53-4c34-b75d-9d330b9126ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:36.650257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a4888f77-ff53-4c34-b75d-9d330b9126ab None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:36.651783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a4888f77-ff53-4c34-b75d-9d330b9126ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:36.735900 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 158/336] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:36.761336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067cd85-262c-477b-a30f-cfdf7efc9a1f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:36.765105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:36.917161 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067cd85-262c-477b-a30f-cfdf7efc9a1f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:36.961479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e4f06-6d5e-433b-8edc-1b93d629f246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:36.962294 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e4f06-6d5e-433b-8edc-1b93d629f246 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:36.962633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e4f06-6d5e-433b-8edc-1b93d629f246 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:36.962911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e4f06-6d5e-433b-8edc-1b93d629f246 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:36.979762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe836c-d57d-4c83-91f4-71b143714b35 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:36.980388 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe836c-d57d-4c83-91f4-71b143714b35 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:36.980854 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e4f06-6d5e-433b-8edc-1b93d629f246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:36.981128 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe836c-d57d-4c83-91f4-71b143714b35 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:36.982929 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 159/337] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:36.988485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59832ad-a943-4c4f-8e5b-5f81fb9223b8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:36.988727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-c52e4f06-6d5e-433b-8edc-1b93d629f246 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:51:36.988727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:36.988727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:36.988727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:36.988727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:36.988727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:36.988727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:36.988727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:36.988727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:36.988727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:36.988727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:36.988727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:36.988727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:36.988727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:36.988727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:36.988727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:36.989592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:36.989592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:36.989592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:36.989592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:36.989592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:36.989592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:36.989592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:36.989592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:36.989592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:36.989592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:36.989592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:36.989592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:36.989592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:36.989592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:36.989592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:36.989592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:36.990390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:36.990390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:36.990390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:36.990390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:36.990390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:36.990390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:36.990390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:36.990390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:36.990390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:36.990390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:36.990390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:51:36.990390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:36.990390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 179/338] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:36.991855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59832ad-a943-4c4f-8e5b-5f81fb9223b8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:36.992370 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59832ad-a943-4c4f-8e5b-5f81fb9223b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:36.995827 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e4f06-6d5e-433b-8edc-1b93d629f246 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:37.025770 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f59832ad-a943-4c4f-8e5b-5f81fb9223b8 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:37.027352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f59832ad-a943-4c4f-8e5b-5f81fb9223b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:37.055021 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:37.115853 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:37.151394 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 160/339] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 19 10:51:37.187275 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59832ad-a943-4c4f-8e5b-5f81fb9223b8 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:37.203704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e4f06-6d5e-433b-8edc-1b93d629f246 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:37.282885 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd0282-5b5d-4f6e-984c-763622ed2408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:37.283493 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd0282-5b5d-4f6e-984c-763622ed2408 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:37.283775 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd0282-5b5d-4f6e-984c-763622ed2408 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:37.284053 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd0282-5b5d-4f6e-984c-763622ed2408 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:37.284856 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd0282-5b5d-4f6e-984c-763622ed2408 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:37.285168 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd0282-5b5d-4f6e-984c-763622ed2408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:37.286647 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd0282-5b5d-4f6e-984c-763622ed2408 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:37.304257 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 180/340] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:37.309794 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd0282-5b5d-4f6e-984c-763622ed2408 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:37.396448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59832ad-a943-4c4f-8e5b-5f81fb9223b8 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:37.485155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd0282-5b5d-4f6e-984c-763622ed2408 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:37.498858 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236404ca-9b07-4525-b255-ccad2852c063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:37.499685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236404ca-9b07-4525-b255-ccad2852c063 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:37.499972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236404ca-9b07-4525-b255-ccad2852c063 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:37.500248 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236404ca-9b07-4525-b255-ccad2852c063 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:37.518974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:37.522527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:37.535008 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236404ca-9b07-4525-b255-ccad2852c063 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:37.540562 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044247d-14bf-4b84-92bd-209b92af3edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:37.541685 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044247d-14bf-4b84-92bd-209b92af3edb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:37.542126 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044247d-14bf-4b84-92bd-209b92af3edb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:37.542541 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044247d-14bf-4b84-92bd-209b92af3edb None admin] PATH_INFO: `/v3/users/a7a06876dc6d4a7788b69fb675af9859` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:37.545761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-236404ca-9b07-4525-b255-ccad2852c063 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:37.545761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:37.545761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:37.545761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:37.545761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:37.545761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:37.545761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:37.545761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:37.545761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:37.545761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:37.545761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:37.545761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:37.545761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:37.545761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:37.545761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:37.545761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:37.546849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:37.546849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:37.546849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:37.546849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:37.546849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:37.546849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:37.546849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:37.546849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:37.546849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:37.546849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:37.546849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:37.546849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:37.546849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:37.546849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:37.546849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:37.546849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:37.547806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:37.547806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:37.547806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:37.547806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:37.547806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:37.547806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:37.547806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:37.547806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:37.547806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:37.547806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:37.547806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:37.547806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:37.547806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 161/341] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:37.549498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044247d-14bf-4b84-92bd-209b92af3edb None admin] RBAC: Authorizing `identity:get_user(user_id=a7a06876dc6d4a7788b69fb675af9859)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:37.551107 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044247d-14bf-4b84-92bd-209b92af3edb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:37.553040 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 181/342] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:37 2022] GET /identity/v3/users/a7a06876dc6d4a7788b69fb675af9859 => generated 293 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:37.553412 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236404ca-9b07-4525-b255-ccad2852c063 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:37.558672 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044247d-14bf-4b84-92bd-209b92af3edb None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:37.733924 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044247d-14bf-4b84-92bd-209b92af3edb None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:37.763931 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236404ca-9b07-4525-b255-ccad2852c063 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:37.788289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe0d74-7de5-4f10-a801-0e80f38a6405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:37.789399 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe0d74-7de5-4f10-a801-0e80f38a6405 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:37.789895 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe0d74-7de5-4f10-a801-0e80f38a6405 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:37.790376 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe0d74-7de5-4f10-a801-0e80f38a6405 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:37.791586 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe0d74-7de5-4f10-a801-0e80f38a6405 None admin] RBAC: Adding query filter params (role.id=86a8e86138e340409f4f8986321ed53d, user.id=a7a06876dc6d4a7788b69fb675af9859, scope.system=all) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:37.792094 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe0d74-7de5-4f10-a801-0e80f38a6405 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:37.793883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe0d74-7de5-4f10-a801-0e80f38a6405 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:37.814242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 182/343] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Jul 19 10:51:37 2022] GET /identity/v3/role_assignments?user.id=a7a06876dc6d4a7788b69fb675af9859&scope.system=all&role.id=86a8e86138e340409f4f8986321ed53d => generated 510 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:37.815589 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fe76d-84a9-4e79-9b8d-a136b8d8f442 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:37.815875 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fe76d-84a9-4e79-9b8d-a136b8d8f442 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:37.816152 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fe76d-84a9-4e79-9b8d-a136b8d8f442 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:37.817490 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 183/344] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:37.826809 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0a0f6-cea2-4a8d-95f7-e88e48e761ba None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:37.827150 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0a0f6-cea2-4a8d-95f7-e88e48e761ba None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:37.827357 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0a0f6-cea2-4a8d-95f7-e88e48e761ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:37.832371 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46788eb-c315-497e-b2fa-0e94c5e979c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:37.833151 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46788eb-c315-497e-b2fa-0e94c5e979c6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:37.833439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46788eb-c315-497e-b2fa-0e94c5e979c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:37.833758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46788eb-c315-497e-b2fa-0e94c5e979c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:37.834536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46788eb-c315-497e-b2fa-0e94c5e979c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:37.834947 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46788eb-c315-497e-b2fa-0e94c5e979c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:37.836410 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46788eb-c315-497e-b2fa-0e94c5e979c6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:37.863594 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 162/345] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:37.868891 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46788eb-c315-497e-b2fa-0e94c5e979c6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:37.873566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a9e0a0f6-cea2-4a8d-95f7-e88e48e761ba None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:37.874995 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a9e0a0f6-cea2-4a8d-95f7-e88e48e761ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:37.973391 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:37.990419 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:38.036082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 184/346] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:38.038467 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46788eb-c315-497e-b2fa-0e94c5e979c6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:38.041404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131d8c0-e78d-4883-98b0-a41470c7ae84 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:38.041990 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131d8c0-e78d-4883-98b0-a41470c7ae84 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:38.042415 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131d8c0-e78d-4883-98b0-a41470c7ae84 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:38.044104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 185/347] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:38.050245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fafd2c-a443-4fbe-9954-dba6b51bc2ef None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:38.050809 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fafd2c-a443-4fbe-9954-dba6b51bc2ef None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:38.051284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fafd2c-a443-4fbe-9954-dba6b51bc2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:38.076517 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f1fafd2c-a443-4fbe-9954-dba6b51bc2ef None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:38.078132 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f1fafd2c-a443-4fbe-9954-dba6b51bc2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:38.107017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb41e41-fd83-4113-9234-2da167c7c428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:38.107672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb41e41-fd83-4113-9234-2da167c7c428 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:38.108008 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb41e41-fd83-4113-9234-2da167c7c428 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:38.108317 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb41e41-fd83-4113-9234-2da167c7c428 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:38.168369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 186/348] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:51:38.173806 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fafd2c-a443-4fbe-9954-dba6b51bc2ef None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:38.190342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb41e41-fd83-4113-9234-2da167c7c428 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:38.191883 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb41e41-fd83-4113-9234-2da167c7c428 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:38.262873 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:38.322571 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 163/349] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 10:51:38.322767 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fafd2c-a443-4fbe-9954-dba6b51bc2ef None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:38.323827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb41e41-fd83-4113-9234-2da167c7c428 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:38.341547 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:38.370244 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba91be3-8805-4a8b-a4e5-a6c109793725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:38.372245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba91be3-8805-4a8b-a4e5-a6c109793725 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:38.372671 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba91be3-8805-4a8b-a4e5-a6c109793725 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:38.373114 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba91be3-8805-4a8b-a4e5-a6c109793725 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:38.388450 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba91be3-8805-4a8b-a4e5-a6c109793725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:38.398936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-9ba91be3-8805-4a8b-a4e5-a6c109793725 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:38.398936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:38.398936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:38.398936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:38.398936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:38.398936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:38.398936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:38.398936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:38.398936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:38.398936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:38.398936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:38.398936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:38.398936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:38.398936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:38.398936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:38.398936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:38.400084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:38.400084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:38.400084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:38.400084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:38.400084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:38.400084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:38.400084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:38.400084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:38.400084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:38.400084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:38.400084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:38.400084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:38.400084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:38.400084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:38.400084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:38.400084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:38.401065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:38.401065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:38.401065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:38.401065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:38.401065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:38.401065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:38.401065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:38.401065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:38.401065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:38.401065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:38.401065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:38.401065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:38.404912 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 187/350] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 19 10:51:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:38.404912 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba91be3-8805-4a8b-a4e5-a6c109793725 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:38.474655 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb41e41-fd83-4113-9234-2da167c7c428 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:38.523784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf043e17-91c2-4004-a194-b754f09d893c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:38.525302 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf043e17-91c2-4004-a194-b754f09d893c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:38.526042 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf043e17-91c2-4004-a194-b754f09d893c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:38.526903 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf043e17-91c2-4004-a194-b754f09d893c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:38.542688 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf043e17-91c2-4004-a194-b754f09d893c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:38.543232 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba91be3-8805-4a8b-a4e5-a6c109793725 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:38.552999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-cf043e17-91c2-4004-a194-b754f09d893c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:38.552999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:38.552999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:38.552999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:38.552999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:38.552999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:38.552999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:38.552999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:38.552999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:38.552999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:38.552999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:38.552999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:38.552999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:38.552999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:38.552999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:38.552999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:38.553940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:38.553940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:38.553940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:38.553940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:38.553940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:38.553940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:38.553940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:38.553940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:38.553940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:38.553940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:38.553940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:38.553940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:38.553940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:38.553940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:38.553940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:38.553940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:38.559926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:38.559926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:38.559926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:38.559926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:38.559926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:38.559926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:38.559926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:38.559926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:38.559926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:38.559926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:38.559926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:38.559926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:38.559926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 164/351] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:38.559926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf043e17-91c2-4004-a194-b754f09d893c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:38.588493 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:38.592925 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445da49-a058-4044-ba18-b253266eae56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:38.594473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445da49-a058-4044-ba18-b253266eae56 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:38.595000 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445da49-a058-4044-ba18-b253266eae56 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:38.595503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445da49-a058-4044-ba18-b253266eae56 None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:38.596928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445da49-a058-4044-ba18-b253266eae56 None admin] RBAC: Authorizing `identity:get_project(project_id=4c9b1fef5ff14878b0fe811a533eb847)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:38.598619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445da49-a058-4044-ba18-b253266eae56 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:38.600663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 188/352] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:38 2022] GET /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:38.601773 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445da49-a058-4044-ba18-b253266eae56 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:38.645821 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:38.680162 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf043e17-91c2-4004-a194-b754f09d893c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:38.713461 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445da49-a058-4044-ba18-b253266eae56 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:38.717300 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459c30f-3f3c-44b1-80ab-225fae358dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:38.718054 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459c30f-3f3c-44b1-80ab-225fae358dbb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:38.718600 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459c30f-3f3c-44b1-80ab-225fae358dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:38.718960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459c30f-3f3c-44b1-80ab-225fae358dbb None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:38.719802 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459c30f-3f3c-44b1-80ab-225fae358dbb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:38.720156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459c30f-3f3c-44b1-80ab-225fae358dbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:38.721645 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459c30f-3f3c-44b1-80ab-225fae358dbb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:38.731473 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 165/353] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:51:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:38.732421 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459c30f-3f3c-44b1-80ab-225fae358dbb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:38.755582 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409d008-18aa-466e-bd5f-51521f7f0eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:38.756953 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409d008-18aa-466e-bd5f-51521f7f0eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:38.757474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409d008-18aa-466e-bd5f-51521f7f0eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:38.757958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409d008-18aa-466e-bd5f-51521f7f0eb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:38.758951 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409d008-18aa-466e-bd5f-51521f7f0eb0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:38.759447 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409d008-18aa-466e-bd5f-51521f7f0eb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:38.761101 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409d008-18aa-466e-bd5f-51521f7f0eb0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:38.770573 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 189/354] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:38.771882 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409d008-18aa-466e-bd5f-51521f7f0eb0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:38.826394 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:38.848275 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459c30f-3f3c-44b1-80ab-225fae358dbb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:38.876354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:38.880618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409d008-18aa-466e-bd5f-51521f7f0eb0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:38.889136 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba294bf-cd6a-4de3-9542-e6c759d4e056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:38.889897 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba294bf-cd6a-4de3-9542-e6c759d4e056 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:38.890244 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba294bf-cd6a-4de3-9542-e6c759d4e056 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:38.890584 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba294bf-cd6a-4de3-9542-e6c759d4e056 None admin] PATH_INFO: `/v3/groups/222813a3396d408e94ff1bbff1eba2e5` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:38.898014 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba294bf-cd6a-4de3-9542-e6c759d4e056 None admin] RBAC: Authorizing `identity:get_group(group_id=222813a3396d408e94ff1bbff1eba2e5)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:38.899515 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba294bf-cd6a-4de3-9542-e6c759d4e056 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:38.901964 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 166/355] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 19 10:51:38 2022] GET /identity/v3/groups/222813a3396d408e94ff1bbff1eba2e5 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:38.902834 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba294bf-cd6a-4de3-9542-e6c759d4e056 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:38.920961 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e72b1-77fd-4d9b-8d0b-2a092e3daff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:38.922020 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e72b1-77fd-4d9b-8d0b-2a092e3daff0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:38.922489 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e72b1-77fd-4d9b-8d0b-2a092e3daff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:38.922931 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e72b1-77fd-4d9b-8d0b-2a092e3daff0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:39.008128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e72b1-77fd-4d9b-8d0b-2a092e3daff0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:39.009912 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e72b1-77fd-4d9b-8d0b-2a092e3daff0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:39.052267 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba294bf-cd6a-4de3-9542-e6c759d4e056 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:39.104820 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b89233-b1a9-41ef-adfa-0f2df199ce03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:39.105516 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b89233-b1a9-41ef-adfa-0f2df199ce03 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:39.105868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b89233-b1a9-41ef-adfa-0f2df199ce03 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:39.106206 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b89233-b1a9-41ef-adfa-0f2df199ce03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:39.125737 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:39.163973 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:39.168740 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 190/356] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:39.170618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e72b1-77fd-4d9b-8d0b-2a092e3daff0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:39.207230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b89233-b1a9-41ef-adfa-0f2df199ce03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:39.209024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b89233-b1a9-41ef-adfa-0f2df199ce03 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:39.315242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e72b1-77fd-4d9b-8d0b-2a092e3daff0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:39.344007 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 167/357] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:39.348748 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e0fe4-9122-4e4f-99ec-68dc511d8db3 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:39.348748 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e0fe4-9122-4e4f-99ec-68dc511d8db3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:39.348748 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e0fe4-9122-4e4f-99ec-68dc511d8db3 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:39.348748 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 168/358] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:39.349672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159a98d-c064-48c0-8e6b-7a1b7e882bbd None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:39.349958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159a98d-c064-48c0-8e6b-7a1b7e882bbd None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:39.350296 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159a98d-c064-48c0-8e6b-7a1b7e882bbd None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:39.352544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 169/359] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:39.353966 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159a98d-c064-48c0-8e6b-7a1b7e882bbd None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:39.365770 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29080353-6bfd-4ffe-8b33-ff608c2793a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:39.366731 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29080353-6bfd-4ffe-8b33-ff608c2793a9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:39.367016 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29080353-6bfd-4ffe-8b33-ff608c2793a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:39.367356 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29080353-6bfd-4ffe-8b33-ff608c2793a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:39.368205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29080353-6bfd-4ffe-8b33-ff608c2793a9 None admin] RBAC: Adding query filter params (group.id=222813a3396d408e94ff1bbff1eba2e5, role.id=6ff885694ad84e4cb935ef1c1f001858, scope.project.id=4c9b1fef5ff14878b0fe811a533eb847) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:39.368942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29080353-6bfd-4ffe-8b33-ff608c2793a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:39.370596 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29080353-6bfd-4ffe-8b33-ff608c2793a9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:39.379429 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 191/360] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 19 10:51:39 2022] GET /identity/v3/role_assignments?group.id=222813a3396d408e94ff1bbff1eba2e5&scope.project.id=4c9b1fef5ff14878b0fe811a533eb847&role.id=6ff885694ad84e4cb935ef1c1f001858 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:39.379429 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aefc1a-3a39-4cc3-874b-93d2f19bd9cf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:39.379429 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aefc1a-3a39-4cc3-874b-93d2f19bd9cf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:39.379429 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aefc1a-3a39-4cc3-874b-93d2f19bd9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:39.408044 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f9aefc1a-3a39-4cc3-874b-93d2f19bd9cf None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:39.408044 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f9aefc1a-3a39-4cc3-874b-93d2f19bd9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:39.415327 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:39.504060 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159a98d-c064-48c0-8e6b-7a1b7e882bbd None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:39.506863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:39.517301 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 192/361] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:39.518442 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aefc1a-3a39-4cc3-874b-93d2f19bd9cf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:39.551349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb575ba-cbcc-4173-b24d-d9a330905953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:39.552248 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb575ba-cbcc-4173-b24d-d9a330905953 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:39.552671 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb575ba-cbcc-4173-b24d-d9a330905953 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:39.552999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb575ba-cbcc-4173-b24d-d9a330905953 None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:39.554842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb575ba-cbcc-4173-b24d-d9a330905953 None admin] RBAC: Authorizing `identity:get_project(project_id=4c9b1fef5ff14878b0fe811a533eb847)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:39.556499 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb575ba-cbcc-4173-b24d-d9a330905953 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:39.558978 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 170/362] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:39 2022] GET /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:39.561297 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd594d22-1285-4ff6-b8f3-8cd3e52597bd None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:39.561616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd594d22-1285-4ff6-b8f3-8cd3e52597bd None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:39.561919 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd594d22-1285-4ff6-b8f3-8cd3e52597bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:39.581521 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-dd594d22-1285-4ff6-b8f3-8cd3e52597bd None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:39.582741 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dd594d22-1285-4ff6-b8f3-8cd3e52597bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:39.645208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aefc1a-3a39-4cc3-874b-93d2f19bd9cf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:39.678219 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 171/363] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:39.680508 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd594d22-1285-4ff6-b8f3-8cd3e52597bd None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:39.690292 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef52978-4a85-4ed3-813e-f330b98d2359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:39.691545 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef52978-4a85-4ed3-813e-f330b98d2359 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:39.691986 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef52978-4a85-4ed3-813e-f330b98d2359 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:39.692412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef52978-4a85-4ed3-813e-f330b98d2359 None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:39.693919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef52978-4a85-4ed3-813e-f330b98d2359 None admin] RBAC: Authorizing `identity:get_project(project_id=5c8bef8162de48719c2febf3564c7269)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:39.695854 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef52978-4a85-4ed3-813e-f330b98d2359 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:39.697931 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 193/364] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:39 2022] GET /identity/v3/projects/5c8bef8162de48719c2febf3564c7269 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:39.698864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef52978-4a85-4ed3-813e-f330b98d2359 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:39.744702 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:39.786171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:39.819338 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd594d22-1285-4ff6-b8f3-8cd3e52597bd None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:39.845862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef52978-4a85-4ed3-813e-f330b98d2359 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:39.858668 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07487c0d-cf06-45f5-b2b4-d8ccf987c63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:39.859679 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07487c0d-cf06-45f5-b2b4-d8ccf987c63d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:39.859969 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07487c0d-cf06-45f5-b2b4-d8ccf987c63d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:39.860247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07487c0d-cf06-45f5-b2b4-d8ccf987c63d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:39.876911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07487c0d-cf06-45f5-b2b4-d8ccf987c63d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:39.884859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-07487c0d-cf06-45f5-b2b4-d8ccf987c63d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:39.884859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:39.884859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:39.884859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:39.884859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:39.884859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:39.884859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:39.884859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:39.884859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:39.884859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:39.884859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:39.884859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:39.884859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:39.884859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:39.884859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:39.884859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:39.885985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:39.885985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:39.885985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:39.885985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:39.885985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:39.885985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:39.885985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:39.885985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:39.885985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:39.885985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:39.885985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:39.885985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:39.885985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:39.885985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:39.885985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:39.885985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:39.886822 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:39.886822 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:39.886822 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:39.886822 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:39.886822 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:39.886822 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:39.886822 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:39.886822 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:39.886822 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:39.886822 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:39.886822 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:39.886822 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:39.888170 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 172/365] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 19 10:51:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:39.889445 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07487c0d-cf06-45f5-b2b4-d8ccf987c63d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:39.895037 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c5860-2f10-49e8-b5f0-8ba6460aa378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:39.896204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c5860-2f10-49e8-b5f0-8ba6460aa378 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:39.896426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c5860-2f10-49e8-b5f0-8ba6460aa378 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:39.896697 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c5860-2f10-49e8-b5f0-8ba6460aa378 None admin] PATH_INFO: `/v3/groups/222813a3396d408e94ff1bbff1eba2e5` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:39.897987 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c5860-2f10-49e8-b5f0-8ba6460aa378 None admin] RBAC: Authorizing `identity:get_group(group_id=222813a3396d408e94ff1bbff1eba2e5)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:39.900679 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c5860-2f10-49e8-b5f0-8ba6460aa378 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:39.902627 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 194/366] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 19 10:51:39 2022] GET /identity/v3/groups/222813a3396d408e94ff1bbff1eba2e5 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:39.903244 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c5860-2f10-49e8-b5f0-8ba6460aa378 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:40.007743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07487c0d-cf06-45f5-b2b4-d8ccf987c63d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:40.010776 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:40.036069 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c5860-2f10-49e8-b5f0-8ba6460aa378 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:40.056896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30202e11-bfc9-43bc-938e-f10ed05ea817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:40.057926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30202e11-bfc9-43bc-938e-f10ed05ea817 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:40.058211 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30202e11-bfc9-43bc-938e-f10ed05ea817 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:40.058487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30202e11-bfc9-43bc-938e-f10ed05ea817 None admin] PATH_INFO: `/v3/groups/222813a3396d408e94ff1bbff1eba2e5` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:40.059725 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30202e11-bfc9-43bc-938e-f10ed05ea817 None admin] RBAC: Authorizing `identity:get_group(group_id=222813a3396d408e94ff1bbff1eba2e5)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:40.061421 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30202e11-bfc9-43bc-938e-f10ed05ea817 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:40.063412 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 173/367] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 19 10:51:39 2022] GET /identity/v3/groups/222813a3396d408e94ff1bbff1eba2e5 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:40.064218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30202e11-bfc9-43bc-938e-f10ed05ea817 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:40.072781 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:40.080381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16142d-5d73-471b-8662-476dba742943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:40.081633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16142d-5d73-471b-8662-476dba742943 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:40.082060 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16142d-5d73-471b-8662-476dba742943 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:40.082495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16142d-5d73-471b-8662-476dba742943 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:40.095466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16142d-5d73-471b-8662-476dba742943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:40.104553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-4c16142d-5d73-471b-8662-476dba742943 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:40.104553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:40.104553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:40.104553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:40.104553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:40.104553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:40.104553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:40.104553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:40.104553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:40.104553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:40.104553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:40.104553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:40.104553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:40.104553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:40.104553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:40.104553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:40.105753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:40.105753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:40.105753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:40.105753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:40.105753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:40.105753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:40.105753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:40.105753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:40.105753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:40.105753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:40.105753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:40.105753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:40.105753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:40.105753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:40.105753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:40.105753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:40.106549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:40.106549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:40.106549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:40.106549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:40.106549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:40.106549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:40.106549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:40.106549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:40.106549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:40.106549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:40.106549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:40.106549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:40.109394 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 195/368] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:51:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:40.110507 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16142d-5d73-471b-8662-476dba742943 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:40.181684 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30202e11-bfc9-43bc-938e-f10ed05ea817 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:40.218940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22334b7-be10-4143-a439-4fb606e4ea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:40.219625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22334b7-be10-4143-a439-4fb606e4ea12 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:40.219911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22334b7-be10-4143-a439-4fb606e4ea12 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:40.220185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22334b7-be10-4143-a439-4fb606e4ea12 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:40.221440 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22334b7-be10-4143-a439-4fb606e4ea12 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:40.221746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22334b7-be10-4143-a439-4fb606e4ea12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:40.223651 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22334b7-be10-4143-a439-4fb606e4ea12 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:40.235051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 174/369] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:51:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:40.236229 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22334b7-be10-4143-a439-4fb606e4ea12 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:40.236504 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16142d-5d73-471b-8662-476dba742943 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:40.277894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5283e8-2672-4e1c-8ff8-ecd328127023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:40.278677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5283e8-2672-4e1c-8ff8-ecd328127023 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:40.278964 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5283e8-2672-4e1c-8ff8-ecd328127023 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:40.279240 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5283e8-2672-4e1c-8ff8-ecd328127023 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:40.280205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5283e8-2672-4e1c-8ff8-ecd328127023 None admin] RBAC: Adding query filter params (group.id=222813a3396d408e94ff1bbff1eba2e5, role.id=0a734da5c17d4cd39ea84b75878e55f1, scope.project.id=4c9b1fef5ff14878b0fe811a533eb847) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:40.280525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5283e8-2672-4e1c-8ff8-ecd328127023 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:40.282142 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5283e8-2672-4e1c-8ff8-ecd328127023 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:40.282686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:40.291436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 196/370] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 19 10:51:40 2022] GET /identity/v3/role_assignments?group.id=222813a3396d408e94ff1bbff1eba2e5&scope.project.id=4c9b1fef5ff14878b0fe811a533eb847&role.id=0a734da5c17d4cd39ea84b75878e55f1 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:40.292254 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5283e8-2672-4e1c-8ff8-ecd328127023 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:40.368034 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:40.433924 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22334b7-be10-4143-a439-4fb606e4ea12 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:40.453301 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5283e8-2672-4e1c-8ff8-ecd328127023 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:40.487658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393014d8-3763-4d78-a4db-4a62691c628c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:40.488340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393014d8-3763-4d78-a4db-4a62691c628c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:40.488621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393014d8-3763-4d78-a4db-4a62691c628c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:40.488925 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393014d8-3763-4d78-a4db-4a62691c628c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:40.490227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393014d8-3763-4d78-a4db-4a62691c628c None admin] RBAC: Adding query filter params (group.id=222813a3396d408e94ff1bbff1eba2e5, role.id=6ff885694ad84e4cb935ef1c1f001858, scope.project.id=5c8bef8162de48719c2febf3564c7269) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:40.490227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393014d8-3763-4d78-a4db-4a62691c628c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:40.492365 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393014d8-3763-4d78-a4db-4a62691c628c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:40.499143 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 175/371] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 19 10:51:40 2022] GET /identity/v3/role_assignments?group.id=222813a3396d408e94ff1bbff1eba2e5&scope.project.id=5c8bef8162de48719c2febf3564c7269&role.id=6ff885694ad84e4cb935ef1c1f001858 => generated 260 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:40.500276 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393014d8-3763-4d78-a4db-4a62691c628c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:40.510101 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257e6fa-8be1-492d-846b-a863df606d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:40.511238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257e6fa-8be1-492d-846b-a863df606d47 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:40.512354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257e6fa-8be1-492d-846b-a863df606d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:40.513022 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257e6fa-8be1-492d-846b-a863df606d47 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:40.514522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257e6fa-8be1-492d-846b-a863df606d47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:40.515055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257e6fa-8be1-492d-846b-a863df606d47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:40.517450 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257e6fa-8be1-492d-846b-a863df606d47 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:40.530464 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 197/372] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:40.542598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257e6fa-8be1-492d-846b-a863df606d47 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:40.700182 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:40.705681 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393014d8-3763-4d78-a4db-4a62691c628c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:40.757620 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257e6fa-8be1-492d-846b-a863df606d47 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:40.783498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758d7de-de2d-4ea0-b19d-515478142d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:40.784474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758d7de-de2d-4ea0-b19d-515478142d17 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:40.784957 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758d7de-de2d-4ea0-b19d-515478142d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:40.786104 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758d7de-de2d-4ea0-b19d-515478142d17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:40.803556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:40.838667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd52fc-45c4-42b9-a1c6-cbffc0d4f647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:40.841990 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd52fc-45c4-42b9-a1c6-cbffc0d4f647 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:40.842474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd52fc-45c4-42b9-a1c6-cbffc0d4f647 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:40.843002 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd52fc-45c4-42b9-a1c6-cbffc0d4f647 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:40.936600 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758d7de-de2d-4ea0-b19d-515478142d17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:40.938145 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758d7de-de2d-4ea0-b19d-515478142d17 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:40.981102 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd52fc-45c4-42b9-a1c6-cbffc0d4f647 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:40.982598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd52fc-45c4-42b9-a1c6-cbffc0d4f647 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:41.135207 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:41.140274 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 176/373] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:41.146779 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758d7de-de2d-4ea0-b19d-515478142d17 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:41.185398 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 198/374] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:41.201599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd52fc-45c4-42b9-a1c6-cbffc0d4f647 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:41.227571 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:41.368315 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758d7de-de2d-4ea0-b19d-515478142d17 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:41.415907 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd52fc-45c4-42b9-a1c6-cbffc0d4f647 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:41.439254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c95da-4460-4ec3-9397-51f9c4a42ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:41.440138 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c95da-4460-4ec3-9397-51f9c4a42ace None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:41.440459 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c95da-4460-4ec3-9397-51f9c4a42ace None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:41.440743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c95da-4460-4ec3-9397-51f9c4a42ace None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:41.442858 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c95da-4460-4ec3-9397-51f9c4a42ace None admin] RBAC: Authorizing `identity:get_project(project_id=5c8bef8162de48719c2febf3564c7269)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:41.446350 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c95da-4460-4ec3-9397-51f9c4a42ace None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:41.446350 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 177/375] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:41 2022] GET /identity/v3/projects/5c8bef8162de48719c2febf3564c7269 => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:41.452315 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c95da-4460-4ec3-9397-51f9c4a42ace None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:41.492856 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d7620-3baa-424e-b20d-79aa502b5a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:41.493740 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d7620-3baa-424e-b20d-79aa502b5a77 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:41.494015 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d7620-3baa-424e-b20d-79aa502b5a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:41.494283 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d7620-3baa-424e-b20d-79aa502b5a77 None admin] PATH_INFO: `/v3/projects/4f39c75cf6e84472a01d3e6114767933` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:41.496347 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d7620-3baa-424e-b20d-79aa502b5a77 None admin] RBAC: Authorizing `identity:get_project(project_id=4f39c75cf6e84472a01d3e6114767933)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:41.497882 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d7620-3baa-424e-b20d-79aa502b5a77 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:41.499618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 199/376] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:41 2022] GET /identity/v3/projects/4f39c75cf6e84472a01d3e6114767933 => generated 344 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:41.505175 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d7620-3baa-424e-b20d-79aa502b5a77 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:41.566703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:41.637040 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c95da-4460-4ec3-9397-51f9c4a42ace None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:41.667776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:41.701475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d7620-3baa-424e-b20d-79aa502b5a77 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:41.715840 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d0cc5-92cd-4a3e-90c0-9a0a1c0eeb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:41.716761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d0cc5-92cd-4a3e-90c0-9a0a1c0eeb94 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:41.717038 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d0cc5-92cd-4a3e-90c0-9a0a1c0eeb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:41.717322 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d0cc5-92cd-4a3e-90c0-9a0a1c0eeb94 None admin] PATH_INFO: `/v3/groups/222813a3396d408e94ff1bbff1eba2e5` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:41.720518 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d0cc5-92cd-4a3e-90c0-9a0a1c0eeb94 None admin] RBAC: Authorizing `identity:get_group(group_id=222813a3396d408e94ff1bbff1eba2e5)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:41.722102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d0cc5-92cd-4a3e-90c0-9a0a1c0eeb94 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:41.723956 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 178/377] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 19 10:51:41 2022] GET /identity/v3/groups/222813a3396d408e94ff1bbff1eba2e5 => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:41.737097 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d0cc5-92cd-4a3e-90c0-9a0a1c0eeb94 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:41.792108 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23fa9d-3491-4675-8c93-8f35989c3e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:41.793047 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23fa9d-3491-4675-8c93-8f35989c3e05 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:41.793329 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23fa9d-3491-4675-8c93-8f35989c3e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:41.793601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23fa9d-3491-4675-8c93-8f35989c3e05 None admin] PATH_INFO: `/v3/groups/4e535c2ee037488d9440de7a3df5fa67` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:41.810340 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23fa9d-3491-4675-8c93-8f35989c3e05 None admin] RBAC: Authorizing `identity:get_group(group_id=4e535c2ee037488d9440de7a3df5fa67)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:41.811824 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23fa9d-3491-4675-8c93-8f35989c3e05 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:41.813630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 200/378] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 19 10:51:41 2022] GET /identity/v3/groups/4e535c2ee037488d9440de7a3df5fa67 => generated 229 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:41.814921 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d729014-1b78-43a7-8df0-bff0078708b9 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:41.815201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d729014-1b78-43a7-8df0-bff0078708b9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:41.815473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d729014-1b78-43a7-8df0-bff0078708b9 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:41.819044 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 201/379] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:41.825306 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a81c6-ddf0-4395-9819-7a1ca40b2f13 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:41.825609 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a81c6-ddf0-4395-9819-7a1ca40b2f13 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:41.825859 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a81c6-ddf0-4395-9819-7a1ca40b2f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:41.861632 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-677a81c6-ddf0-4395-9819-7a1ca40b2f13 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:41.863512 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-677a81c6-ddf0-4395-9819-7a1ca40b2f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:41.907100 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d0cc5-92cd-4a3e-90c0-9a0a1c0eeb94 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:41.943533 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e3fb6-97d1-4db5-bb75-ee6e826821a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:41.944295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e3fb6-97d1-4db5-bb75-ee6e826821a2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:41.944484 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e3fb6-97d1-4db5-bb75-ee6e826821a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:41.944769 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e3fb6-97d1-4db5-bb75-ee6e826821a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:41.945664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e3fb6-97d1-4db5-bb75-ee6e826821a2 None admin] RBAC: Adding query filter params (group.id=222813a3396d408e94ff1bbff1eba2e5, role.id=0a734da5c17d4cd39ea84b75878e55f1, scope.project.id=5c8bef8162de48719c2febf3564c7269) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:41.945977 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e3fb6-97d1-4db5-bb75-ee6e826821a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:41.947508 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e3fb6-97d1-4db5-bb75-ee6e826821a2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:41.948836 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 202/380] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:41.950003 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a81c6-ddf0-4395-9819-7a1ca40b2f13 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:41.951921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:41.957746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 179/381] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 19 10:51:41 2022] GET /identity/v3/role_assignments?group.id=222813a3396d408e94ff1bbff1eba2e5&scope.project.id=5c8bef8162de48719c2febf3564c7269&role.id=0a734da5c17d4cd39ea84b75878e55f1 => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:41.985809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e3fb6-97d1-4db5-bb75-ee6e826821a2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:42.097308 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:42.138355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a81c6-ddf0-4395-9819-7a1ca40b2f13 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:42.194000 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e3fb6-97d1-4db5-bb75-ee6e826821a2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:42.206747 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68d84f-179d-4054-bc6a-1d02a7914d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:42.207866 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68d84f-179d-4054-bc6a-1d02a7914d2d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:42.208374 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68d84f-179d-4054-bc6a-1d02a7914d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:42.208906 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68d84f-179d-4054-bc6a-1d02a7914d2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:42.210543 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68d84f-179d-4054-bc6a-1d02a7914d2d None admin] RBAC: Adding query filter params (group.id=4e535c2ee037488d9440de7a3df5fa67, role.id=3f9528e7a7914797a4635aa6b536b7ff, scope.project.id=4f39c75cf6e84472a01d3e6114767933) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:42.211155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68d84f-179d-4054-bc6a-1d02a7914d2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:42.226010 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68d84f-179d-4054-bc6a-1d02a7914d2d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:42.244865 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 203/382] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 19 10:51:41 2022] GET /identity/v3/role_assignments?group.id=4e535c2ee037488d9440de7a3df5fa67&scope.project.id=4f39c75cf6e84472a01d3e6114767933&role.id=3f9528e7a7914797a4635aa6b536b7ff => generated 260 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:42.266706 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8fa72-867a-4e77-a707-5417337e0588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:42.267844 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8fa72-867a-4e77-a707-5417337e0588 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:42.268333 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8fa72-867a-4e77-a707-5417337e0588 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:42.268806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8fa72-867a-4e77-a707-5417337e0588 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:42.287690 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8fa72-867a-4e77-a707-5417337e0588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:42.298115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-fdc8fa72-867a-4e77-a707-5417337e0588 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:42.298115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:42.298115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:42.298115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:42.298115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:42.298115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:42.298115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:42.298115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:42.298115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:42.298115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:42.298115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:42.298115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:42.298115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:42.298115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:42.298115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:42.298115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:42.299049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:42.299049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:42.299049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:42.299049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:42.299049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:42.299049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:42.299049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:42.299049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:42.299049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:42.299049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:42.299049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:42.299049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:42.299049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:42.299049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:42.299049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:42.299049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:42.299841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:42.299841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:42.299841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:42.299841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:42.299841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:42.299841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:42.299841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:42.299841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:42.299841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:42.299841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:42.299841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:42.299841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:42.302304 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 180/383] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:42.311088 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68d84f-179d-4054-bc6a-1d02a7914d2d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:42.468073 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68d84f-179d-4054-bc6a-1d02a7914d2d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:42.517373 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602d73a-a825-46eb-8d52-05b55dfc950b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:42.518447 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602d73a-a825-46eb-8d52-05b55dfc950b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:42.518895 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602d73a-a825-46eb-8d52-05b55dfc950b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:42.519324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602d73a-a825-46eb-8d52-05b55dfc950b None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:42.520390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602d73a-a825-46eb-8d52-05b55dfc950b None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:42.521157 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602d73a-a825-46eb-8d52-05b55dfc950b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:42.523635 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602d73a-a825-46eb-8d52-05b55dfc950b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:42.538114 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 204/384] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:42.544096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8fa72-867a-4e77-a707-5417337e0588 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:42.655273 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:42.739385 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8fa72-867a-4e77-a707-5417337e0588 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:42.817999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa332f-4409-406d-abfc-dd5272c9d510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:42.819815 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa332f-4409-406d-abfc-dd5272c9d510 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:42.820552 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa332f-4409-406d-abfc-dd5272c9d510 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:42.821238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa332f-4409-406d-abfc-dd5272c9d510 None admin] PATH_INFO: `/v3/groups/222813a3396d408e94ff1bbff1eba2e5` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:42.823548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa332f-4409-406d-abfc-dd5272c9d510 None admin] RBAC: Authorizing `identity:get_group(group_id=222813a3396d408e94ff1bbff1eba2e5)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:42.826389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa332f-4409-406d-abfc-dd5272c9d510 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:42.833718 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 181/385] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 19 10:51:42 2022] GET /identity/v3/groups/222813a3396d408e94ff1bbff1eba2e5 => generated 226 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:42.840176 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602d73a-a825-46eb-8d52-05b55dfc950b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:42.847171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:42.892600 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b09a57-55ed-47e4-acf6-51cbd4428870 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:42.893636 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b09a57-55ed-47e4-acf6-51cbd4428870 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:42.894426 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b09a57-55ed-47e4-acf6-51cbd4428870 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:42.897844 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 182/386] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:42.907193 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09c885-f19a-4913-ae72-6fef6d7ffff1 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:42.908084 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09c885-f19a-4913-ae72-6fef6d7ffff1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:42.908898 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09c885-f19a-4913-ae72-6fef6d7ffff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:42.938103 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fa09c885-f19a-4913-ae72-6fef6d7ffff1 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:42.940927 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fa09c885-f19a-4913-ae72-6fef6d7ffff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:43.045112 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602d73a-a825-46eb-8d52-05b55dfc950b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:43.090254 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aa73f-a474-4422-bcee-efd810c9c3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:43.091146 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aa73f-a474-4422-bcee-efd810c9c3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:43.091430 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aa73f-a474-4422-bcee-efd810c9c3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:43.091684 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aa73f-a474-4422-bcee-efd810c9c3d2 None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:43.096613 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715aa73f-a474-4422-bcee-efd810c9c3d2 None admin] RBAC: Authorizing `identity:get_project(project_id=4c9b1fef5ff14878b0fe811a533eb847)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:43.098120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715aa73f-a474-4422-bcee-efd810c9c3d2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:43.100131 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 205/387] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:42 2022] GET /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:43.111536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 183/388] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:43.113777 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aa73f-a474-4422-bcee-efd810c9c3d2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:43.135547 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09c885-f19a-4913-ae72-6fef6d7ffff1 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:43.233910 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:43.239643 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:43.301916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aa73f-a474-4422-bcee-efd810c9c3d2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:43.319398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09c885-f19a-4913-ae72-6fef6d7ffff1 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:43.340232 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68677078-0312-4361-b712-f56ff4637f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:43.341416 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68677078-0312-4361-b712-f56ff4637f28 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:43.341860 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68677078-0312-4361-b712-f56ff4637f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:43.342271 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68677078-0312-4361-b712-f56ff4637f28 None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847/groups/222813a3396d408e94ff1bbff1eba2e5/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:43.344433 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68677078-0312-4361-b712-f56ff4637f28 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c9b1fef5ff14878b0fe811a533eb847, group_id=222813a3396d408e94ff1bbff1eba2e5, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:43.346073 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68677078-0312-4361-b712-f56ff4637f28 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:43.361881 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 206/389] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jul 19 10:51:43 2022] PUT /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847/groups/222813a3396d408e94ff1bbff1eba2e5/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:51:43.367046 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf1558-8e43-4400-bea4-d8355f9b6306 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:43.373324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf1558-8e43-4400-bea4-d8355f9b6306 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:43.373908 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf1558-8e43-4400-bea4-d8355f9b6306 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:43.375966 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 207/390] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:43 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:43.387630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b0f6a-6e8d-4707-bf5c-a7aff9871379 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:43.388146 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b0f6a-6e8d-4707-bf5c-a7aff9871379 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:43.388615 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b0f6a-6e8d-4707-bf5c-a7aff9871379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:43.407157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb36311-7981-4fbb-807a-f52f7d9334f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:43.408576 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb36311-7981-4fbb-807a-f52f7d9334f0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:43.409078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb36311-7981-4fbb-807a-f52f7d9334f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:43.409563 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb36311-7981-4fbb-807a-f52f7d9334f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:43.419083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fc4b0f6a-6e8d-4707-bf5c-a7aff9871379 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:43.420766 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fc4b0f6a-6e8d-4707-bf5c-a7aff9871379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:43.486305 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb36311-7981-4fbb-807a-f52f7d9334f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:43.501815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 208/391] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:51:43.506463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-deb36311-7981-4fbb-807a-f52f7d9334f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:43.506463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:43.506463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:43.506463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:43.506463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:43.506463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:43.506463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:43.506463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:43.506463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:43.506463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:43.506463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:43.506463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:43.506463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:43.506463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:43.506463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:43.506463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:43.507372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:43.507372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:43.507372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:43.507372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:43.507372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:43.507372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:43.507372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:43.507372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:43.507372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:43.507372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:43.507372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:43.507372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:43.507372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:43.507372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:43.507372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:43.507372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:43.508265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:43.508265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:43.508265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:43.508265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:43.508265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:43.508265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:43.508265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:43.508265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:43.508265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:43.508265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:43.508265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:43.508265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:43.511141 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 184/392] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 19 10:51:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:43.517424 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b0f6a-6e8d-4707-bf5c-a7aff9871379 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:43.579046 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb36311-7981-4fbb-807a-f52f7d9334f0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:43.593104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:43.639159 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b0f6a-6e8d-4707-bf5c-a7aff9871379 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:43.679296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5cab4-f970-4ecd-baa8-2ed3b46519b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:43.680696 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5cab4-f970-4ecd-baa8-2ed3b46519b1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:43.681265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5cab4-f970-4ecd-baa8-2ed3b46519b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:43.681741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5cab4-f970-4ecd-baa8-2ed3b46519b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:43.682761 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5cab4-f970-4ecd-baa8-2ed3b46519b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:43.683280 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5cab4-f970-4ecd-baa8-2ed3b46519b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:43.685085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5cab4-f970-4ecd-baa8-2ed3b46519b1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:43.694878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 209/393] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:51:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:43.701243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5cab4-f970-4ecd-baa8-2ed3b46519b1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:43.778034 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb36311-7981-4fbb-807a-f52f7d9334f0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:43.801647 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:43.815273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5cab4-f970-4ecd-baa8-2ed3b46519b1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:43.819087 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c9d23-8521-4d29-9193-2f9c71976452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:43.819398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c9d23-8521-4d29-9193-2f9c71976452 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:43.819769 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c9d23-8521-4d29-9193-2f9c71976452 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:43.820204 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c9d23-8521-4d29-9193-2f9c71976452 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:43.832744 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c9d23-8521-4d29-9193-2f9c71976452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:43.840991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-984c9d23-8521-4d29-9193-2f9c71976452 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:43.840991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:43.840991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:43.840991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:43.840991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:43.840991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:43.840991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:43.840991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:43.840991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:43.840991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:43.840991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:43.840991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:43.840991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:43.840991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:43.840991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:43.840991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:43.841926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:43.841926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:43.841926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:43.841926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:43.841926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:43.841926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:43.841926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:43.841926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:43.841926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:43.841926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:43.841926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:43.841926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:43.841926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:43.841926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:43.841926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:43.841926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:43.842727 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:43.842727 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:43.842727 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:43.842727 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:43.842727 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:43.842727 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:43.842727 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:43.842727 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:43.842727 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:43.842727 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:43.842727 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:43.842727 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:43.843328 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 185/394] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:43.846868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:43.854758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c9d23-8521-4d29-9193-2f9c71976452 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:43.862703 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53e413-8806-4505-a771-ea579b7b84c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:43.863886 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53e413-8806-4505-a771-ea579b7b84c0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:43.864371 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53e413-8806-4505-a771-ea579b7b84c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:43.864905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53e413-8806-4505-a771-ea579b7b84c0 None admin] PATH_INFO: `/v3/groups/222813a3396d408e94ff1bbff1eba2e5` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:43.866362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b53e413-8806-4505-a771-ea579b7b84c0 None admin] RBAC: Authorizing `identity:get_group(group_id=222813a3396d408e94ff1bbff1eba2e5)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:43.868130 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b53e413-8806-4505-a771-ea579b7b84c0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:43.870521 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 210/395] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 19 10:51:43 2022] GET /identity/v3/groups/222813a3396d408e94ff1bbff1eba2e5 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:43.876312 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53e413-8806-4505-a771-ea579b7b84c0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:44.000584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53e413-8806-4505-a771-ea579b7b84c0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:44.001331 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c9d23-8521-4d29-9193-2f9c71976452 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:44.043148 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd8ebc-7a31-4990-ac88-c525577ba0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:44.043851 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd8ebc-7a31-4990-ac88-c525577ba0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:44.044129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd8ebc-7a31-4990-ac88-c525577ba0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:44.044397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd8ebc-7a31-4990-ac88-c525577ba0f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:44.045181 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd8ebc-7a31-4990-ac88-c525577ba0f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:44.045483 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd8ebc-7a31-4990-ac88-c525577ba0f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:44.046865 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd8ebc-7a31-4990-ac88-c525577ba0f1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:44.068349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 186/396] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:44.069407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f24f06-c614-46ab-a2e6-e1e724aeb389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:44.070354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f24f06-c614-46ab-a2e6-e1e724aeb389 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:44.070630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f24f06-c614-46ab-a2e6-e1e724aeb389 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:44.070895 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f24f06-c614-46ab-a2e6-e1e724aeb389 None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:44.072123 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f24f06-c614-46ab-a2e6-e1e724aeb389 None admin] RBAC: Authorizing `identity:get_project(project_id=4c9b1fef5ff14878b0fe811a533eb847)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:44.073610 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f24f06-c614-46ab-a2e6-e1e724aeb389 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:44.076563 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd8ebc-7a31-4990-ac88-c525577ba0f1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:44.077404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 211/397] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:43 2022] GET /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:44.082232 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f24f06-c614-46ab-a2e6-e1e724aeb389 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:44.153420 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:44.222638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:44.231088 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd8ebc-7a31-4990-ac88-c525577ba0f1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:44.269892 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb223014-c3e6-43f1-acec-4c99550c6754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:44.270768 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb223014-c3e6-43f1-acec-4c99550c6754 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:44.271048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb223014-c3e6-43f1-acec-4c99550c6754 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:44.271315 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb223014-c3e6-43f1-acec-4c99550c6754 None admin] PATH_INFO: `/v3/groups/222813a3396d408e94ff1bbff1eba2e5` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:44.272512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb223014-c3e6-43f1-acec-4c99550c6754 None admin] RBAC: Authorizing `identity:get_group(group_id=222813a3396d408e94ff1bbff1eba2e5)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:44.274055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb223014-c3e6-43f1-acec-4c99550c6754 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:44.276010 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 187/398] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 19 10:51:44 2022] GET /identity/v3/groups/222813a3396d408e94ff1bbff1eba2e5 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:44.284143 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb223014-c3e6-43f1-acec-4c99550c6754 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:44.310687 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f24f06-c614-46ab-a2e6-e1e724aeb389 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:44.382426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7275c-4551-4caa-a092-3d04741f5f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:44.383408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7275c-4551-4caa-a092-3d04741f5f3b None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:44.383692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7275c-4551-4caa-a092-3d04741f5f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:44.383967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7275c-4551-4caa-a092-3d04741f5f3b None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847/groups/222813a3396d408e94ff1bbff1eba2e5/roles/0a734da5c17d4cd39ea84b75878e55f1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:44.390727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7275c-4551-4caa-a092-3d04741f5f3b None admin] RBAC: Authorizing `identity:create_grant(project_id=4c9b1fef5ff14878b0fe811a533eb847, group_id=222813a3396d408e94ff1bbff1eba2e5, role_id=0a734da5c17d4cd39ea84b75878e55f1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:44.392193 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7275c-4551-4caa-a092-3d04741f5f3b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:44.392742 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb223014-c3e6-43f1-acec-4c99550c6754 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:44.402352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:44.435384 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 212/399] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jul 19 10:51:44 2022] PUT /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847/groups/222813a3396d408e94ff1bbff1eba2e5/roles/0a734da5c17d4cd39ea84b75878e55f1 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:51:44.436481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4079ef-af72-40d2-880e-6cf9f64e8e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:44.437547 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4079ef-af72-40d2-880e-6cf9f64e8e86 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:44.437982 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4079ef-af72-40d2-880e-6cf9f64e8e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:44.438403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4079ef-af72-40d2-880e-6cf9f64e8e86 None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:44.439914 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4079ef-af72-40d2-880e-6cf9f64e8e86 None admin] RBAC: Authorizing `identity:get_project(project_id=5c8bef8162de48719c2febf3564c7269)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:44.441877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4079ef-af72-40d2-880e-6cf9f64e8e86 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:44.444386 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 188/400] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:44 2022] GET /identity/v3/projects/5c8bef8162de48719c2febf3564c7269 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:44.453448 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7275c-4551-4caa-a092-3d04741f5f3b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:44.627428 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7275c-4551-4caa-a092-3d04741f5f3b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:44.664094 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:44.690506 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cd1bc-369d-4db3-b81e-ccf0f2558666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:44.692046 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cd1bc-369d-4db3-b81e-ccf0f2558666 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:44.692544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cd1bc-369d-4db3-b81e-ccf0f2558666 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:44.693037 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cd1bc-369d-4db3-b81e-ccf0f2558666 None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269/groups/222813a3396d408e94ff1bbff1eba2e5/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:44.696807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cd1bc-369d-4db3-b81e-ccf0f2558666 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c8bef8162de48719c2febf3564c7269, group_id=222813a3396d408e94ff1bbff1eba2e5, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:44.699361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb992f8-2d09-4f53-9cbf-153edccae0ed None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:44.699562 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cd1bc-369d-4db3-b81e-ccf0f2558666 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:44.700044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb992f8-2d09-4f53-9cbf-153edccae0ed None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:44.700505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb992f8-2d09-4f53-9cbf-153edccae0ed None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:44.702510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 189/401] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:44.708665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee97fe-5beb-407c-8ce2-b8985ab1832d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:44.709321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee97fe-5beb-407c-8ce2-b8985ab1832d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:44.709805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee97fe-5beb-407c-8ce2-b8985ab1832d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:44.731254 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 213/402] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jul 19 10:51:44 2022] PUT /identity/v3/projects/5c8bef8162de48719c2febf3564c7269/groups/222813a3396d408e94ff1bbff1eba2e5/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:51:44.744024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-43ee97fe-5beb-407c-8ce2-b8985ab1832d None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:44.745647 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-43ee97fe-5beb-407c-8ce2-b8985ab1832d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:44.832923 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 190/403] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:44.869189 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cd1bc-369d-4db3-b81e-ccf0f2558666 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:45.083434 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cd1bc-369d-4db3-b81e-ccf0f2558666 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:45.153274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077fc82-3656-4fa2-abfc-1640f287ba7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:45.154119 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077fc82-3656-4fa2-abfc-1640f287ba7b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:45.154397 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077fc82-3656-4fa2-abfc-1640f287ba7b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:45.154666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077fc82-3656-4fa2-abfc-1640f287ba7b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:45.169931 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077fc82-3656-4fa2-abfc-1640f287ba7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:45.178127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-4077fc82-3656-4fa2-abfc-1640f287ba7b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:45.178127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:45.178127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:45.178127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:45.178127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:45.178127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:45.178127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:45.178127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:45.178127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:45.178127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:45.178127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:45.178127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:45.178127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:45.178127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:45.178127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:45.178127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:45.179083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:45.179083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:45.179083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:45.179083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:45.179083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:45.179083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:45.179083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:45.179083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:45.179083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:45.179083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:45.179083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:45.179083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:45.179083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:45.179083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:45.179083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:45.179083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:45.179914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:45.179914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:45.179914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:45.179914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:45.179914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:45.179914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:45.179914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:45.179914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:45.179914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:45.179914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:45.179914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:45.179914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:45.179914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 214/404] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 19 10:51:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:45.186284 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee97fe-5beb-407c-8ce2-b8985ab1832d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:45.451124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aa9db-fdfd-4d6c-9392-9d0206f160eb None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:45.451402 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aa9db-fdfd-4d6c-9392-9d0206f160eb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:45.451751 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aa9db-fdfd-4d6c-9392-9d0206f160eb None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:45.455124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 215/405] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:51:45.463281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696339c-182e-4210-a915-59f11c463829 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:45.464130 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696339c-182e-4210-a915-59f11c463829 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:45.464939 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696339c-182e-4210-a915-59f11c463829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:45.467800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee97fe-5beb-407c-8ce2-b8985ab1832d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:45.471282 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:45.506528 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8696339c-182e-4210-a915-59f11c463829 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:45.507837 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8696339c-182e-4210-a915-59f11c463829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:45.527979 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17df49-8ab9-41cd-9e88-03fe41fb8368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:45.528664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17df49-8ab9-41cd-9e88-03fe41fb8368 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:45.528980 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17df49-8ab9-41cd-9e88-03fe41fb8368 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:45.529252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17df49-8ab9-41cd-9e88-03fe41fb8368 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:45.530005 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17df49-8ab9-41cd-9e88-03fe41fb8368 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:45.530311 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17df49-8ab9-41cd-9e88-03fe41fb8368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:45.531720 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17df49-8ab9-41cd-9e88-03fe41fb8368 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:45.541116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 191/406] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:51:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:45.546641 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17df49-8ab9-41cd-9e88-03fe41fb8368 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:45.620074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:45.701143 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 216/407] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:45.745988 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696339c-182e-4210-a915-59f11c463829 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:45.796913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17df49-8ab9-41cd-9e88-03fe41fb8368 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:45.874394 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f1800-cc2c-491e-9d5b-bf6b0070de32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:45.876302 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f1800-cc2c-491e-9d5b-bf6b0070de32 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:45.877161 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f1800-cc2c-491e-9d5b-bf6b0070de32 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:45.880703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f1800-cc2c-491e-9d5b-bf6b0070de32 None admin] PATH_INFO: `/v3/groups/222813a3396d408e94ff1bbff1eba2e5` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:45.888107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f1800-cc2c-491e-9d5b-bf6b0070de32 None admin] RBAC: Authorizing `identity:get_group(group_id=222813a3396d408e94ff1bbff1eba2e5)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:45.892676 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f1800-cc2c-491e-9d5b-bf6b0070de32 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:45.896400 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 192/408] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 19 10:51:45 2022] GET /identity/v3/groups/222813a3396d408e94ff1bbff1eba2e5 => generated 226 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:45.906491 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f1800-cc2c-491e-9d5b-bf6b0070de32 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:45.983937 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:46.004592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696339c-182e-4210-a915-59f11c463829 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:46.116061 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2330418-d8c2-453e-9e1c-fd55c10460d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:46.117506 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2330418-d8c2-453e-9e1c-fd55c10460d2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:46.117986 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2330418-d8c2-453e-9e1c-fd55c10460d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:46.118454 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2330418-d8c2-453e-9e1c-fd55c10460d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:46.152516 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2330418-d8c2-453e-9e1c-fd55c10460d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:46.171201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-f2330418-d8c2-453e-9e1c-fd55c10460d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:46.171201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:46.171201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:46.171201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:46.171201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:46.171201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:46.171201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:46.171201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:46.171201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:46.171201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:46.171201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:46.171201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:46.171201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:46.171201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:46.171201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:46.171201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:46.173075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:46.173075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:46.173075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:46.173075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:46.173075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:46.173075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:46.173075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:46.173075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:46.173075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:46.173075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:46.173075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:46.173075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:46.173075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:46.173075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:46.173075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:46.173075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:46.174704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:46.174704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:46.174704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:46.174704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:46.174704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:46.174704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:46.174704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:46.174704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:46.174704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:46.174704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:46.174704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:46.174704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:46.180847 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 217/409] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:51:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:46.186518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2330418-d8c2-453e-9e1c-fd55c10460d2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:46.200394 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f1800-cc2c-491e-9d5b-bf6b0070de32 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:46.248548 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:46.353570 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab356800-05ad-4d2f-aa2d-a580a833423e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:46.355080 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab356800-05ad-4d2f-aa2d-a580a833423e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:46.355080 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab356800-05ad-4d2f-aa2d-a580a833423e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:46.355080 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab356800-05ad-4d2f-aa2d-a580a833423e None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:46.356439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab356800-05ad-4d2f-aa2d-a580a833423e None admin] RBAC: Authorizing `identity:get_project(project_id=5c8bef8162de48719c2febf3564c7269)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:46.357984 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab356800-05ad-4d2f-aa2d-a580a833423e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:46.361307 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 193/410] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:45 2022] GET /identity/v3/projects/5c8bef8162de48719c2febf3564c7269 => generated 302 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:46.369539 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab356800-05ad-4d2f-aa2d-a580a833423e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:46.393576 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2330418-d8c2-453e-9e1c-fd55c10460d2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:46.553738 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898bea5-f219-408d-8767-8604df1432f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:46.555174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898bea5-f219-408d-8767-8604df1432f2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:46.555648 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898bea5-f219-408d-8767-8604df1432f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:46.556094 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898bea5-f219-408d-8767-8604df1432f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:46.557451 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898bea5-f219-408d-8767-8604df1432f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:46.558310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898bea5-f219-408d-8767-8604df1432f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:46.561740 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898bea5-f219-408d-8767-8604df1432f2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:46.582273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 218/411] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:46.585091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9da148-cdf1-4c1b-8dee-dbd86e8322c5 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:46.585624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9da148-cdf1-4c1b-8dee-dbd86e8322c5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:46.586097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9da148-cdf1-4c1b-8dee-dbd86e8322c5 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:46.589043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 219/412] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:46.594299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9da148-cdf1-4c1b-8dee-dbd86e8322c5 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:46.609778 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab356800-05ad-4d2f-aa2d-a580a833423e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:46.613170 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:46.695619 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01df62-8627-43db-b069-3ffb5ef28918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:46.697241 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01df62-8627-43db-b069-3ffb5ef28918 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:46.697738 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01df62-8627-43db-b069-3ffb5ef28918 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:46.698228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01df62-8627-43db-b069-3ffb5ef28918 None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269/groups/222813a3396d408e94ff1bbff1eba2e5/roles/0a734da5c17d4cd39ea84b75878e55f1` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:46.702212 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01df62-8627-43db-b069-3ffb5ef28918 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c8bef8162de48719c2febf3564c7269, group_id=222813a3396d408e94ff1bbff1eba2e5, role_id=0a734da5c17d4cd39ea84b75878e55f1)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:46.704995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01df62-8627-43db-b069-3ffb5ef28918 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:46.740553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 194/413] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jul 19 10:51:46 2022] PUT /identity/v3/projects/5c8bef8162de48719c2febf3564c7269/groups/222813a3396d408e94ff1bbff1eba2e5/roles/0a734da5c17d4cd39ea84b75878e55f1 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 10:51:46.743240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ed8ae-7f77-43a7-ab73-d47d31454726 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:46.743737 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ed8ae-7f77-43a7-ab73-d47d31454726 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:46.744184 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ed8ae-7f77-43a7-ab73-d47d31454726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:46.800037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-da1ed8ae-7f77-43a7-ab73-d47d31454726 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:46.802186 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-da1ed8ae-7f77-43a7-ab73-d47d31454726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:46.850414 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:46.888927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9da148-cdf1-4c1b-8dee-dbd86e8322c5 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:46.991736 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 195/414] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:47.011706 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e8b5a-7b69-4668-a136-db08960650cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:47.013230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e8b5a-7b69-4668-a136-db08960650cb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:47.013711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e8b5a-7b69-4668-a136-db08960650cb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:47.014189 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e8b5a-7b69-4668-a136-db08960650cb None admin] PATH_INFO: `/v3/groups/4e535c2ee037488d9440de7a3df5fa67` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:47.016369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e8b5a-7b69-4668-a136-db08960650cb None admin] RBAC: Authorizing `identity:get_group(group_id=4e535c2ee037488d9440de7a3df5fa67)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:47.019054 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e8b5a-7b69-4668-a136-db08960650cb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:47.027304 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 220/415] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 19 10:51:46 2022] GET /identity/v3/groups/4e535c2ee037488d9440de7a3df5fa67 => generated 229 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:47.033410 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ed8ae-7f77-43a7-ab73-d47d31454726 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:47.036411 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e8b5a-7b69-4668-a136-db08960650cb None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:47.216233 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:47.236874 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e8b5a-7b69-4668-a136-db08960650cb None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:47.240084 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ed8ae-7f77-43a7-ab73-d47d31454726 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:47.305880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262779e-c3c7-437e-b152-54630368db91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:47.307432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262779e-c3c7-437e-b152-54630368db91 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:47.307915 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262779e-c3c7-437e-b152-54630368db91 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:47.308409 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262779e-c3c7-437e-b152-54630368db91 None admin] PATH_INFO: `/v3/projects/4f39c75cf6e84472a01d3e6114767933` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:47.310667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262779e-c3c7-437e-b152-54630368db91 None admin] RBAC: Authorizing `identity:get_project(project_id=4f39c75cf6e84472a01d3e6114767933)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:47.312551 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfdf09-9f45-4e3d-b8f2-892d20ff9ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:47.313484 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262779e-c3c7-437e-b152-54630368db91 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:47.314445 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfdf09-9f45-4e3d-b8f2-892d20ff9ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:47.315148 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfdf09-9f45-4e3d-b8f2-892d20ff9ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:47.315824 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfdf09-9f45-4e3d-b8f2-892d20ff9ee1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:47.317278 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 221/416] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:47 2022] GET /identity/v3/projects/4f39c75cf6e84472a01d3e6114767933 => generated 344 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:47.327016 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262779e-c3c7-437e-b152-54630368db91 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:47.338417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfdf09-9f45-4e3d-b8f2-892d20ff9ee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:47.354349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-c0dfdf09-9f45-4e3d-b8f2-892d20ff9ee1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:47.354349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:47.354349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:47.354349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:47.354349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:47.354349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:47.354349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:47.354349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:47.354349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:47.354349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:47.354349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:47.354349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:47.354349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:47.354349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:47.354349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:47.354349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:47.356238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:47.356238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:47.356238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:47.356238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:47.356238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:47.356238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:47.356238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:47.356238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:47.356238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:47.356238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:47.356238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:47.356238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:47.356238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:47.356238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:47.356238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:47.356238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:47.358052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:47.358052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:47.358052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:47.358052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:47.358052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:47.358052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:47.358052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:47.358052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:47.358052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:47.358052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:47.358052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:47.358052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:47.362309 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 196/417] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:47.371800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfdf09-9f45-4e3d-b8f2-892d20ff9ee1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:47.383865 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:47.468971 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262779e-c3c7-437e-b152-54630368db91 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:47.508193 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee0a2d-6b30-4d12-b975-2ac951be54d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:47.509383 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee0a2d-6b30-4d12-b975-2ac951be54d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:47.509832 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee0a2d-6b30-4d12-b975-2ac951be54d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:47.510233 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee0a2d-6b30-4d12-b975-2ac951be54d9 None admin] PATH_INFO: `/v3/projects/4f39c75cf6e84472a01d3e6114767933/groups/4e535c2ee037488d9440de7a3df5fa67/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:47.512524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee0a2d-6b30-4d12-b975-2ac951be54d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f39c75cf6e84472a01d3e6114767933, group_id=4e535c2ee037488d9440de7a3df5fa67, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:47.514188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee0a2d-6b30-4d12-b975-2ac951be54d9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:47.537722 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 222/418] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jul 19 10:51:47 2022] PUT /identity/v3/projects/4f39c75cf6e84472a01d3e6114767933/groups/4e535c2ee037488d9440de7a3df5fa67/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:51:47.605889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfdf09-9f45-4e3d-b8f2-892d20ff9ee1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:47.651436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fe024-2994-4e7c-989b-5b08a6689682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:47.652540 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fe024-2994-4e7c-989b-5b08a6689682 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:47.653051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fe024-2994-4e7c-989b-5b08a6689682 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:47.653555 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fe024-2994-4e7c-989b-5b08a6689682 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:47.654582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fe024-2994-4e7c-989b-5b08a6689682 None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:47.655137 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fe024-2994-4e7c-989b-5b08a6689682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:47.656908 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fe024-2994-4e7c-989b-5b08a6689682 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:47.661032 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8b4d6-e319-4bce-9f5e-4b8e93f2c3da None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:47.662430 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8b4d6-e319-4bce-9f5e-4b8e93f2c3da None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:47.662971 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8b4d6-e319-4bce-9f5e-4b8e93f2c3da None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:47.667956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 223/419] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:51:47.674828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f82f3-f9fc-45c6-b511-d117511b6d71 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:47.675154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f82f3-f9fc-45c6-b511-d117511b6d71 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:47.675520 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f82f3-f9fc-45c6-b511-d117511b6d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:47.677014 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 197/420] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:47.685075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fe024-2994-4e7c-989b-5b08a6689682 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:47.713392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-458f82f3-f9fc-45c6-b511-d117511b6d71 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:47.714988 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-458f82f3-f9fc-45c6-b511-d117511b6d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:47.733345 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:47.897408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 224/421] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:51:47.921697 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f82f3-f9fc-45c6-b511-d117511b6d71 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:47.935407 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fe024-2994-4e7c-989b-5b08a6689682 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:47.945060 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:48.039734 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f468a-28db-4210-ab59-a26e3ba8baf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:48.040662 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f468a-28db-4210-ab59-a26e3ba8baf9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:48.042885 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f468a-28db-4210-ab59-a26e3ba8baf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:48.043327 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f468a-28db-4210-ab59-a26e3ba8baf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:48.128922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f82f3-f9fc-45c6-b511-d117511b6d71 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:48.135669 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f468a-28db-4210-ab59-a26e3ba8baf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:48.137991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f468a-28db-4210-ab59-a26e3ba8baf9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:48.159199 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:48.167862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b63de-571d-405a-9157-0acef472f34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:48.168814 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b63de-571d-405a-9157-0acef472f34a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:48.169705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b63de-571d-405a-9157-0acef472f34a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:48.169705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b63de-571d-405a-9157-0acef472f34a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:48.186289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b63de-571d-405a-9157-0acef472f34a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:48.194382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-442b63de-571d-405a-9157-0acef472f34a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:48.194382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:48.194382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:48.194382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:48.194382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:48.194382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:48.194382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:48.194382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:48.194382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:48.194382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:48.194382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:48.194382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:48.194382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:48.194382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:48.194382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:48.194382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:48.195663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:48.195663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:48.195663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:48.195663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:48.195663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:48.195663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:48.195663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:48.195663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:48.195663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:48.195663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:48.195663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:48.195663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:48.195663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:48.195663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:48.195663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:48.195663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:48.196842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:48.196842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:48.196842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:48.196842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:48.196842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:48.196842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:48.196842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:48.196842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:48.196842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:48.196842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:48.196842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:48.196842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:48.203205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 225/422] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:48.203205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845fff9-c00c-4462-808e-0c36120ce023 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:48.203205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845fff9-c00c-4462-808e-0c36120ce023 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:48.203205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845fff9-c00c-4462-808e-0c36120ce023 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:48.206356 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 226/423] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:48.207892 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a4ce4-9e0c-4cd7-b144-e176dc9f0e33 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:48.208178 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a4ce4-9e0c-4cd7-b144-e176dc9f0e33 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:48.208455 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a4ce4-9e0c-4cd7-b144-e176dc9f0e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:48.227704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9c1a4ce4-9e0c-4cd7-b144-e176dc9f0e33 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:48.229187 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9c1a4ce4-9e0c-4cd7-b144-e176dc9f0e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:48.295130 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 198/424] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:48.296947 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f468a-28db-4210-ab59-a26e3ba8baf9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:48.314067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 227/425] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:48.314852 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a4ce4-9e0c-4cd7-b144-e176dc9f0e33 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:48.337370 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:48.421178 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f468a-28db-4210-ab59-a26e3ba8baf9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:48.450498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:48.474112 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a4ce4-9e0c-4cd7-b144-e176dc9f0e33 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:48.474533 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb25c7b-d6f0-498c-890c-a5ee0bebf670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:48.475433 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb25c7b-d6f0-498c-890c-a5ee0bebf670 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:48.475911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb25c7b-d6f0-498c-890c-a5ee0bebf670 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:48.476495 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb25c7b-d6f0-498c-890c-a5ee0bebf670 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:48.477810 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb25c7b-d6f0-498c-890c-a5ee0bebf670 None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:48.478321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb25c7b-d6f0-498c-890c-a5ee0bebf670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:48.479915 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb25c7b-d6f0-498c-890c-a5ee0bebf670 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:48.489408 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 199/426] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:48.490610 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb25c7b-d6f0-498c-890c-a5ee0bebf670 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:48.510749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839dbe2-3256-444a-8ac7-bbd542ae588c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:48.511628 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839dbe2-3256-444a-8ac7-bbd542ae588c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:48.511909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839dbe2-3256-444a-8ac7-bbd542ae588c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:48.512177 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839dbe2-3256-444a-8ac7-bbd542ae588c None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:48.513404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839dbe2-3256-444a-8ac7-bbd542ae588c None admin] RBAC: Authorizing `identity:get_project(project_id=4c9b1fef5ff14878b0fe811a533eb847)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:48.514904 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839dbe2-3256-444a-8ac7-bbd542ae588c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:48.517199 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 228/427] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:48 2022] GET /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:48.517789 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839dbe2-3256-444a-8ac7-bbd542ae588c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:48.602701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb25c7b-d6f0-498c-890c-a5ee0bebf670 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:48.613295 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:48.622344 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839dbe2-3256-444a-8ac7-bbd542ae588c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:48.639908 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477743a-dac2-44a6-bc65-a15b1154a5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:48.641123 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477743a-dac2-44a6-bc65-a15b1154a5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:48.641609 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477743a-dac2-44a6-bc65-a15b1154a5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:48.642082 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477743a-dac2-44a6-bc65-a15b1154a5c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:48.653445 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477743a-dac2-44a6-bc65-a15b1154a5c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:48.658299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be016fd-8e91-47c7-805b-a86a6f64207a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:48.658959 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be016fd-8e91-47c7-805b-a86a6f64207a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:48.659232 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be016fd-8e91-47c7-805b-a86a6f64207a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:48.659500 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be016fd-8e91-47c7-805b-a86a6f64207a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:48.662879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-6477743a-dac2-44a6-bc65-a15b1154a5c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:48.662879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:48.662879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:48.662879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:48.662879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:48.662879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:48.662879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:48.662879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:48.662879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:48.662879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:48.662879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:48.662879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:48.662879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:48.662879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:48.662879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:48.662879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:48.663774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:48.663774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:48.663774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:48.663774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:48.663774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:48.663774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:48.663774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:48.663774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:48.663774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:48.663774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:48.663774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:48.663774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:48.663774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:48.663774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:48.663774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:48.663774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:48.664626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:48.664626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:48.664626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:48.664626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:48.664626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:48.664626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:48.664626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:48.664626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:48.664626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:48.664626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:48.664626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:48.664626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:48.667561 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 200/428] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 19 10:51:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:48.668674 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477743a-dac2-44a6-bc65-a15b1154a5c5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:48.712122 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:48.737146 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be016fd-8e91-47c7-805b-a86a6f64207a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:48.738633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be016fd-8e91-47c7-805b-a86a6f64207a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:48.784358 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477743a-dac2-44a6-bc65-a15b1154a5c5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:48.816745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:48.821302 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada87cc-1b89-48b6-accd-fb49237ab0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:48.822487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada87cc-1b89-48b6-accd-fb49237ab0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:48.823000 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada87cc-1b89-48b6-accd-fb49237ab0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:48.823472 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada87cc-1b89-48b6-accd-fb49237ab0d7 None admin] PATH_INFO: `/v3/groups/222813a3396d408e94ff1bbff1eba2e5` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:48.824908 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada87cc-1b89-48b6-accd-fb49237ab0d7 None admin] RBAC: Authorizing `identity:get_group(group_id=222813a3396d408e94ff1bbff1eba2e5)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:48.826579 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada87cc-1b89-48b6-accd-fb49237ab0d7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:48.828474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 201/429] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 19 10:51:48 2022] GET /identity/v3/groups/222813a3396d408e94ff1bbff1eba2e5 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:48.829563 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada87cc-1b89-48b6-accd-fb49237ab0d7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:48.846192 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 229/430] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:48.847081 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be016fd-8e91-47c7-805b-a86a6f64207a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:48.938519 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada87cc-1b89-48b6-accd-fb49237ab0d7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:48.941378 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:48.952569 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be016fd-8e91-47c7-805b-a86a6f64207a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:48.978038 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08ce28-5b5a-4c4b-86ee-6435488520dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:48.979165 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08ce28-5b5a-4c4b-86ee-6435488520dc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:48.979654 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08ce28-5b5a-4c4b-86ee-6435488520dc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:48.980200 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08ce28-5b5a-4c4b-86ee-6435488520dc None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:48.981214 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08ce28-5b5a-4c4b-86ee-6435488520dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:48.981763 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08ce28-5b5a-4c4b-86ee-6435488520dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:48.983411 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08ce28-5b5a-4c4b-86ee-6435488520dc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:48.991039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8cb5f-3043-433a-925c-e5dcf1cb43c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:48.991777 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8cb5f-3043-433a-925c-e5dcf1cb43c9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:48.992060 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8cb5f-3043-433a-925c-e5dcf1cb43c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:48.992355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8cb5f-3043-433a-925c-e5dcf1cb43c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:48.993245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8cb5f-3043-433a-925c-e5dcf1cb43c9 None admin] RBAC: Adding query filter params (group.id=222813a3396d408e94ff1bbff1eba2e5, role.id=6ff885694ad84e4cb935ef1c1f001858, scope.project.id=4c9b1fef5ff14878b0fe811a533eb847) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:48.993557 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8cb5f-3043-433a-925c-e5dcf1cb43c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:48.995083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8cb5f-3043-433a-925c-e5dcf1cb43c9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:48.995841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 202/431] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:51:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:48.997020 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08ce28-5b5a-4c4b-86ee-6435488520dc None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:49.008129 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 230/432] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 19 10:51:48 2022] GET /identity/v3/role_assignments?group.id=222813a3396d408e94ff1bbff1eba2e5&scope.project.id=4c9b1fef5ff14878b0fe811a533eb847&role.id=6ff885694ad84e4cb935ef1c1f001858 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:49.008825 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8cb5f-3043-433a-925c-e5dcf1cb43c9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:49.056607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:49.109610 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08ce28-5b5a-4c4b-86ee-6435488520dc None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:49.125174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8cb5f-3043-433a-925c-e5dcf1cb43c9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:49.146904 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf22e6-152a-474d-bcfb-4b17c5c92f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:49.148263 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf22e6-152a-474d-bcfb-4b17c5c92f68 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:49.148765 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf22e6-152a-474d-bcfb-4b17c5c92f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:49.149238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf22e6-152a-474d-bcfb-4b17c5c92f68 None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:49.150663 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf22e6-152a-474d-bcfb-4b17c5c92f68 None admin] RBAC: Authorizing `identity:get_project(project_id=5c8bef8162de48719c2febf3564c7269)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:49.152307 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf22e6-152a-474d-bcfb-4b17c5c92f68 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:49.154333 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 203/433] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:48 2022] GET /identity/v3/projects/5c8bef8162de48719c2febf3564c7269 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:49.168938 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8975181-3358-489a-9274-d24e2feb89d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:49.170698 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf22e6-152a-474d-bcfb-4b17c5c92f68 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:49.176451 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8975181-3358-489a-9274-d24e2feb89d8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:49.178984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8975181-3358-489a-9274-d24e2feb89d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:49.179539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8975181-3358-489a-9274-d24e2feb89d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:49.237222 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:49.329567 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf22e6-152a-474d-bcfb-4b17c5c92f68 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:49.340979 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8975181-3358-489a-9274-d24e2feb89d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:49.342571 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8975181-3358-489a-9274-d24e2feb89d8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:49.368050 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48662551-cde9-4aaa-9bef-9d8761e63785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:49.369338 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48662551-cde9-4aaa-9bef-9d8761e63785 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:49.369827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48662551-cde9-4aaa-9bef-9d8761e63785 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:49.370319 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48662551-cde9-4aaa-9bef-9d8761e63785 None admin] PATH_INFO: `/v3/groups/222813a3396d408e94ff1bbff1eba2e5` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:49.371835 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48662551-cde9-4aaa-9bef-9d8761e63785 None admin] RBAC: Authorizing `identity:get_group(group_id=222813a3396d408e94ff1bbff1eba2e5)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:49.373591 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48662551-cde9-4aaa-9bef-9d8761e63785 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:49.380440 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 204/434] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 19 10:51:49 2022] GET /identity/v3/groups/222813a3396d408e94ff1bbff1eba2e5 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:49.382003 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48662551-cde9-4aaa-9bef-9d8761e63785 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:49.399198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:49.484356 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 231/435] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:49.490661 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8975181-3358-489a-9274-d24e2feb89d8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:49.529187 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48662551-cde9-4aaa-9bef-9d8761e63785 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:49.533055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:49.575021 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f01f2-79d3-4b93-a28d-18c8a8ca82a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:49.576075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f01f2-79d3-4b93-a28d-18c8a8ca82a6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:49.576562 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f01f2-79d3-4b93-a28d-18c8a8ca82a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:49.577058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f01f2-79d3-4b93-a28d-18c8a8ca82a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:49.578153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f01f2-79d3-4b93-a28d-18c8a8ca82a6 None admin] RBAC: Adding query filter params (group.id=222813a3396d408e94ff1bbff1eba2e5, role.id=6ff885694ad84e4cb935ef1c1f001858, scope.project.id=5c8bef8162de48719c2febf3564c7269) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:49.578693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f01f2-79d3-4b93-a28d-18c8a8ca82a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:49.580371 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f01f2-79d3-4b93-a28d-18c8a8ca82a6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:49.589617 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 205/436] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 19 10:51:49 2022] GET /identity/v3/role_assignments?group.id=222813a3396d408e94ff1bbff1eba2e5&scope.project.id=5c8bef8162de48719c2febf3564c7269&role.id=6ff885694ad84e4cb935ef1c1f001858 => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:49.626017 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8975181-3358-489a-9274-d24e2feb89d8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:49.670766 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e50a69-2c2e-4332-b1ff-6b449134c36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:49.671735 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e50a69-2c2e-4332-b1ff-6b449134c36a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:49.672016 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e50a69-2c2e-4332-b1ff-6b449134c36a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:49.672291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e50a69-2c2e-4332-b1ff-6b449134c36a None admin] PATH_INFO: `/v3/projects/4c9b1fef5ff14878b0fe811a533eb847` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:49.673724 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e50a69-2c2e-4332-b1ff-6b449134c36a None admin] RBAC: Authorizing `identity:get_project(project_id=4c9b1fef5ff14878b0fe811a533eb847)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:49.675310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e50a69-2c2e-4332-b1ff-6b449134c36a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:49.677653 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 232/437] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:49 2022] GET /identity/v3/projects/4c9b1fef5ff14878b0fe811a533eb847 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:49.684982 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f01f2-79d3-4b93-a28d-18c8a8ca82a6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:49.810393 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f01f2-79d3-4b93-a28d-18c8a8ca82a6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:49.847621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee51681-67fb-40a5-9bd2-f9c103f1423d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:49.848501 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee51681-67fb-40a5-9bd2-f9c103f1423d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:49.848813 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee51681-67fb-40a5-9bd2-f9c103f1423d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:49.849091 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee51681-67fb-40a5-9bd2-f9c103f1423d None admin] PATH_INFO: `/v3/groups/222813a3396d408e94ff1bbff1eba2e5` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:49.850300 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee51681-67fb-40a5-9bd2-f9c103f1423d None admin] RBAC: Authorizing `identity:get_group(group_id=222813a3396d408e94ff1bbff1eba2e5)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:49.851851 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee51681-67fb-40a5-9bd2-f9c103f1423d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:49.854252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 206/438] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 19 10:51:49 2022] GET /identity/v3/groups/222813a3396d408e94ff1bbff1eba2e5 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:49.860185 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e50a69-2c2e-4332-b1ff-6b449134c36a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:49.872082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:49.972604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e50a69-2c2e-4332-b1ff-6b449134c36a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:50.010599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d13a2-9311-4cf7-a800-39f08748c365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:50.011279 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d13a2-9311-4cf7-a800-39f08748c365 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:50.011555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d13a2-9311-4cf7-a800-39f08748c365 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:50.011831 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d13a2-9311-4cf7-a800-39f08748c365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:50.012678 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d13a2-9311-4cf7-a800-39f08748c365 None admin] RBAC: Adding query filter params (group.id=222813a3396d408e94ff1bbff1eba2e5, role.id=0a734da5c17d4cd39ea84b75878e55f1, scope.project.id=4c9b1fef5ff14878b0fe811a533eb847) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:50.013016 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d13a2-9311-4cf7-a800-39f08748c365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:50.014514 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d13a2-9311-4cf7-a800-39f08748c365 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:50.022785 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 233/439] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 19 10:51:49 2022] GET /identity/v3/role_assignments?group.id=222813a3396d408e94ff1bbff1eba2e5&scope.project.id=4c9b1fef5ff14878b0fe811a533eb847&role.id=0a734da5c17d4cd39ea84b75878e55f1 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:50.075292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1a202-8c1c-451b-a4bc-76e50ac42d61 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:50.075483 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1a202-8c1c-451b-a4bc-76e50ac42d61 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:50.075748 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1a202-8c1c-451b-a4bc-76e50ac42d61 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:50.077325 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 207/440] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:50.083773 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ae4e1-0ab2-4184-ac03-77818c2142c3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:50.084135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ae4e1-0ab2-4184-ac03-77818c2142c3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:50.084295 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ae4e1-0ab2-4184-ac03-77818c2142c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:50.110421 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d80ae4e1-0ab2-4184-ac03-77818c2142c3 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:50.111882 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d80ae4e1-0ab2-4184-ac03-77818c2142c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:50.198252 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 234/441] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:50.222884 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1a202-8c1c-451b-a4bc-76e50ac42d61 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:50.267156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:50.350370 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1a202-8c1c-451b-a4bc-76e50ac42d61 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:50.400002 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8880b-3644-41b2-a51a-8f11c6e003e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:50.400002 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8880b-3644-41b2-a51a-8f11c6e003e1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:50.400002 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8880b-3644-41b2-a51a-8f11c6e003e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:50.402429 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8880b-3644-41b2-a51a-8f11c6e003e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:50.419933 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8880b-3644-41b2-a51a-8f11c6e003e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:50.428468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-77e8880b-3644-41b2-a51a-8f11c6e003e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:50.428468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:50.428468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:50.428468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:50.428468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:50.428468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:50.428468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:50.428468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:50.428468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:50.428468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:50.428468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:50.428468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:50.428468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:50.428468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:50.428468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:50.428468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:50.430102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:50.430102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:50.430102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:50.430102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:50.430102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:50.430102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:50.430102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:50.430102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:50.430102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:50.430102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:50.430102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:50.430102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:50.430102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:50.430102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:50.430102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:50.430102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:50.431369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:50.431369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:50.431369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:50.431369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:50.431369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:50.431369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:50.431369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:50.431369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:50.431369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:50.431369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:50.431369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:50.431369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:50.431369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 208/442] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 19 10:51:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:50.436479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ae4e1-0ab2-4184-ac03-77818c2142c3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:50.439720 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:50.481748 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ca348-832f-4e35-9b2c-8820881e7507 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:50.481995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ca348-832f-4e35-9b2c-8820881e7507 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:50.482489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ca348-832f-4e35-9b2c-8820881e7507 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:50.483901 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 209/443] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:51:50.489393 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52ffcb-c9c3-46e7-bcbc-cde922fc95cf None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:50.489765 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52ffcb-c9c3-46e7-bcbc-cde922fc95cf None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:50.490011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52ffcb-c9c3-46e7-bcbc-cde922fc95cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:50.508126 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fc52ffcb-c9c3-46e7-bcbc-cde922fc95cf None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:50.509362 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fc52ffcb-c9c3-46e7-bcbc-cde922fc95cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:50.573756 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ae4e1-0ab2-4184-ac03-77818c2142c3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:50.610258 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 210/444] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:51:50.623648 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59538c1b-f1d5-4a4d-91d6-ed6881bc2d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:50.623648 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59538c1b-f1d5-4a4d-91d6-ed6881bc2d5e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:50.623648 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59538c1b-f1d5-4a4d-91d6-ed6881bc2d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:50.624392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59538c1b-f1d5-4a4d-91d6-ed6881bc2d5e None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:50.624639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59538c1b-f1d5-4a4d-91d6-ed6881bc2d5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:50.625383 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59538c1b-f1d5-4a4d-91d6-ed6881bc2d5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:50.626372 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59538c1b-f1d5-4a4d-91d6-ed6881bc2d5e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:50.634467 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52ffcb-c9c3-46e7-bcbc-cde922fc95cf None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:50.638618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 235/445] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:51:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:50.644636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59538c1b-f1d5-4a4d-91d6-ed6881bc2d5e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:50.663232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:50.718014 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:50.755206 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52ffcb-c9c3-46e7-bcbc-cde922fc95cf None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:50.762626 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59538c1b-f1d5-4a4d-91d6-ed6881bc2d5e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:50.793197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff4f28-fbd9-4531-ae02-9bffb991768d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:50.794019 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff4f28-fbd9-4531-ae02-9bffb991768d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:50.794296 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff4f28-fbd9-4531-ae02-9bffb991768d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:50.794563 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff4f28-fbd9-4531-ae02-9bffb991768d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:50.803109 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68a3fc-a915-4165-b22c-4b16dc2e3bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:50.804105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68a3fc-a915-4165-b22c-4b16dc2e3bae None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:50.804432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68a3fc-a915-4165-b22c-4b16dc2e3bae None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:50.804740 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68a3fc-a915-4165-b22c-4b16dc2e3bae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:50.805477 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff4f28-fbd9-4531-ae02-9bffb991768d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:50.813280 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-5fff4f28-fbd9-4531-ae02-9bffb991768d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:50.813280 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:50.813280 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:50.813280 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:50.813280 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:50.813280 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:50.813280 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:50.813280 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:50.813280 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:50.813280 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:50.813280 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:50.813280 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:50.813280 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:50.813280 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:50.813280 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:50.813280 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:50.814398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:50.814398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:50.814398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:50.814398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:50.814398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:50.814398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:50.814398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:50.814398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:50.814398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:50.814398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:50.814398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:50.814398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:50.814398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:50.814398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:50.814398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:50.814398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:50.815392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:50.815392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:50.815392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:50.815392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:50.815392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:50.815392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:50.815392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:50.815392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:50.815392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:50.815392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:50.815392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:50.815392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:50.815392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 211/446] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:51:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:51:50.820281 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff4f28-fbd9-4531-ae02-9bffb991768d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:50.888132 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68a3fc-a915-4165-b22c-4b16dc2e3bae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:50.890483 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68a3fc-a915-4165-b22c-4b16dc2e3bae None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:50.917883 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:50.937167 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff4f28-fbd9-4531-ae02-9bffb991768d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:50.974232 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:50.977707 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0240dac-34f3-49a9-bdd0-38d0f1816e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:50.978408 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0240dac-34f3-49a9-bdd0-38d0f1816e20 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:50.978691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0240dac-34f3-49a9-bdd0-38d0f1816e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:50.978974 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0240dac-34f3-49a9-bdd0-38d0f1816e20 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:50.979763 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0240dac-34f3-49a9-bdd0-38d0f1816e20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:50.980070 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0240dac-34f3-49a9-bdd0-38d0f1816e20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:50.981585 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0240dac-34f3-49a9-bdd0-38d0f1816e20 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:50.992276 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 212/447] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:50.998210 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0240dac-34f3-49a9-bdd0-38d0f1816e20 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:51.022074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 236/448] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 10:51:51.028104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68a3fc-a915-4165-b22c-4b16dc2e3bae None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:51.121413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0240dac-34f3-49a9-bdd0-38d0f1816e20 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:51.158654 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c35f47-5f25-49a8-9375-5a9dbf62caaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:51.159231 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c35f47-5f25-49a8-9375-5a9dbf62caaf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:51.159518 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c35f47-5f25-49a8-9375-5a9dbf62caaf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:51.159792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c35f47-5f25-49a8-9375-5a9dbf62caaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:51.160580 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68a3fc-a915-4165-b22c-4b16dc2e3bae None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:51.178572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:51.208499 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e87f88-5be5-4c67-85b3-1853c0244633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:51.209427 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e87f88-5be5-4c67-85b3-1853c0244633 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:51.209706 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e87f88-5be5-4c67-85b3-1853c0244633 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:51.209977 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e87f88-5be5-4c67-85b3-1853c0244633 None admin] PATH_INFO: `/v3/projects/5c8bef8162de48719c2febf3564c7269` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:51.211266 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e87f88-5be5-4c67-85b3-1853c0244633 None admin] RBAC: Authorizing `identity:get_project(project_id=5c8bef8162de48719c2febf3564c7269)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:51.212764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e87f88-5be5-4c67-85b3-1853c0244633 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:51.214570 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 237/449] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:51 2022] GET /identity/v3/projects/5c8bef8162de48719c2febf3564c7269 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:51.220302 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e87f88-5be5-4c67-85b3-1853c0244633 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:51.238364 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c35f47-5f25-49a8-9375-5a9dbf62caaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:51.239867 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c35f47-5f25-49a8-9375-5a9dbf62caaf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:51.252904 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:51.325631 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e87f88-5be5-4c67-85b3-1853c0244633 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:51.355103 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 213/450] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:51:51.359865 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce118c0-4665-4cb8-88e5-91188a91955e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:51.360692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c35f47-5f25-49a8-9375-5a9dbf62caaf None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:51.360812 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce118c0-4665-4cb8-88e5-91188a91955e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:51.361019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce118c0-4665-4cb8-88e5-91188a91955e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:51.361284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce118c0-4665-4cb8-88e5-91188a91955e None admin] PATH_INFO: `/v3/groups/222813a3396d408e94ff1bbff1eba2e5` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:51.362443 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce118c0-4665-4cb8-88e5-91188a91955e None admin] RBAC: Authorizing `identity:get_group(group_id=222813a3396d408e94ff1bbff1eba2e5)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:51.363893 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce118c0-4665-4cb8-88e5-91188a91955e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:51.365544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 238/451] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 19 10:51:51 2022] GET /identity/v3/groups/222813a3396d408e94ff1bbff1eba2e5 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:51.371306 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce118c0-4665-4cb8-88e5-91188a91955e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:51.407578 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:51.461131 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c35f47-5f25-49a8-9375-5a9dbf62caaf None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:51.470902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:51.474141 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce118c0-4665-4cb8-88e5-91188a91955e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:51.496987 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a152334-96fe-4599-8be7-3c1c6e3a4de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:51.497861 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a152334-96fe-4599-8be7-3c1c6e3a4de1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:51.498144 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a152334-96fe-4599-8be7-3c1c6e3a4de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:51.498418 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a152334-96fe-4599-8be7-3c1c6e3a4de1 None admin] PATH_INFO: `/v3/projects/4f39c75cf6e84472a01d3e6114767933` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:51.499643 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a152334-96fe-4599-8be7-3c1c6e3a4de1 None admin] RBAC: Authorizing `identity:get_project(project_id=4f39c75cf6e84472a01d3e6114767933)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:51.501147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a152334-96fe-4599-8be7-3c1c6e3a4de1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:51.502847 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 214/452] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:51:51 2022] GET /identity/v3/projects/4f39c75cf6e84472a01d3e6114767933 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:51.508395 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a152334-96fe-4599-8be7-3c1c6e3a4de1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:51.510655 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab24c4a-5cce-4e51-a74d-1660d3afe3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:51.511324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab24c4a-5cce-4e51-a74d-1660d3afe3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:51.511604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab24c4a-5cce-4e51-a74d-1660d3afe3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:51.511905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab24c4a-5cce-4e51-a74d-1660d3afe3f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:51.512747 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab24c4a-5cce-4e51-a74d-1660d3afe3f8 None admin] RBAC: Adding query filter params (group.id=222813a3396d408e94ff1bbff1eba2e5, role.id=0a734da5c17d4cd39ea84b75878e55f1, scope.project.id=5c8bef8162de48719c2febf3564c7269) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:51.513067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab24c4a-5cce-4e51-a74d-1660d3afe3f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:51.514502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab24c4a-5cce-4e51-a74d-1660d3afe3f8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:51.520630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 239/453] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 19 10:51:51 2022] GET /identity/v3/role_assignments?group.id=222813a3396d408e94ff1bbff1eba2e5&scope.project.id=5c8bef8162de48719c2febf3564c7269&role.id=0a734da5c17d4cd39ea84b75878e55f1 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:51.617983 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a152334-96fe-4599-8be7-3c1c6e3a4de1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:51.633470 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:51.657476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6be70-2a96-45e9-8ae4-7c8acd495d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:51.658361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6be70-2a96-45e9-8ae4-7c8acd495d76 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:51.658651 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6be70-2a96-45e9-8ae4-7c8acd495d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:51.658927 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6be70-2a96-45e9-8ae4-7c8acd495d76 None admin] PATH_INFO: `/v3/groups/4e535c2ee037488d9440de7a3df5fa67` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:51.660183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6be70-2a96-45e9-8ae4-7c8acd495d76 None admin] RBAC: Authorizing `identity:get_group(group_id=4e535c2ee037488d9440de7a3df5fa67)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:51.661696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6be70-2a96-45e9-8ae4-7c8acd495d76 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:51.663403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 215/454] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 19 10:51:51 2022] GET /identity/v3/groups/4e535c2ee037488d9440de7a3df5fa67 => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:51.669497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab24c4a-5cce-4e51-a74d-1660d3afe3f8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:51.774618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab24c4a-5cce-4e51-a74d-1660d3afe3f8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:51.807988 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bbf23-5168-40a7-a943-e3b274b94a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:51.808646 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bbf23-5168-40a7-a943-e3b274b94a1b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:51.808958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bbf23-5168-40a7-a943-e3b274b94a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:51.809228 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bbf23-5168-40a7-a943-e3b274b94a1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:51.810056 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92bbf23-5168-40a7-a943-e3b274b94a1b None admin] RBAC: Adding query filter params (group.id=4e535c2ee037488d9440de7a3df5fa67, role.id=3f9528e7a7914797a4635aa6b536b7ff, scope.project.id=4f39c75cf6e84472a01d3e6114767933) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:51.810353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92bbf23-5168-40a7-a943-e3b274b94a1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:51.811808 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92bbf23-5168-40a7-a943-e3b274b94a1b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:51.817788 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 240/455] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 19 10:51:51 2022] GET /identity/v3/role_assignments?group.id=4e535c2ee037488d9440de7a3df5fa67&scope.project.id=4f39c75cf6e84472a01d3e6114767933&role.id=3f9528e7a7914797a4635aa6b536b7ff => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:54.199273 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b9dc4-64bd-4f8d-b447-f6ba5789bf4d None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:54.200301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b9dc4-64bd-4f8d-b447-f6ba5789bf4d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:54.200814 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b9dc4-64bd-4f8d-b447-f6ba5789bf4d None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:54.202663 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 216/456] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:54.208645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5789-4b24-4634-86e6-1997ad9749c9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:54.209618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5789-4b24-4634-86e6-1997ad9749c9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:54.210153 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5789-4b24-4634-86e6-1997ad9749c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:54.237822 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4fee5789-4b24-4634-86e6-1997ad9749c9 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:54.239394 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4fee5789-4b24-4634-86e6-1997ad9749c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:54.275799 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:54.339445 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 241/457] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:51:54.377616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b9dc4-64bd-4f8d-b447-f6ba5789bf4d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:54.546696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b9dc4-64bd-4f8d-b447-f6ba5789bf4d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:54.588325 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1ba59-b401-40e4-b426-d017b19364aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:54.589179 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1ba59-b401-40e4-b426-d017b19364aa None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:54.589461 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1ba59-b401-40e4-b426-d017b19364aa None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:54.589726 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1ba59-b401-40e4-b426-d017b19364aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:54.604064 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1ba59-b401-40e4-b426-d017b19364aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:54.605924 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1ba59-b401-40e4-b426-d017b19364aa None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:54.619975 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cd104-c0dc-47ac-b2a3-0f0b369da148 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:54.620627 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cd104-c0dc-47ac-b2a3-0f0b369da148 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:54.621104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cd104-c0dc-47ac-b2a3-0f0b369da148 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:54.622995 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 242/458] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:54.628453 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492d349-b539-4ad3-93fc-00757da3cf57 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:54.629075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492d349-b539-4ad3-93fc-00757da3cf57 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:54.629568 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492d349-b539-4ad3-93fc-00757da3cf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:54.633753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-86f1ba59-b401-40e4-b426-d017b19364aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:51:54.633753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:54.633753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:54.633753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:54.633753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:54.633753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:54.633753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:54.633753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:54.633753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:54.633753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:54.633753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:54.633753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:54.633753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:51:54.633753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:51:54.633753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:51:54.634628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:51:54.634628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:54.634628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:54.634628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:54.634628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:54.634628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:54.634628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:54.634628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:54.634628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:54.634628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:54.634628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:54.634628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:54.634628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:54.634628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:54.634628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:54.634628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:54.634628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:54.635512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:51:54.635512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:51:54.635512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:51:54.635512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:54.635512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 217/459] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:54.641459 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1ba59-b401-40e4-b426-d017b19364aa None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:54.666100 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1492d349-b539-4ad3-93fc-00757da3cf57 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:54.667026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1492d349-b539-4ad3-93fc-00757da3cf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:54.737167 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:54.791178 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 243/460] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:54.811959 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978014e-ee83-4f31-a2e1-9ea0aa4bae75 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:54.812147 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978014e-ee83-4f31-a2e1-9ea0aa4bae75 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:54.812407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978014e-ee83-4f31-a2e1-9ea0aa4bae75 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:54.814366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 244/461] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:51:54.821776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978014e-ee83-4f31-a2e1-9ea0aa4bae75 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:54.849255 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1ba59-b401-40e4-b426-d017b19364aa None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:54.890893 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73649ef-f041-475e-bbe7-64145728d5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:54.891835 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73649ef-f041-475e-bbe7-64145728d5fc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:54.892264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73649ef-f041-475e-bbe7-64145728d5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:54.892683 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73649ef-f041-475e-bbe7-64145728d5fc None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:54.893623 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73649ef-f041-475e-bbe7-64145728d5fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:54.894120 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73649ef-f041-475e-bbe7-64145728d5fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:54.895754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73649ef-f041-475e-bbe7-64145728d5fc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:54.913019 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 218/462] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:54.914775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12436ac6-c5a5-4394-87ee-f1becd067919 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:54.915306 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12436ac6-c5a5-4394-87ee-f1becd067919 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:54.915809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12436ac6-c5a5-4394-87ee-f1becd067919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:54.934987 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-12436ac6-c5a5-4394-87ee-f1becd067919 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:54.936535 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-12436ac6-c5a5-4394-87ee-f1becd067919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:54.941152 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:54.954232 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978014e-ee83-4f31-a2e1-9ea0aa4bae75 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:54.998724 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a0b5a-d0dd-4a54-bec4-c99014fe7445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:54.999535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a0b5a-d0dd-4a54-bec4-c99014fe7445 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:54.999810 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a0b5a-d0dd-4a54-bec4-c99014fe7445 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:55.000078 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a0b5a-d0dd-4a54-bec4-c99014fe7445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:55.013215 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a0b5a-d0dd-4a54-bec4-c99014fe7445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:55.014714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a0b5a-d0dd-4a54-bec4-c99014fe7445 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:55.016866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 219/463] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:55.018372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12436ac6-c5a5-4394-87ee-f1becd067919 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:55.039354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-3d9a0b5a-d0dd-4a54-bec4-c99014fe7445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:51:55.039354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:55.039354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:55.039354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:55.039354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:55.039354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:55.039354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:55.039354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:55.039354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:55.039354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:55.039354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:55.039354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:55.039354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:51:55.039354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:51:55.039354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:51:55.040285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:51:55.040285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:55.040285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:55.040285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:55.040285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:55.040285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:55.040285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:55.040285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:55.040285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:55.040285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:55.040285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:55.040285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:55.040285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:55.040285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:55.040285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:55.040285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:55.040285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:55.041162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:51:55.041162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:51:55.041162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:51:55.041162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:55.041162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 245/464] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:55.043042 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da598d3b-6220-4ce9-a223-725357d51896 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:55.043394 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da598d3b-6220-4ce9-a223-725357d51896 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:55.043740 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da598d3b-6220-4ce9-a223-725357d51896 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:55.050178 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 246/465] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:55.051134 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da598d3b-6220-4ce9-a223-725357d51896 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:55.057614 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:55.149141 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12436ac6-c5a5-4394-87ee-f1becd067919 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:55.164087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da598d3b-6220-4ce9-a223-725357d51896 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:55.189700 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2d001-4ea4-4b50-8c1d-c22d13584921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:55.190813 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2d001-4ea4-4b50-8c1d-c22d13584921 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:55.191103 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2d001-4ea4-4b50-8c1d-c22d13584921 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:55.191381 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2d001-4ea4-4b50-8c1d-c22d13584921 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:55.192104 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2d001-4ea4-4b50-8c1d-c22d13584921 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:55.193656 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2d001-4ea4-4b50-8c1d-c22d13584921 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:55.203972 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc055f-d10b-411b-ac90-41ef051c4fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:55.204820 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc055f-d10b-411b-ac90-41ef051c4fec None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:55.205103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc055f-d10b-411b-ac90-41ef051c4fec None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:55.205378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc055f-d10b-411b-ac90-41ef051c4fec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:55.215381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:55.217473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc055f-d10b-411b-ac90-41ef051c4fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:55.226156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 220/466] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 19 10:51:55 2022] POST /identity/v3/users => generated 246 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:51:55.226737 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc055f-d10b-411b-ac90-41ef051c4fec None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:55.226854 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3ceef-50f5-43eb-8dd8-05f7edd67696 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:55.226854 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3ceef-50f5-43eb-8dd8-05f7edd67696 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:55.226854 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3ceef-50f5-43eb-8dd8-05f7edd67696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:55.240284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-b8cc055f-d10b-411b-ac90-41ef051c4fec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:51:55.240284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:55.240284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:55.240284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:55.240284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:55.240284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:55.240284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:55.240284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:55.240284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:55.240284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:55.240284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:55.240284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:55.240284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:51:55.240284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:51:55.240284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:51:55.241273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:51:55.241273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:55.241273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:55.241273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:55.241273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:55.241273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:55.241273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:55.241273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:55.241273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:55.241273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:55.241273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:55.241273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:55.241273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:55.241273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:55.241273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:55.241273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:55.241273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:55.242259 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:51:55.242259 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:51:55.242259 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:51:55.242259 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:55.244983 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 247/467] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:55.246033 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc055f-d10b-411b-ac90-41ef051c4fec None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:55.247781 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-71b3ceef-50f5-43eb-8dd8-05f7edd67696 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:55.249110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-71b3ceef-50f5-43eb-8dd8-05f7edd67696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:55.354366 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 221/468] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:55.355707 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3ceef-50f5-43eb-8dd8-05f7edd67696 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:55.379227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:55.393012 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc055f-d10b-411b-ac90-41ef051c4fec None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:55.439542 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4778acf-7aea-4b4a-8a07-0991db706619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:55.440616 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4778acf-7aea-4b4a-8a07-0991db706619 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:55.440986 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4778acf-7aea-4b4a-8a07-0991db706619 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:55.441323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4778acf-7aea-4b4a-8a07-0991db706619 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:55.442128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4778acf-7aea-4b4a-8a07-0991db706619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:55.442516 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4778acf-7aea-4b4a-8a07-0991db706619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:55.443983 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4778acf-7aea-4b4a-8a07-0991db706619 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:55.461726 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 248/469] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:55.462198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4778acf-7aea-4b4a-8a07-0991db706619 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:55.520364 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3ceef-50f5-43eb-8dd8-05f7edd67696 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:55.534328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:55.560739 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e199ec-c1ab-4fcd-a791-7f5e412b23ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:55.561421 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e199ec-c1ab-4fcd-a791-7f5e412b23ae None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:55.561868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e199ec-c1ab-4fcd-a791-7f5e412b23ae None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:55.562287 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e199ec-c1ab-4fcd-a791-7f5e412b23ae None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:55.563168 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e199ec-c1ab-4fcd-a791-7f5e412b23ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:55.563644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e199ec-c1ab-4fcd-a791-7f5e412b23ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:55.565353 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e199ec-c1ab-4fcd-a791-7f5e412b23ae None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:55.578765 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 222/470] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:55.579929 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e199ec-c1ab-4fcd-a791-7f5e412b23ae None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:55.598867 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4778acf-7aea-4b4a-8a07-0991db706619 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:55.650541 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f4937-d1be-42f6-88da-35274de98453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:55.651370 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f4937-d1be-42f6-88da-35274de98453 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:55.651900 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f4937-d1be-42f6-88da-35274de98453 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:55.652181 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f4937-d1be-42f6-88da-35274de98453 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:55.662194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:55.669425 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f4937-d1be-42f6-88da-35274de98453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:55.672413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f4937-d1be-42f6-88da-35274de98453 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:55.698039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-c46f4937-d1be-42f6-88da-35274de98453 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:51:55.698039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:55.698039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:55.698039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:55.698039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:55.698039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:55.698039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:55.698039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:55.698039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:55.698039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:55.698039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:55.698039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:55.698039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:51:55.698039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:51:55.698039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:51:55.698911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:51:55.698911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:55.698911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:55.698911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:55.698911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:55.698911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:55.698911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:55.698911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:55.698911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:55.698911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:55.698911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:55.698911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:55.698911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:55.698911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:55.698911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:55.698911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:55.698911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:55.699747 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:51:55.699747 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:51:55.699747 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:51:55.699747 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:55.701932 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e199ec-c1ab-4fcd-a791-7f5e412b23ae None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:55.704445 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 249/471] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:55.706467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f4937-d1be-42f6-88da-35274de98453 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:55.744547 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0bf88-1ed7-438e-bf0f-3bb924e125ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:55.745390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0bf88-1ed7-438e-bf0f-3bb924e125ee None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:55.746200 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0bf88-1ed7-438e-bf0f-3bb924e125ee None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:55.746628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0bf88-1ed7-438e-bf0f-3bb924e125ee None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:55.747735 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0bf88-1ed7-438e-bf0f-3bb924e125ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:55.750045 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0bf88-1ed7-438e-bf0f-3bb924e125ee None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:55.776044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 223/472] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 19 10:51:55 2022] POST /identity/v3/users => generated 248 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:51:55.777369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0bf88-1ed7-438e-bf0f-3bb924e125ee None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:55.831776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f4937-d1be-42f6-88da-35274de98453 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:55.837104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:55.877095 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8ea77-d597-4e63-af36-ca1349c6df35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:55.878128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8ea77-d597-4e63-af36-ca1349c6df35 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:55.878648 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8ea77-d597-4e63-af36-ca1349c6df35 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:55.879071 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8ea77-d597-4e63-af36-ca1349c6df35 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:55.880084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8ea77-d597-4e63-af36-ca1349c6df35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:55.881962 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8ea77-d597-4e63-af36-ca1349c6df35 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:55.907677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 250/473] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 19 10:51:55 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:51:55.909885 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2668bc-5be3-405e-aa7e-b6284c5285a8 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:55.910440 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2668bc-5be3-405e-aa7e-b6284c5285a8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:55.910934 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2668bc-5be3-405e-aa7e-b6284c5285a8 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:55.911684 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0bf88-1ed7-438e-bf0f-3bb924e125ee None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:55.913480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 251/474] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:55.921365 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7fb16-6dd3-4567-bedc-847c79f42a25 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:55.921365 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7fb16-6dd3-4567-bedc-847c79f42a25 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:55.921365 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7fb16-6dd3-4567-bedc-847c79f42a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:55.944295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:55.954818 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcf9dd-3f5f-4bea-92ee-66b6b6c0d3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:55.955431 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcf9dd-3f5f-4bea-92ee-66b6b6c0d3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:55.956116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcf9dd-3f5f-4bea-92ee-66b6b6c0d3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:55.956600 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcf9dd-3f5f-4bea-92ee-66b6b6c0d3c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:55.958608 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-eab7fb16-6dd3-4567-bedc-847c79f42a25 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:55.960963 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-eab7fb16-6dd3-4567-bedc-847c79f42a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:55.961770 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcf9dd-3f5f-4bea-92ee-66b6b6c0d3c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:55.962091 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcf9dd-3f5f-4bea-92ee-66b6b6c0d3c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:55.963534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcf9dd-3f5f-4bea-92ee-66b6b6c0d3c5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:55.992813 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 224/475] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:56.000156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcf9dd-3f5f-4bea-92ee-66b6b6c0d3c5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:56.080843 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 252/476] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:56.101756 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7fb16-6dd3-4567-bedc-847c79f42a25 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:56.145561 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcf9dd-3f5f-4bea-92ee-66b6b6c0d3c5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:56.192141 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24598fd2-7207-43e8-829b-bfcc90ec2639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:56.193162 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24598fd2-7207-43e8-829b-bfcc90ec2639 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:56.193620 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24598fd2-7207-43e8-829b-bfcc90ec2639 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:56.194091 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24598fd2-7207-43e8-829b-bfcc90ec2639 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:56.195050 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24598fd2-7207-43e8-829b-bfcc90ec2639 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:56.196702 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24598fd2-7207-43e8-829b-bfcc90ec2639 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:56.222835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:56.224074 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 225/477] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 19 10:51:55 2022] POST /identity/v3/users => generated 249 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 10:51:56.236303 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7fb16-6dd3-4567-bedc-847c79f42a25 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:56.280101 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394e4bb-7317-4346-b540-d7e68f2d47cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:56.280839 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394e4bb-7317-4346-b540-d7e68f2d47cb None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:56.281123 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394e4bb-7317-4346-b540-d7e68f2d47cb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:56.281398 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394e4bb-7317-4346-b540-d7e68f2d47cb None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:56.282153 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394e4bb-7317-4346-b540-d7e68f2d47cb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:56.283631 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394e4bb-7317-4346-b540-d7e68f2d47cb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:56.293027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.sql.core [None req-f394e4bb-7317-4346-b540-d7e68f2d47cb None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 19 10:51:56.293027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 19 10:51:56.293027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [parameters: {'id': 'd2d7f1faafe045dd9e4ccfba84909c1b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 19 10:51:56.293027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80497) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 10:51:56.311412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-f394e4bb-7317-4346-b540-d7e68f2d47cb None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 19 10:51:56.311412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:56.311412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 10:51:56.311412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 10:51:56.311412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 10:51:56.311412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 10:51:56.311412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 10:51:56.311412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 10:51:56.311412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 10:51:56.311412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application conn.query(q) Jul 19 10:51:56.311412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 10:51:56.311412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 10:51:56.311412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 10:51:56.311412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application result.read() Jul 19 10:51:56.311412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 10:51:56.312335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 10:51:56.312335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 10:51:56.312335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 10:51:56.312335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 10:51:56.312335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 10:51:56.312335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 10:51:56.312335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 10:51:56.312335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 19 10:51:56.312335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:56.312335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 10:51:56.312335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:56.312335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:56.312335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 10:51:56.312335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 10:51:56.312335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 19 10:51:56.312335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return ref.to_dict() Jul 19 10:51:56.312335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 10:51:56.312335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application next(self.gen) Jul 19 10:51:56.313277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 10:51:56.313277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application yield resource Jul 19 10:51:56.313277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 10:51:56.313277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application next(self.gen) Jul 19 10:51:56.313277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 10:51:56.313277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 10:51:56.313277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 10:51:56.313277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 10:51:56.313277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 10:51:56.313277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise self.value Jul 19 10:51:56.313277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 10:51:56.313277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 10:51:56.313277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 10:51:56.313277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application session.commit() Jul 19 10:51:56.313277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 10:51:56.313277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 10:51:56.313277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 10:51:56.314121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 10:51:56.314121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 10:51:56.314121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.session.flush() Jul 19 10:51:56.314121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 10:51:56.314121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 10:51:56.314121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 10:51:56.314121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 10:51:56.314121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 10:51:56.314121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application compat.raise_( Jul 19 10:51:56.314121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 10:51:56.314121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception Jul 19 10:51:56.314121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 10:51:56.314121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 10:51:56.314121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 10:51:56.314121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 10:51:56.314121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 10:51:56.314121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 10:51:56.315074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 10:51:56.315074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 10:51:56.315074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 19 10:51:56.315074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 19 10:51:56.315074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 10:51:56.315074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 10:51:56.315074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 10:51:56.315074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 10:51:56.315074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 10:51:56.315074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 10:51:56.315074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 10:51:56.315074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 10:51:56.315074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 10:51:56.315074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 10:51:56.315074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 10:51:56.315074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception Jul 19 10:51:56.315871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 10:51:56.315871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 10:51:56.315871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 10:51:56.315871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 10:51:56.315871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 10:51:56.315871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 10:51:56.315871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 10:51:56.315871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application conn.query(q) Jul 19 10:51:56.315871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 10:51:56.315871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 10:51:56.315871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 10:51:56.315871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application result.read() Jul 19 10:51:56.315871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 10:51:56.315871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 10:51:56.315871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 10:51:56.315871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 10:51:56.316649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 10:51:56.316649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 10:51:56.316649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 10:51:56.316649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 10:51:56.316649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 19 10:51:56.316649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 19 10:51:56.316649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [parameters: {'id': 'd2d7f1faafe045dd9e4ccfba84909c1b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 19 10:51:56.316649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 10:51:56.316649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:56.316649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:51:56.316649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:56.316649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:56.316649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:56.316649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:56.316649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:56.316649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:56.322229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:56.322229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:56.322229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:56.322229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:56.322229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:56.322229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:56.322229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 19 10:51:56.322229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 19 10:51:56.322229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:56.322229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:56.322229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 19 10:51:56.322229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 19 10:51:56.322229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 10:51:56.322229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 10:51:56.322229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 19 10:51:56.322229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:56.324218 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 253/478] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jul 19 10:51:56 2022] POST /identity/v3/roles => generated 144 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:51:56.324349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24598fd2-7207-43e8-829b-bfcc90ec2639 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:56.382371 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:56.463750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24598fd2-7207-43e8-829b-bfcc90ec2639 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:56.501198 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e9bef-bc7d-47a2-8bb4-73dd7d0b5fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:56.502309 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e9bef-bc7d-47a2-8bb4-73dd7d0b5fdb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:56.502778 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e9bef-bc7d-47a2-8bb4-73dd7d0b5fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:56.503219 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e9bef-bc7d-47a2-8bb4-73dd7d0b5fdb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:56.515318 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e9bef-bc7d-47a2-8bb4-73dd7d0b5fdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:56.523839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-0c6e9bef-bc7d-47a2-8bb4-73dd7d0b5fdb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:56.523839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:56.523839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:56.523839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:56.523839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:56.523839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:56.523839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:56.523839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:56.523839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:56.523839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:56.523839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:56.523839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:56.523839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:56.523839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:56.523839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:56.523839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:56.524780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:56.524780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:56.524780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:56.524780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:56.524780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:56.524780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:56.524780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:56.524780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:56.524780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:56.524780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:56.524780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:56.524780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:56.524780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:56.524780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:56.524780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:56.524780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:56.525587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:56.525587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:56.525587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:56.525587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:56.525587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:56.525587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:56.525587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:56.525587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:56.525587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:56.525587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:56.525587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:56.525587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:56.532402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 226/479] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 19 10:51:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:56.534025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394e4bb-7317-4346-b540-d7e68f2d47cb None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:56.649248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394e4bb-7317-4346-b540-d7e68f2d47cb None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:56.685916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b3e87-015e-4a52-bc51-332823568a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:56.686857 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b3e87-015e-4a52-bc51-332823568a01 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:56.687277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b3e87-015e-4a52-bc51-332823568a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:56.687687 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b3e87-015e-4a52-bc51-332823568a01 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:56.688737 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b3e87-015e-4a52-bc51-332823568a01 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:56.689244 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b3e87-015e-4a52-bc51-332823568a01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:56.690825 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b3e87-015e-4a52-bc51-332823568a01 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:56.704837 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 254/480] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:51:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:58.053157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a98d3-bf23-4c17-9e9a-d2f934f57090 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:58.053968 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a98d3-bf23-4c17-9e9a-d2f934f57090 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:58.054352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a98d3-bf23-4c17-9e9a-d2f934f57090 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:58.057229 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 227/481] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:58.066544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5558b-5f3c-48d2-9e04-16efb9623b58 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:58.067349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5558b-5f3c-48d2-9e04-16efb9623b58 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:58.067490 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5558b-5f3c-48d2-9e04-16efb9623b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:58.096873 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a0d5558b-5f3c-48d2-9e04-16efb9623b58 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:58.098912 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a0d5558b-5f3c-48d2-9e04-16efb9623b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:58.127986 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:58.255473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 255/482] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:58.296454 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a98d3-bf23-4c17-9e9a-d2f934f57090 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:58.450299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524bc92-d775-4fca-a6b3-ab028b797691 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:58.450741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524bc92-d775-4fca-a6b3-ab028b797691 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:58.451264 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524bc92-d775-4fca-a6b3-ab028b797691 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:58.452978 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 256/483] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:58.467273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f1182-95e7-4cc1-84df-461f2ec7e8e7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:58.467619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f1182-95e7-4cc1-84df-461f2ec7e8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:58.467831 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f1182-95e7-4cc1-84df-461f2ec7e8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:58.513997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7a9f1182-95e7-4cc1-84df-461f2ec7e8e7 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:58.515837 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7a9f1182-95e7-4cc1-84df-461f2ec7e8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:58.526917 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a98d3-bf23-4c17-9e9a-d2f934f57090 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:58.530898 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:58.584033 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be58a7-e279-4218-ba19-11b7553785e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:58.584919 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be58a7-e279-4218-ba19-11b7553785e3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:58.585213 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be58a7-e279-4218-ba19-11b7553785e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:58.585493 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be58a7-e279-4218-ba19-11b7553785e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:58.613765 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be58a7-e279-4218-ba19-11b7553785e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:58.621756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e4be58a7-e279-4218-ba19-11b7553785e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:51:58.621756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:58.621756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:58.621756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:58.621756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:58.621756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:58.621756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:58.621756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:58.621756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:58.621756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:58.621756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:58.621756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:58.621756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:58.621756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:58.621756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:58.621756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:58.622675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:58.622675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:58.622675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:58.622675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:58.622675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:58.622675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:58.622675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:58.622675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:58.622675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:58.622675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:58.622675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:58.622675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:58.622675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:58.622675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:58.622675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:58.622675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:58.623746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:58.623746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:58.623746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:58.623746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:58.623746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:58.623746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:58.623746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:58.623746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:58.623746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:58.623746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:58.623746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:51:58.623746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:58.623746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 228/484] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:51:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:58.629317 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be58a7-e279-4218-ba19-11b7553785e3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:58.649496 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 257/485] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:58.699042 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f1182-95e7-4cc1-84df-461f2ec7e8e7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:58.768887 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be58a7-e279-4218-ba19-11b7553785e3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:58.814032 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:58.828335 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e991d-a5ce-4d95-af42-1c84e6c9ab93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:58.829068 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e991d-a5ce-4d95-af42-1c84e6c9ab93 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:58.829353 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e991d-a5ce-4d95-af42-1c84e6c9ab93 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:58.829776 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e991d-a5ce-4d95-af42-1c84e6c9ab93 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:58.830667 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e991d-a5ce-4d95-af42-1c84e6c9ab93 None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:58.830979 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e991d-a5ce-4d95-af42-1c84e6c9ab93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:58.833100 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e991d-a5ce-4d95-af42-1c84e6c9ab93 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:58.855458 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f1182-95e7-4cc1-84df-461f2ec7e8e7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:58.855672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 229/486] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 19 10:51:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:58.855672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5857c6c-b27e-4157-b8df-2ce1a39f4326 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:58.855672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5857c6c-b27e-4157-b8df-2ce1a39f4326 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:58.855672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5857c6c-b27e-4157-b8df-2ce1a39f4326 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:58.857965 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 230/487] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:58.859068 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5857c6c-b27e-4157-b8df-2ce1a39f4326 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:58.889801 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:58.896402 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cdd3c-7e5b-4f8f-a9e7-8da783a1b493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:58.898335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cdd3c-7e5b-4f8f-a9e7-8da783a1b493 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:58.899077 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cdd3c-7e5b-4f8f-a9e7-8da783a1b493 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:58.899575 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cdd3c-7e5b-4f8f-a9e7-8da783a1b493 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:58.916271 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cdd3c-7e5b-4f8f-a9e7-8da783a1b493 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:58.924198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-450cdd3c-7e5b-4f8f-a9e7-8da783a1b493 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:51:58.924198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:58.924198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:58.924198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:58.924198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:58.924198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:58.924198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:58.924198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:58.924198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:58.924198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:58.924198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:58.924198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:58.924198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:58.924198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:58.924198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:58.924198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:58.926170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:58.926170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:58.926170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:58.926170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:58.926170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:58.926170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:58.926170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:58.926170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:58.926170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:58.926170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:58.926170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:58.926170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:58.926170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:58.926170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:58.926170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:58.926170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:58.927748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:58.927748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:58.927748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:58.927748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:58.927748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:58.927748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:58.927748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:58.927748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:58.927748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:58.927748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:58.927748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:51:58.927748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:58.927748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 258/488] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:51:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:51:58.927748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57d8cd-6162-4ee8-862f-81f265fe3e98 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:58.930905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57d8cd-6162-4ee8-862f-81f265fe3e98 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:58.930905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57d8cd-6162-4ee8-862f-81f265fe3e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:58.948278 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0c57d8cd-6162-4ee8-862f-81f265fe3e98 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:58.950130 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0c57d8cd-6162-4ee8-862f-81f265fe3e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:59.038417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5857c6c-b27e-4157-b8df-2ce1a39f4326 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:59.040477 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 259/489] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:59.041665 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57d8cd-6162-4ee8-862f-81f265fe3e98 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:59.127776 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30b401-9085-4297-a2dc-0df5404bdaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:59.129652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30b401-9085-4297-a2dc-0df5404bdaf0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:59.129961 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30b401-9085-4297-a2dc-0df5404bdaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:59.130245 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30b401-9085-4297-a2dc-0df5404bdaf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:59.134468 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:59.144681 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30b401-9085-4297-a2dc-0df5404bdaf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:59.146248 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30b401-9085-4297-a2dc-0df5404bdaf0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:59.168762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-4a30b401-9085-4297-a2dc-0df5404bdaf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:51:59.168762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:59.168762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:59.168762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:59.168762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:59.168762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:59.168762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:59.168762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:59.168762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:59.168762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:59.168762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:59.168762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:59.168762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:51:59.168762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:51:59.168762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:51:59.169918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:51:59.169918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:59.169918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:59.169918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:59.169918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:59.169918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:59.169918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:59.169918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:59.169918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:59.169918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:59.169918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:59.169918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:59.169918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:59.169918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:59.169918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:59.169918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:59.169918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:59.171042 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:51:59.171042 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:51:59.171042 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:51:59.171042 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:59.174717 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 231/490] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:59.175688 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30b401-9085-4297-a2dc-0df5404bdaf0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:59.186377 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57d8cd-6162-4ee8-862f-81f265fe3e98 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:59.238452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebe92b-9c68-4bed-8c67-059e69746911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:59.240042 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebe92b-9c68-4bed-8c67-059e69746911 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:59.241409 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebe92b-9c68-4bed-8c67-059e69746911 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:59.241906 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebe92b-9c68-4bed-8c67-059e69746911 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:59.243321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebe92b-9c68-4bed-8c67-059e69746911 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:59.243864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebe92b-9c68-4bed-8c67-059e69746911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:59.245464 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebe92b-9c68-4bed-8c67-059e69746911 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:59.256239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 260/491] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 19 10:51:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:59.257260 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebe92b-9c68-4bed-8c67-059e69746911 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:59.311355 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:59.377878 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30b401-9085-4297-a2dc-0df5404bdaf0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:59.395857 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebe92b-9c68-4bed-8c67-059e69746911 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:59.427867 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc51786-ec7e-434a-8cab-76228e2847ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:59.429733 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc51786-ec7e-434a-8cab-76228e2847ed None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:59.430020 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc51786-ec7e-434a-8cab-76228e2847ed None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:59.430301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc51786-ec7e-434a-8cab-76228e2847ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:59.433972 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:59.448317 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d004ff-87cd-41d6-9272-7790d4b0aaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:59.449507 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d004ff-87cd-41d6-9272-7790d4b0aaf4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:59.450007 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d004ff-87cd-41d6-9272-7790d4b0aaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:59.450494 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d004ff-87cd-41d6-9272-7790d4b0aaf4 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:59.451277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc51786-ec7e-434a-8cab-76228e2847ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:59.451904 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d004ff-87cd-41d6-9272-7790d4b0aaf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:59.452451 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d004ff-87cd-41d6-9272-7790d4b0aaf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:59.455030 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d004ff-87cd-41d6-9272-7790d4b0aaf4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:59.465764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-8bc51786-ec7e-434a-8cab-76228e2847ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:51:59.465764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:59.465764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:59.465764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:59.465764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:59.465764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:59.465764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:59.465764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:59.465764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:59.465764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:59.465764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:59.465764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:59.465764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:59.465764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:59.465764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:59.465764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:59.466736 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:59.466736 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:59.466736 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:59.466736 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:59.466736 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:59.466736 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:59.466736 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:59.466736 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:59.466736 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:59.466736 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:59.466736 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:59.466736 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:59.466736 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:59.466736 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:59.466736 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:59.466736 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:59.467524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:59.467524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:59.467524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:59.467524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:59.467524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:59.467524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:59.467524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:59.467524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:59.467524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:59.467524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:59.467524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:51:59.467524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:59.473619 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 232/492] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:51:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:59.473619 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc51786-ec7e-434a-8cab-76228e2847ed None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:59.484453 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 261/493] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:59.484453 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473e9a3-9f08-4118-b4da-d4e2ad2db5d6 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:59.484453 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473e9a3-9f08-4118-b4da-d4e2ad2db5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:59.484453 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473e9a3-9f08-4118-b4da-d4e2ad2db5d6 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:59.485413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 262/494] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:51:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:59.486877 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473e9a3-9f08-4118-b4da-d4e2ad2db5d6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:59.642756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc51786-ec7e-434a-8cab-76228e2847ed None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:59.647880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473e9a3-9f08-4118-b4da-d4e2ad2db5d6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:59.695061 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f1edd-ce80-485c-ba7f-ac33859e4b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:59.696565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f1edd-ce80-485c-ba7f-ac33859e4b54 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:59.697075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f1edd-ce80-485c-ba7f-ac33859e4b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:59.697787 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f1edd-ce80-485c-ba7f-ac33859e4b54 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:59.698789 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f1edd-ce80-485c-ba7f-ac33859e4b54 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:59.699278 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f1edd-ce80-485c-ba7f-ac33859e4b54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:59.700908 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f1edd-ce80-485c-ba7f-ac33859e4b54 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:59.703808 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b537dc1-8909-4a9c-b03e-ea6c736c64b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:59.705170 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b537dc1-8909-4a9c-b03e-ea6c736c64b5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:59.705664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b537dc1-8909-4a9c-b03e-ea6c736c64b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:59.706107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b537dc1-8909-4a9c-b03e-ea6c736c64b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:59.711187 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:59.717232 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 263/495] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 19 10:51:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:59.719383 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f1edd-ce80-485c-ba7f-ac33859e4b54 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:59.728886 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b537dc1-8909-4a9c-b03e-ea6c736c64b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:59.731591 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b537dc1-8909-4a9c-b03e-ea6c736c64b5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:59.765766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-4b537dc1-8909-4a9c-b03e-ea6c736c64b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:51:59.765766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:59.765766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:59.765766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:59.765766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:59.765766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:59.765766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:59.765766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:59.765766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:59.765766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:59.765766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:59.765766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:59.765766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:51:59.765766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:51:59.765766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:51:59.767482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:51:59.767482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:59.767482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:59.767482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:59.767482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:59.767482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:59.767482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:59.767482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:59.767482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:59.767482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:59.767482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:59.767482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:59.767482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:59.767482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:59.767482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:59.767482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:59.767482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:59.769338 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:51:59.769338 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:51:59.769338 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:51:59.769338 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:51:59.769338 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 233/496] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:59.770861 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78753b94-6b9f-4907-a5e4-34d66b06454a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:59.770861 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78753b94-6b9f-4907-a5e4-34d66b06454a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:59.770861 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78753b94-6b9f-4907-a5e4-34d66b06454a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:59.794025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:59.802690 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-78753b94-6b9f-4907-a5e4-34d66b06454a None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:59.804816 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-78753b94-6b9f-4907-a5e4-34d66b06454a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:59.879230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f1edd-ce80-485c-ba7f-ac33859e4b54 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:59.909026 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 234/497] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:59.910429 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78753b94-6b9f-4907-a5e4-34d66b06454a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:59.951812 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f65de4-00c4-48ea-8e94-713fb6664766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:59.952946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f65de4-00c4-48ea-8e94-713fb6664766 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:59.953398 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f65de4-00c4-48ea-8e94-713fb6664766 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:59.953832 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f65de4-00c4-48ea-8e94-713fb6664766 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:59.966885 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f65de4-00c4-48ea-8e94-713fb6664766 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:59.968389 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f65de4-00c4-48ea-8e94-713fb6664766 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:59.985436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-47f65de4-00c4-48ea-8e94-713fb6664766 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:51:59.985436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:59.985436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:59.985436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:59.985436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:59.985436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:59.985436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:59.985436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:59.985436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:59.985436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:59.985436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:59.985436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:59.985436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:51:59.985436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:51:59.985436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:51:59.985436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:51:59.987144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:59.987144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:59.987144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:51:59.987144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:51:59.987144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:51:59.987144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:51:59.987144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:59.987144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:59.987144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:59.987144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:59.987144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:59.987144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:59.987144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:59.987144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:59.987144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:59.987144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:59.987144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:59.987144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:59.989369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:59.989369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:59.989369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:51:59.989369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:51:59.989369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:51:59.989369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:51:59.989369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:51:59.989369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:51:59.989369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:51:59.989369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:51:59.989369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 264/498] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 19 10:51:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:59.989369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f65de4-00c4-48ea-8e94-713fb6664766 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:00.043953 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78753b94-6b9f-4907-a5e4-34d66b06454a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:00.062706 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:00.081817 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1a121-8f5a-45c3-b957-3c1df62b626c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:00.082633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1a121-8f5a-45c3-b957-3c1df62b626c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:00.082914 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1a121-8f5a-45c3-b957-3c1df62b626c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:00.083187 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1a121-8f5a-45c3-b957-3c1df62b626c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:00.094932 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1a121-8f5a-45c3-b957-3c1df62b626c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:00.096681 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1a121-8f5a-45c3-b957-3c1df62b626c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:00.117864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-cfd1a121-8f5a-45c3-b957-3c1df62b626c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:00.117864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:00.117864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:00.117864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:00.117864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:00.117864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:00.117864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:00.117864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:00.117864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:00.117864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:00.117864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:00.117864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:00.117864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:00.117864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:00.117864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:00.119546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:00.119546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:00.119546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:00.119546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:00.119546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:00.119546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:00.119546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:00.119546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:00.119546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:00.119546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:00.119546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:00.119546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:00.119546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:00.119546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:00.119546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:00.119546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:00.119546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:00.121376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:00.121376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:00.121376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:00.121376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:00.121376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 235/499] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:00.122200 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e3335-4814-4e48-af2e-12193f539bd3 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:00.122735 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e3335-4814-4e48-af2e-12193f539bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:00.123082 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e3335-4814-4e48-af2e-12193f539bd3 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:00.124856 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 236/500] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:00.126335 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e3335-4814-4e48-af2e-12193f539bd3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:00.136635 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f65de4-00c4-48ea-8e94-713fb6664766 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:00.156587 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:00.185466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a955e-da4f-45bf-af09-69051ecc35a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:00.186506 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a955e-da4f-45bf-af09-69051ecc35a3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:00.186942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a955e-da4f-45bf-af09-69051ecc35a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:00.187366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a955e-da4f-45bf-af09-69051ecc35a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:00.188505 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a955e-da4f-45bf-af09-69051ecc35a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:00.189048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a955e-da4f-45bf-af09-69051ecc35a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:00.190883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a955e-da4f-45bf-af09-69051ecc35a3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:00.210822 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 265/501] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:00.212068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a955e-da4f-45bf-af09-69051ecc35a3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:00.285240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e3335-4814-4e48-af2e-12193f539bd3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:00.334767 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da70855-90df-46d4-9487-5cc0fbb3d370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:00.335625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da70855-90df-46d4-9487-5cc0fbb3d370 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:00.335907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da70855-90df-46d4-9487-5cc0fbb3d370 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:00.336180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da70855-90df-46d4-9487-5cc0fbb3d370 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:00.343103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a955e-da4f-45bf-af09-69051ecc35a3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:00.347241 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da70855-90df-46d4-9487-5cc0fbb3d370 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:00.355436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-0da70855-90df-46d4-9487-5cc0fbb3d370 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:00.355436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:00.355436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:00.355436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:00.355436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:00.355436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:00.355436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:00.355436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:00.355436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:00.355436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:00.355436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:00.355436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:00.355436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:00.355436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:00.355436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:00.355436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:00.357055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:00.357055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:00.357055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:00.357055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:00.357055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:00.357055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:00.357055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:00.357055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:00.357055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:00.357055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:00.357055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:00.357055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:00.357055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:00.357055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:00.357055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:00.357055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:00.358001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:00.358001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:00.358001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:00.358001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:00.358001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:00.358001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:00.358001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:00.358001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:00.358001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:00.358001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:00.358001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:00.358001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:00.358001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 237/502] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:52:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:00.358001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da70855-90df-46d4-9487-5cc0fbb3d370 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:00.402192 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547b349-cac2-427b-87c4-b6532cb4e15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:00.403191 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547b349-cac2-427b-87c4-b6532cb4e15f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:00.403375 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:00.403636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547b349-cac2-427b-87c4-b6532cb4e15f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:00.404015 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547b349-cac2-427b-87c4-b6532cb4e15f None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:00.405386 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547b349-cac2-427b-87c4-b6532cb4e15f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:00.405817 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547b349-cac2-427b-87c4-b6532cb4e15f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:00.407723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547b349-cac2-427b-87c4-b6532cb4e15f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:00.453654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 266/503] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 19 10:52:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:00.455744 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbf5dc-37dd-41cb-9fa6-35cacb131e05 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:00.456184 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbf5dc-37dd-41cb-9fa6-35cacb131e05 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:00.456601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbf5dc-37dd-41cb-9fa6-35cacb131e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:00.481441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-05cbf5dc-37dd-41cb-9fa6-35cacb131e05 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:00.483296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-05cbf5dc-37dd-41cb-9fa6-35cacb131e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:00.510112 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da70855-90df-46d4-9487-5cc0fbb3d370 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:00.522509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:00.556814 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0abd28-5699-4769-bc25-74a1fffe17b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:00.557650 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0abd28-5699-4769-bc25-74a1fffe17b5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:00.558023 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0abd28-5699-4769-bc25-74a1fffe17b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:00.558501 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0abd28-5699-4769-bc25-74a1fffe17b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:00.559262 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0abd28-5699-4769-bc25-74a1fffe17b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:00.559564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0abd28-5699-4769-bc25-74a1fffe17b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:00.561098 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0abd28-5699-4769-bc25-74a1fffe17b5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:00.576221 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 238/504] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:00.577345 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0abd28-5699-4769-bc25-74a1fffe17b5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:00.585736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 267/505] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:00.587170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbf5dc-37dd-41cb-9fa6-35cacb131e05 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:00.697301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:00.711188 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0abd28-5699-4769-bc25-74a1fffe17b5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:00.733759 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbf5dc-37dd-41cb-9fa6-35cacb131e05 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:00.762827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdfdf0-c4a1-465b-8f7c-c6c099d93e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:00.764073 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdfdf0-c4a1-465b-8f7c-c6c099d93e3d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:00.764520 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdfdf0-c4a1-465b-8f7c-c6c099d93e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:00.764992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdfdf0-c4a1-465b-8f7c-c6c099d93e3d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:00.774879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdfdf0-c4a1-465b-8f7c-c6c099d93e3d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:00.776608 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdfdf0-c4a1-465b-8f7c-c6c099d93e3d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:00.783649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a70320-f5d5-4c64-9dbb-4babd658ace6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:00.784406 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a70320-f5d5-4c64-9dbb-4babd658ace6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:00.784868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a70320-f5d5-4c64-9dbb-4babd658ace6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:00.785231 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a70320-f5d5-4c64-9dbb-4babd658ace6 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:00.786080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a70320-f5d5-4c64-9dbb-4babd658ace6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:00.786472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a70320-f5d5-4c64-9dbb-4babd658ace6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:00.788039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a70320-f5d5-4c64-9dbb-4babd658ace6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:00.794972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-31fdfdf0-c4a1-465b-8f7c-c6c099d93e3d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 10:52:00.794972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:00.794972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:00.794972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:00.794972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:00.794972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:00.794972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:00.794972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:00.794972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:00.794972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:00.794972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:00.794972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:00.794972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:00.794972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:00.794972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:00.794972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:00.796701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:00.796701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:00.796701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:00.796701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:00.796701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:00.796701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:00.796701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:00.796701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:00.796701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:00.796701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:00.796701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:00.796701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:00.796701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:00.796701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:00.796701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:00.796701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:00.796701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:00.796701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:00.798950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:00.798950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:00.798950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:00.798950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:00.798950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:00.798950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:00.798950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:00.798950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:00.798950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 10:52:00.798950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:00.798950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 239/506] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:00.798950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdfdf0-c4a1-465b-8f7c-c6c099d93e3d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:00.804667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 268/507] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 19 10:52:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:00.805752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a70320-f5d5-4c64-9dbb-4babd658ace6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:00.838002 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:00.942868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdfdf0-c4a1-465b-8f7c-c6c099d93e3d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:00.958931 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a70320-f5d5-4c64-9dbb-4babd658ace6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:00.989031 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257ddc8-9e9a-4326-8acb-33622680621e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:00.989813 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257ddc8-9e9a-4326-8acb-33622680621e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:00.990200 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257ddc8-9e9a-4326-8acb-33622680621e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:00.990597 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257ddc8-9e9a-4326-8acb-33622680621e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:01.001242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91f957-833b-40f0-bea5-7bfbf2d9784e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:01.002161 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91f957-833b-40f0-bea5-7bfbf2d9784e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:01.002531 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91f957-833b-40f0-bea5-7bfbf2d9784e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:01.002881 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91f957-833b-40f0-bea5-7bfbf2d9784e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:01.012125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91f957-833b-40f0-bea5-7bfbf2d9784e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:01.013120 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:01.014121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91f957-833b-40f0-bea5-7bfbf2d9784e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:01.030310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-3a91f957-833b-40f0-bea5-7bfbf2d9784e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 19 10:52:01.030310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:01.030310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:01.030310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:01.030310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:01.030310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:01.030310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:01.030310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:01.030310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:01.030310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:01.030310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:01.030310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:01.030310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:01.030310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:01.030310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:01.030310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:01.031942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:01.031942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:01.031942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:01.031942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:01.031942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:01.031942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:01.031942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:01.031942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:01.031942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:01.031942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:01.031942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:01.031942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:01.031942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:01.031942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:01.031942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:01.031942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:01.031942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:01.031942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:01.033926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:01.033926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:01.033926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:01.033926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:01.033926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:01.033926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:01.033926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:01.033926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:01.033926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 19 10:52:01.033926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:01.033926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 269/508] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:01.035118 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91f957-833b-40f0-bea5-7bfbf2d9784e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:01.088117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257ddc8-9e9a-4326-8acb-33622680621e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:01.089804 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257ddc8-9e9a-4326-8acb-33622680621e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:01.140289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:01.167584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91f957-833b-40f0-bea5-7bfbf2d9784e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:01.219958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0573b4-e3c6-42ab-a9e4-d41ab00f0563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:01.220343 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 240/509] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:01.220659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0573b4-e3c6-42ab-a9e4-d41ab00f0563 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:01.220975 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0573b4-e3c6-42ab-a9e4-d41ab00f0563 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:01.221244 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0573b4-e3c6-42ab-a9e4-d41ab00f0563 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:01.221814 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257ddc8-9e9a-4326-8acb-33622680621e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:01.239948 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0573b4-e3c6-42ab-a9e4-d41ab00f0563 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:01.241845 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0573b4-e3c6-42ab-a9e4-d41ab00f0563 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:01.262469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-5f0573b4-e3c6-42ab-a9e4-d41ab00f0563 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:01.262469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:01.262469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:01.262469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:01.262469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:01.262469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:01.262469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:01.262469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:01.262469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:01.262469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:01.262469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:01.262469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:01.262469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:01.262469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:01.262469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:01.269535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:01.269535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:01.269535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:01.269535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:01.269535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:01.269535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:01.269535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:01.269535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:01.269535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:01.269535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:01.269535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:01.269535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:01.269535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:01.269535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:01.269535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:01.269535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:01.269535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:01.270392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:01.270392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:01.270392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:01.270392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:01.270392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 270/510] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:01.270392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0573b4-e3c6-42ab-a9e4-d41ab00f0563 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:01.305366 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:01.361091 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257ddc8-9e9a-4326-8acb-33622680621e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:01.381686 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0573b4-e3c6-42ab-a9e4-d41ab00f0563 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:01.398529 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd351a8-ed3b-46d1-80d5-bb9f1888f85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:01.399430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd351a8-ed3b-46d1-80d5-bb9f1888f85e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:01.399853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd351a8-ed3b-46d1-80d5-bb9f1888f85e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:01.400113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd351a8-ed3b-46d1-80d5-bb9f1888f85e None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:01.401263 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd351a8-ed3b-46d1-80d5-bb9f1888f85e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:01.401573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd351a8-ed3b-46d1-80d5-bb9f1888f85e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:01.403070 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd351a8-ed3b-46d1-80d5-bb9f1888f85e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:01.414362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:01.420270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a608a7-e465-42a3-ab99-0da143610d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:01.421121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a608a7-e465-42a3-ab99-0da143610d3a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:01.421400 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a608a7-e465-42a3-ab99-0da143610d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:01.421667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a608a7-e465-42a3-ab99-0da143610d3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:01.434681 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a608a7-e465-42a3-ab99-0da143610d3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:01.436179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a608a7-e465-42a3-ab99-0da143610d3a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:01.446616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 241/511] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jul 19 10:52:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:01.447493 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd351a8-ed3b-46d1-80d5-bb9f1888f85e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:01.461565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-15a608a7-e465-42a3-ab99-0da143610d3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:01.461565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:01.461565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:01.461565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:01.461565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:01.461565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:01.461565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:01.461565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:01.461565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:01.461565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:01.461565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:01.461565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:01.461565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:01.461565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:01.461565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:01.463230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:01.463230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:01.463230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:01.463230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:01.463230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:01.463230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:01.463230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:01.463230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:01.463230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:01.463230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:01.463230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:01.463230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:01.463230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:01.463230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:01.463230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:01.463230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:01.463230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:01.465298 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:01.465298 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:01.465298 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:01.465298 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:01.465298 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 271/512] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:01.465298 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a608a7-e465-42a3-ab99-0da143610d3a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:01.581173 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a608a7-e465-42a3-ab99-0da143610d3a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:01.585118 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd351a8-ed3b-46d1-80d5-bb9f1888f85e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:01.603823 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:01.627613 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba5ffc-5fa5-4dc9-a374-f7b0520e8c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:01.629052 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba5ffc-5fa5-4dc9-a374-f7b0520e8c29 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:01.629541 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba5ffc-5fa5-4dc9-a374-f7b0520e8c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:01.630027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba5ffc-5fa5-4dc9-a374-f7b0520e8c29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:01.636470 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df40ff8-f7a3-464e-807a-05a2c6898862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:01.637198 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df40ff8-f7a3-464e-807a-05a2c6898862 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:01.637484 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df40ff8-f7a3-464e-807a-05a2c6898862 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:01.637760 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df40ff8-f7a3-464e-807a-05a2c6898862 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:01.638619 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df40ff8-f7a3-464e-807a-05a2c6898862 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:01.638928 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df40ff8-f7a3-464e-807a-05a2c6898862 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:01.640413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df40ff8-f7a3-464e-807a-05a2c6898862 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:01.647660 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba5ffc-5fa5-4dc9-a374-f7b0520e8c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:01.649221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba5ffc-5fa5-4dc9-a374-f7b0520e8c29 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:01.662527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 242/513] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jul 19 10:52:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:01.663713 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df40ff8-f7a3-464e-807a-05a2c6898862 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:01.672441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-28ba5ffc-5fa5-4dc9-a374-f7b0520e8c29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:01.672441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:01.672441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:01.672441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:01.672441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:01.672441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:01.672441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:01.672441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:01.672441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:01.672441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:01.672441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:01.672441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:01.672441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:01.672441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:01.672441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:01.673645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:01.673645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:01.673645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:01.673645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:01.673645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:01.673645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:01.673645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:01.673645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:01.673645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:01.673645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:01.673645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:01.673645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:01.673645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:01.673645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:01.673645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:01.673645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:01.673645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:01.674665 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:01.674665 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:01.674665 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:01.674665 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:01.676878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 272/514] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:01.677956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba5ffc-5fa5-4dc9-a374-f7b0520e8c29 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:01.726049 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:01.777920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df40ff8-f7a3-464e-807a-05a2c6898862 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:01.822442 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2ec22-ffec-4445-821f-548cd4643601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:01.823137 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2ec22-ffec-4445-821f-548cd4643601 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:01.823420 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2ec22-ffec-4445-821f-548cd4643601 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:01.823692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2ec22-ffec-4445-821f-548cd4643601 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:01.824466 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2ec22-ffec-4445-821f-548cd4643601 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:01.824810 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2ec22-ffec-4445-821f-548cd4643601 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:01.824998 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba5ffc-5fa5-4dc9-a374-f7b0520e8c29 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:01.826303 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2ec22-ffec-4445-821f-548cd4643601 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:01.841553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 243/515] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:01.843191 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2ec22-ffec-4445-821f-548cd4643601 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:01.874210 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52153823-c92d-4c96-96c6-1de68e786331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:01.875017 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52153823-c92d-4c96-96c6-1de68e786331 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:01.875455 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52153823-c92d-4c96-96c6-1de68e786331 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:01.875811 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52153823-c92d-4c96-96c6-1de68e786331 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:01.880945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:01.961465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52153823-c92d-4c96-96c6-1de68e786331 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:01.962941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52153823-c92d-4c96-96c6-1de68e786331 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:01.973322 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2ec22-ffec-4445-821f-548cd4643601 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:02.009706 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:02.012067 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f0fba-1a1e-493a-8bcd-dced618c8240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:02.012798 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f0fba-1a1e-493a-8bcd-dced618c8240 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:02.013073 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f0fba-1a1e-493a-8bcd-dced618c8240 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:02.013350 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f0fba-1a1e-493a-8bcd-dced618c8240 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:02.014098 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f0fba-1a1e-493a-8bcd-dced618c8240 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:02.014412 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f0fba-1a1e-493a-8bcd-dced618c8240 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:02.015872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f0fba-1a1e-493a-8bcd-dced618c8240 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:02.029562 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 244/516] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:02.030461 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f0fba-1a1e-493a-8bcd-dced618c8240 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:02.115407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 273/517] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:02.116696 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52153823-c92d-4c96-96c6-1de68e786331 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:02.153840 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:02.173515 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f0fba-1a1e-493a-8bcd-dced618c8240 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:02.215022 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777d8f3-3bc9-4d85-8ffb-f4280e262e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:02.215688 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777d8f3-3bc9-4d85-8ffb-f4280e262e4e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:02.215968 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777d8f3-3bc9-4d85-8ffb-f4280e262e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:02.216262 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777d8f3-3bc9-4d85-8ffb-f4280e262e4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:02.246372 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52153823-c92d-4c96-96c6-1de68e786331 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:02.289781 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af174b57-0b2a-4e88-aa3d-fa73198ebdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:02.290684 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af174b57-0b2a-4e88-aa3d-fa73198ebdf7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:02.291032 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af174b57-0b2a-4e88-aa3d-fa73198ebdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:02.291369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af174b57-0b2a-4e88-aa3d-fa73198ebdf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:02.292309 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af174b57-0b2a-4e88-aa3d-fa73198ebdf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:02.292674 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af174b57-0b2a-4e88-aa3d-fa73198ebdf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:02.294222 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af174b57-0b2a-4e88-aa3d-fa73198ebdf7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:02.297275 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:02.308433 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777d8f3-3bc9-4d85-8ffb-f4280e262e4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:02.309826 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 274/518] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:02.310266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777d8f3-3bc9-4d85-8ffb-f4280e262e4e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:02.310819 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af174b57-0b2a-4e88-aa3d-fa73198ebdf7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:02.415349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:02.435254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 245/519] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:02.436427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777d8f3-3bc9-4d85-8ffb-f4280e262e4e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:02.436994 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af174b57-0b2a-4e88-aa3d-fa73198ebdf7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:02.493819 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8828e-faa5-41d1-a6f4-38619cb74af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:02.494859 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8828e-faa5-41d1-a6f4-38619cb74af7 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:02.495302 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8828e-faa5-41d1-a6f4-38619cb74af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:02.495739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8828e-faa5-41d1-a6f4-38619cb74af7 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:02.496962 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8828e-faa5-41d1-a6f4-38619cb74af7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:02.499224 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8828e-faa5-41d1-a6f4-38619cb74af7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:02.526546 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 275/520] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 19 10:52:02 2022] POST /identity/v3/users => generated 247 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:52:02.527920 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8828e-faa5-41d1-a6f4-38619cb74af7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:02.607840 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777d8f3-3bc9-4d85-8ffb-f4280e262e4e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:02.633240 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:02.654904 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0168b-fa80-4d19-b85d-97065bf1113c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:02.654904 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0168b-fa80-4d19-b85d-97065bf1113c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:02.655308 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0168b-fa80-4d19-b85d-97065bf1113c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:02.655424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0168b-fa80-4d19-b85d-97065bf1113c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:02.664504 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0168b-fa80-4d19-b85d-97065bf1113c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:02.666166 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0168b-fa80-4d19-b85d-97065bf1113c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:02.683805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-a8e0168b-fa80-4d19-b85d-97065bf1113c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 10:52:02.683805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:02.683805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:02.683805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:02.683805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:02.683805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:02.683805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:02.683805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:02.683805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:02.683805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:02.683805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:02.683805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:02.683805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:02.683805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:02.683805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:02.683805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:02.685715 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:02.685715 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:02.685715 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:02.685715 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:02.685715 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:02.685715 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:02.685715 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:02.685715 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:02.685715 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:02.685715 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:02.685715 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:02.685715 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:02.685715 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:02.685715 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:02.685715 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:02.685715 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:02.685715 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:02.685715 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:02.687254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:02.687254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:02.687254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:02.687254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:02.687254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:02.687254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:02.687254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:02.687254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:02.687254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 10:52:02.687254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:02.690291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 246/521] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:52:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:02.691312 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0168b-fa80-4d19-b85d-97065bf1113c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:02.741891 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8828e-faa5-41d1-a6f4-38619cb74af7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:02.758749 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:02.798364 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea774d-2849-4be8-99e5-be9d6377f183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:02.799716 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea774d-2849-4be8-99e5-be9d6377f183 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:02.800196 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea774d-2849-4be8-99e5-be9d6377f183 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:02.801752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea774d-2849-4be8-99e5-be9d6377f183 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:02.822013 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea774d-2849-4be8-99e5-be9d6377f183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:02.823664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea774d-2849-4be8-99e5-be9d6377f183 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:02.843286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-dbea774d-2849-4be8-99e5-be9d6377f183 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:02.843286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:02.843286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:02.843286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:02.843286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:02.843286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:02.843286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:02.843286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:02.843286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:02.843286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:02.843286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:02.843286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:02.843286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:02.843286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:02.843286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:02.844369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:02.844369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:02.844369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:02.844369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:02.844369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:02.844369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:02.844369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:02.844369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:02.844369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:02.844369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:02.844369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:02.844369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:02.844369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:02.844369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:02.844369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:02.844369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:02.844369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:02.845472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:02.845472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:02.845472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:02.845472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:02.846328 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0168b-fa80-4d19-b85d-97065bf1113c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:02.847047 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 276/522] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:02.852812 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea774d-2849-4be8-99e5-be9d6377f183 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:02.891972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b704bf-9300-4a26-b2bd-f233ad646574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:02.892827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b704bf-9300-4a26-b2bd-f233ad646574 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:02.893108 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b704bf-9300-4a26-b2bd-f233ad646574 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:02.893393 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b704bf-9300-4a26-b2bd-f233ad646574 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:02.901485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b704bf-9300-4a26-b2bd-f233ad646574 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:02.903129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b704bf-9300-4a26-b2bd-f233ad646574 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:02.919725 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-72b704bf-9300-4a26-b2bd-f233ad646574 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:02.919725 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:02.919725 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:02.919725 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:02.919725 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:02.919725 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:02.919725 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:02.919725 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:02.919725 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:02.919725 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:02.919725 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:02.919725 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:02.919725 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:02.919725 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:02.919725 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:02.921784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:02.921784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:02.921784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:02.921784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:02.921784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:02.921784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:02.921784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:02.921784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:02.921784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:02.921784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:02.921784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:02.921784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:02.921784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:02.921784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:02.921784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:02.921784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:02.921784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:02.923812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:02.923812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:02.923812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:02.923812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:02.923812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:02.923812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:02.923812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:02.923812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:02.923812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 247/523] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:02.926403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b704bf-9300-4a26-b2bd-f233ad646574 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:02.990938 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea774d-2849-4be8-99e5-be9d6377f183 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:02.996110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:03.043716 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b597828-d346-4083-bdf9-1bc5393d5cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:03.044703 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b597828-d346-4083-bdf9-1bc5393d5cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:03.045194 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b597828-d346-4083-bdf9-1bc5393d5cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:03.045624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b597828-d346-4083-bdf9-1bc5393d5cf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:03.060145 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b704bf-9300-4a26-b2bd-f233ad646574 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:03.061012 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b597828-d346-4083-bdf9-1bc5393d5cf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:03.062759 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b597828-d346-4083-bdf9-1bc5393d5cf9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:03.069977 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:03.086676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-4b597828-d346-4083-bdf9-1bc5393d5cf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:03.086676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:03.086676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:03.086676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:03.086676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:03.086676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:03.086676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:03.086676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:03.086676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:03.086676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:03.086676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:03.086676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:03.086676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:03.086676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:03.086676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:03.088705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:03.088705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:03.088705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:03.088705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:03.088705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:03.088705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:03.088705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:03.088705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:03.088705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:03.088705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:03.088705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:03.088705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:03.088705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:03.088705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:03.088705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:03.088705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:03.088705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:03.090633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:03.090633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:03.090633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:03.090633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:03.095140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 277/524] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:03.096261 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b597828-d346-4083-bdf9-1bc5393d5cf9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:03.110168 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c1d68-15a5-438e-bc24-d632987e90a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:03.111059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c1d68-15a5-438e-bc24-d632987e90a3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:03.111436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c1d68-15a5-438e-bc24-d632987e90a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:03.111775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c1d68-15a5-438e-bc24-d632987e90a3 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:03.112755 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c1d68-15a5-438e-bc24-d632987e90a3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:03.113122 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c1d68-15a5-438e-bc24-d632987e90a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:03.114694 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c1d68-15a5-438e-bc24-d632987e90a3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:03.138678 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 248/525] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Jul 19 10:52:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:03.139345 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c1d68-15a5-438e-bc24-d632987e90a3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:03.239919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b597828-d346-4083-bdf9-1bc5393d5cf9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:03.289479 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c1d68-15a5-438e-bc24-d632987e90a3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:03.290014 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f22466-f1c8-4869-81ba-a8caf8df1e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:03.290715 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f22466-f1c8-4869-81ba-a8caf8df1e86 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:03.290966 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f22466-f1c8-4869-81ba-a8caf8df1e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:03.291230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f22466-f1c8-4869-81ba-a8caf8df1e86 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:03.291968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f22466-f1c8-4869-81ba-a8caf8df1e86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:03.292273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f22466-f1c8-4869-81ba-a8caf8df1e86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:03.293730 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f22466-f1c8-4869-81ba-a8caf8df1e86 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:03.310543 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 278/526] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:03.311363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f22466-f1c8-4869-81ba-a8caf8df1e86 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:03.335944 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:03.343206 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77145e9-4052-4853-a52d-b5f50431fe3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:03.344258 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77145e9-4052-4853-a52d-b5f50431fe3c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:03.344703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77145e9-4052-4853-a52d-b5f50431fe3c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:03.345148 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77145e9-4052-4853-a52d-b5f50431fe3c None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:03.346303 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77145e9-4052-4853-a52d-b5f50431fe3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:03.346762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77145e9-4052-4853-a52d-b5f50431fe3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:03.348936 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77145e9-4052-4853-a52d-b5f50431fe3c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:03.380009 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 249/527] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:03.380009 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77145e9-4052-4853-a52d-b5f50431fe3c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:03.409172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:03.459961 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f22466-f1c8-4869-81ba-a8caf8df1e86 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:03.507070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fde35d-695c-4bd4-b27d-3f6c10bba5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:03.508015 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fde35d-695c-4bd4-b27d-3f6c10bba5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:03.508450 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fde35d-695c-4bd4-b27d-3f6c10bba5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:03.508898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fde35d-695c-4bd4-b27d-3f6c10bba5d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:03.510043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fde35d-695c-4bd4-b27d-3f6c10bba5d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:03.510538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fde35d-695c-4bd4-b27d-3f6c10bba5d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:03.512649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fde35d-695c-4bd4-b27d-3f6c10bba5d0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:03.523470 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77145e9-4052-4853-a52d-b5f50431fe3c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:03.527267 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 279/528] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:03.527267 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fde35d-695c-4bd4-b27d-3f6c10bba5d0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:03.562548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c42f0-f0bf-4e8a-b291-263f899c5f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:03.563212 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c42f0-f0bf-4e8a-b291-263f899c5f95 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:03.563497 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c42f0-f0bf-4e8a-b291-263f899c5f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:03.563770 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c42f0-f0bf-4e8a-b291-263f899c5f95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:03.657794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c42f0-f0bf-4e8a-b291-263f899c5f95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:03.659806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c42f0-f0bf-4e8a-b291-263f899c5f95 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:03.667643 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:03.689621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:03.708505 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fde35d-695c-4bd4-b27d-3f6c10bba5d0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:03.768388 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b6f73-7360-491e-a260-5742d3a6e863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:03.769161 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b6f73-7360-491e-a260-5742d3a6e863 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:03.769446 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b6f73-7360-491e-a260-5742d3a6e863 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:03.769721 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b6f73-7360-491e-a260-5742d3a6e863 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:03.778152 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b6f73-7360-491e-a260-5742d3a6e863 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:03.779803 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b6f73-7360-491e-a260-5742d3a6e863 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:03.792257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 250/529] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:03.793495 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c42f0-f0bf-4e8a-b291-263f899c5f95 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:03.795916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-4f3b6f73-7360-491e-a260-5742d3a6e863 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:03.795916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:03.795916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:03.795916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:03.795916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:03.795916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:03.795916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:03.795916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:03.795916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:03.795916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:03.795916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:03.795916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:03.795916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:03.795916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:03.795916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:03.797105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:03.797105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:03.797105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:03.797105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:03.797105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:03.797105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:03.797105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:03.797105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:03.797105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:03.797105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:03.797105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:03.797105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:03.797105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:03.797105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:03.797105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:03.797105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:03.797105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:03.797958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:03.797958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:03.797958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:03.797958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:03.797958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:03.797958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:03.797958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:03.797958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:03.800884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 280/530] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:03.802406 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b6f73-7360-491e-a260-5742d3a6e863 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:03.923470 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c42f0-f0bf-4e8a-b291-263f899c5f95 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:03.949310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b6f73-7360-491e-a260-5742d3a6e863 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:03.953193 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:03.967386 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86becd-10dd-48ab-add1-c2ee19b2f5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:03.968055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86becd-10dd-48ab-add1-c2ee19b2f5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:03.968335 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86becd-10dd-48ab-add1-c2ee19b2f5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:03.968607 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86becd-10dd-48ab-add1-c2ee19b2f5c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:03.970001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86becd-10dd-48ab-add1-c2ee19b2f5c3 None admin] RBAC: Adding query filter params (role.id=669088b4ca4644f4bb586dfeaf427fb0, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=3c50a821e9ef44cb9fccd49ee4af7dbf) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:03.970313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86becd-10dd-48ab-add1-c2ee19b2f5c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:03.972264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86becd-10dd-48ab-add1-c2ee19b2f5c3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:03.988815 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 251/531] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:03 2022] GET /identity/v3/role_assignments?user.id=3c50a821e9ef44cb9fccd49ee4af7dbf&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=669088b4ca4644f4bb586dfeaf427fb0 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:03.988815 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86becd-10dd-48ab-add1-c2ee19b2f5c3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:04.016379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a9aa8-b5b8-42a5-a2e9-486187eea8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:04.017228 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a9aa8-b5b8-42a5-a2e9-486187eea8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:04.017510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a9aa8-b5b8-42a5-a2e9-486187eea8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:04.017792 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a9aa8-b5b8-42a5-a2e9-486187eea8b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:04.023673 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:04.032586 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a9aa8-b5b8-42a5-a2e9-486187eea8b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:04.035933 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a9aa8-b5b8-42a5-a2e9-486187eea8b4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:04.064524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-203a9aa8-b5b8-42a5-a2e9-486187eea8b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:04.064524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:04.064524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:04.064524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:04.064524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:04.064524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:04.064524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:04.064524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:04.064524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:04.064524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:04.064524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:04.064524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:04.064524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:04.064524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:04.064524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:04.065563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:04.065563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:04.065563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:04.065563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:04.065563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:04.065563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:04.065563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:04.065563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:04.065563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:04.065563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:04.065563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:04.065563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:04.065563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:04.065563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:04.065563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:04.065563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:04.065563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:04.066538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:04.066538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:04.066538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:04.066538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:04.066538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:04.066538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:04.066538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:04.066538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:04.079332 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 281/532] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:04.081164 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a9aa8-b5b8-42a5-a2e9-486187eea8b4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:04.124484 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86becd-10dd-48ab-add1-c2ee19b2f5c3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:04.179357 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889ac83-59c8-42ba-83ce-7741671f7c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:04.180518 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889ac83-59c8-42ba-83ce-7741671f7c47 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:04.181025 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889ac83-59c8-42ba-83ce-7741671f7c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:04.181445 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889ac83-59c8-42ba-83ce-7741671f7c47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:04.196381 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889ac83-59c8-42ba-83ce-7741671f7c47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:04.198534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889ac83-59c8-42ba-83ce-7741671f7c47 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:04.221771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-9889ac83-59c8-42ba-83ce-7741671f7c47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:04.221771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:04.221771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:04.221771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:04.221771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:04.221771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:04.221771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:04.221771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:04.221771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:04.221771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:04.221771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:04.221771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:04.221771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:04.221771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:04.221771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:04.222685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:04.222685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:04.222685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:04.222685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:04.222685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:04.222685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:04.222685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:04.222685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:04.222685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:04.222685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:04.222685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:04.222685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:04.222685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:04.222685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:04.222685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:04.222685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:04.222685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:04.223517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:04.223517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:04.223517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:04.223517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:04.226568 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 252/533] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:04.227969 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889ac83-59c8-42ba-83ce-7741671f7c47 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:04.266882 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a9aa8-b5b8-42a5-a2e9-486187eea8b4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:04.306668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175b9d8-3edf-4b99-b7fe-8942ff326614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:04.308067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175b9d8-3edf-4b99-b7fe-8942ff326614 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:04.308489 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175b9d8-3edf-4b99-b7fe-8942ff326614 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:04.308935 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175b9d8-3edf-4b99-b7fe-8942ff326614 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:04.309926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175b9d8-3edf-4b99-b7fe-8942ff326614 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:04.310479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175b9d8-3edf-4b99-b7fe-8942ff326614 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:04.312093 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175b9d8-3edf-4b99-b7fe-8942ff326614 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:04.314754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:04.340063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 282/534] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:04.341493 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175b9d8-3edf-4b99-b7fe-8942ff326614 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:04.407726 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:04.436952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889ac83-59c8-42ba-83ce-7741671f7c47 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:04.463074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175b9d8-3edf-4b99-b7fe-8942ff326614 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:04.504563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343ddb8-a630-4643-b3c9-a84dbb88b33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:04.504833 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fee300-07e1-4462-95e8-b6a77989a804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:04.505696 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343ddb8-a630-4643-b3c9-a84dbb88b33b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:04.506125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343ddb8-a630-4643-b3c9-a84dbb88b33b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:04.506385 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fee300-07e1-4462-95e8-b6a77989a804 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:04.506757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343ddb8-a630-4643-b3c9-a84dbb88b33b None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:04.507285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fee300-07e1-4462-95e8-b6a77989a804 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:04.507815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343ddb8-a630-4643-b3c9-a84dbb88b33b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:04.508029 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fee300-07e1-4462-95e8-b6a77989a804 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:04.508407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343ddb8-a630-4643-b3c9-a84dbb88b33b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:04.509898 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fee300-07e1-4462-95e8-b6a77989a804 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:04.510166 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343ddb8-a630-4643-b3c9-a84dbb88b33b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:04.510715 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fee300-07e1-4462-95e8-b6a77989a804 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:04.514832 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fee300-07e1-4462-95e8-b6a77989a804 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:04.524756 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 283/535] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:04.525861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343ddb8-a630-4643-b3c9-a84dbb88b33b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:04.557732 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 253/536] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:04.559486 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fee300-07e1-4462-95e8-b6a77989a804 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:04.642957 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343ddb8-a630-4643-b3c9-a84dbb88b33b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:04.663654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:04.686475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a4470-e33c-4f2c-90f5-9486abdd78d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:04.687511 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a4470-e33c-4f2c-90f5-9486abdd78d2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:04.688083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a4470-e33c-4f2c-90f5-9486abdd78d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:04.688532 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a4470-e33c-4f2c-90f5-9486abdd78d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:04.689636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a4470-e33c-4f2c-90f5-9486abdd78d2 None admin] RBAC: Adding query filter params (role.id=669088b4ca4644f4bb586dfeaf427fb0, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=8112def59003484483552fc76f14e281) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:04.690131 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a4470-e33c-4f2c-90f5-9486abdd78d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:04.691801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a4470-e33c-4f2c-90f5-9486abdd78d2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:04.698978 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 284/537] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:04 2022] GET /identity/v3/role_assignments?user.id=8112def59003484483552fc76f14e281&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=669088b4ca4644f4bb586dfeaf427fb0 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:04.705886 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a4470-e33c-4f2c-90f5-9486abdd78d2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:04.755522 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fee300-07e1-4462-95e8-b6a77989a804 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:04.761293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:04.822587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac66c1-9778-4a02-9653-f60204d7abbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:04.824107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac66c1-9778-4a02-9653-f60204d7abbf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:04.824695 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac66c1-9778-4a02-9653-f60204d7abbf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:04.825315 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac66c1-9778-4a02-9653-f60204d7abbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:04.839142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac66c1-9778-4a02-9653-f60204d7abbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:04.842226 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac66c1-9778-4a02-9653-f60204d7abbf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:04.877992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-a2ac66c1-9778-4a02-9653-f60204d7abbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:04.877992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:04.877992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:04.877992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:04.877992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:04.877992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:04.877992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:04.877992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:04.877992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:04.877992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:04.877992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:04.877992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:04.877992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:04.877992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:04.877992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:04.879622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:04.879622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:04.879622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:04.879622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:04.879622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:04.879622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:04.879622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:04.879622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:04.879622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:04.879622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:04.879622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:04.879622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:04.879622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:04.879622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:04.879622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:04.879622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:04.879622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:04.881291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:04.881291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:04.881291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:04.881291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:04.881291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:04.881291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:04.881291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:04.881291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:04.882612 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 254/538] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:04.892583 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac66c1-9778-4a02-9653-f60204d7abbf None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:04.966503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a4470-e33c-4f2c-90f5-9486abdd78d2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:05.077767 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ba1b5-4819-4a3d-8377-a5d9eb570765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:05.078452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ba1b5-4819-4a3d-8377-a5d9eb570765 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:05.078745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ba1b5-4819-4a3d-8377-a5d9eb570765 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:05.079049 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ba1b5-4819-4a3d-8377-a5d9eb570765 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:05.079918 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ba1b5-4819-4a3d-8377-a5d9eb570765 None admin] RBAC: Adding query filter params (role.id=669088b4ca4644f4bb586dfeaf427fb0, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=d1bcfbee5a5e4016a77901d0a637da63) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:05.080236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ba1b5-4819-4a3d-8377-a5d9eb570765 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:05.081777 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ba1b5-4819-4a3d-8377-a5d9eb570765 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:05.098559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 285/539] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:04 2022] GET /identity/v3/role_assignments?user.id=d1bcfbee5a5e4016a77901d0a637da63&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=669088b4ca4644f4bb586dfeaf427fb0 => generated 259 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:05.120112 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac66c1-9778-4a02-9653-f60204d7abbf None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:05.185424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a3680-ad5d-4917-97aa-13038e54b14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:05.186419 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a3680-ad5d-4917-97aa-13038e54b14b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:05.186840 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a3680-ad5d-4917-97aa-13038e54b14b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:05.187252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a3680-ad5d-4917-97aa-13038e54b14b None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:05.188524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a3680-ad5d-4917-97aa-13038e54b14b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:05.189023 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a3680-ad5d-4917-97aa-13038e54b14b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:05.191635 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a3680-ad5d-4917-97aa-13038e54b14b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:05.216400 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 255/540] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:05.226160 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ba1b5-4819-4a3d-8377-a5d9eb570765 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:05.334388 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:05.448381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ba1b5-4819-4a3d-8377-a5d9eb570765 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:05.526093 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26917ef2-751b-4810-beaf-a0131cbc6e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:05.527266 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26917ef2-751b-4810-beaf-a0131cbc6e69 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:05.527769 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26917ef2-751b-4810-beaf-a0131cbc6e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:05.528232 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26917ef2-751b-4810-beaf-a0131cbc6e69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:05.529915 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26917ef2-751b-4810-beaf-a0131cbc6e69 None admin] RBAC: Adding query filter params (role.id=669088b4ca4644f4bb586dfeaf427fb0, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=07eaacc831ae481d99e8ab03ee295e23) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:05.530464 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26917ef2-751b-4810-beaf-a0131cbc6e69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:05.533333 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26917ef2-751b-4810-beaf-a0131cbc6e69 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:05.548148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 286/541] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:05 2022] GET /identity/v3/role_assignments?user.id=07eaacc831ae481d99e8ab03ee295e23&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=669088b4ca4644f4bb586dfeaf427fb0 => generated 259 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:06.157094 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d6da8-d16f-4d17-8edb-2f2d3eb38dd2 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:06.158285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d6da8-d16f-4d17-8edb-2f2d3eb38dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:06.158285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d6da8-d16f-4d17-8edb-2f2d3eb38dd2 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:06.160985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 256/542] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:06.169406 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dac3a-6ef6-497e-b57f-8c6e57346382 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:06.169864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dac3a-6ef6-497e-b57f-8c6e57346382 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:06.170326 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dac3a-6ef6-497e-b57f-8c6e57346382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:06.199900 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-024dac3a-6ef6-497e-b57f-8c6e57346382 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:06.202163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-024dac3a-6ef6-497e-b57f-8c6e57346382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:06.347637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 287/543] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:06.424028 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d6da8-d16f-4d17-8edb-2f2d3eb38dd2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:06.464748 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:06.584059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d6da8-d16f-4d17-8edb-2f2d3eb38dd2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:06.636033 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50e4bf-3925-4822-af63-577a7a392ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:06.636878 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50e4bf-3925-4822-af63-577a7a392ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:06.637141 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50e4bf-3925-4822-af63-577a7a392ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:06.637394 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50e4bf-3925-4822-af63-577a7a392ff5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:06.654537 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50e4bf-3925-4822-af63-577a7a392ff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:06.662514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-8a50e4bf-3925-4822-af63-577a7a392ff5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:06.662514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:06.662514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:06.662514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:06.662514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:06.662514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:06.662514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:06.662514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:06.662514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:06.662514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:06.662514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:06.662514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:06.662514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:06.662514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:06.662514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:06.662514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:06.666099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:06.666099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:06.666099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:06.666099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:06.666099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:06.666099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:06.666099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:06.666099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:06.666099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:06.666099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:06.666099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:06.666099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:06.666099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:06.666099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:06.666099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:06.666099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:06.673542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:06.673542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:06.673542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:06.673542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:06.673542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:06.673542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:06.673542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:06.673542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:06.673542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:06.673542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:06.673542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:06.673542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:06.673542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 257/544] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:52:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:06.676296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dac3a-6ef6-497e-b57f-8c6e57346382 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:06.781363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:06.869826 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dac3a-6ef6-497e-b57f-8c6e57346382 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:06.911110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96b5e5-36dc-475a-9de2-ea6f98b5dff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:06.911809 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96b5e5-36dc-475a-9de2-ea6f98b5dff8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:06.912093 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96b5e5-36dc-475a-9de2-ea6f98b5dff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:06.912368 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96b5e5-36dc-475a-9de2-ea6f98b5dff8 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:06.913251 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96b5e5-36dc-475a-9de2-ea6f98b5dff8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:06.913566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96b5e5-36dc-475a-9de2-ea6f98b5dff8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:06.915017 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96b5e5-36dc-475a-9de2-ea6f98b5dff8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:06.932764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 288/545] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 19 10:52:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:06.940429 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50e4bf-3925-4822-af63-577a7a392ff5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:07.022007 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026a27a-e32f-4c9d-b513-5bf41a3bffbc None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:07.022311 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026a27a-e32f-4c9d-b513-5bf41a3bffbc None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:07.022618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026a27a-e32f-4c9d-b513-5bf41a3bffbc None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:07.024337 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 289/546] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:07.030643 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ecc01-f612-41dd-a2a4-3bc13fcecfc8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:07.031161 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ecc01-f612-41dd-a2a4-3bc13fcecfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:07.031360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ecc01-f612-41dd-a2a4-3bc13fcecfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:07.064585 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-013ecc01-f612-41dd-a2a4-3bc13fcecfc8 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:07.065963 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-013ecc01-f612-41dd-a2a4-3bc13fcecfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:07.124191 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:07.166398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50e4bf-3925-4822-af63-577a7a392ff5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:07.230601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 290/547] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:52:07.237659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497afd6-e77a-4729-b2af-e2753f0e92c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:07.239491 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497afd6-e77a-4729-b2af-e2753f0e92c0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:07.240261 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497afd6-e77a-4729-b2af-e2753f0e92c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:07.241157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497afd6-e77a-4729-b2af-e2753f0e92c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:07.261780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497afd6-e77a-4729-b2af-e2753f0e92c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:07.265199 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497afd6-e77a-4729-b2af-e2753f0e92c0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:07.265645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ecc01-f612-41dd-a2a4-3bc13fcecfc8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:07.307336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-0497afd6-e77a-4729-b2af-e2753f0e92c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:07.307336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:07.307336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:07.307336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:07.307336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:07.307336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:07.307336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:07.307336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:07.307336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:07.307336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:07.307336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:07.307336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:07.307336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:07.307336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:07.307336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:07.309845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:07.309845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:07.309845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:07.309845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:07.309845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:07.309845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:07.309845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:07.309845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:07.309845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:07.309845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:07.309845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:07.309845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:07.309845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:07.309845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:07.309845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:07.309845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:07.309845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:07.314547 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:07.314547 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:07.314547 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:07.314547 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:07.318731 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 258/548] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:07.333011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497afd6-e77a-4729-b2af-e2753f0e92c0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:07.365158 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:07.514620 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ecc01-f612-41dd-a2a4-3bc13fcecfc8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:07.531673 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497afd6-e77a-4729-b2af-e2753f0e92c0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:07.565251 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:07.573832 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a2740-4843-4099-859e-2e406654ba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:07.575400 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a2740-4843-4099-859e-2e406654ba84 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:07.575400 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a2740-4843-4099-859e-2e406654ba84 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:07.575400 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a2740-4843-4099-859e-2e406654ba84 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:07.576566 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a2740-4843-4099-859e-2e406654ba84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:07.577053 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a2740-4843-4099-859e-2e406654ba84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:07.578795 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a2740-4843-4099-859e-2e406654ba84 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:07.585345 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca2c41-0b41-49f2-8053-f7acd41404a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:07.587282 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca2c41-0b41-49f2-8053-f7acd41404a7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:07.588100 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca2c41-0b41-49f2-8053-f7acd41404a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:07.588904 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca2c41-0b41-49f2-8053-f7acd41404a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:07.593341 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 259/549] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:07.597935 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d00a4f-a1ed-4df9-8cc3-65a89444c607 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:07.598918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d00a4f-a1ed-4df9-8cc3-65a89444c607 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:07.599420 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d00a4f-a1ed-4df9-8cc3-65a89444c607 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:07.602933 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 260/550] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:07.604393 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d00a4f-a1ed-4df9-8cc3-65a89444c607 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:07.612446 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca2c41-0b41-49f2-8053-f7acd41404a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:07.621381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-59ca2c41-0b41-49f2-8053-f7acd41404a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:07.621381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:07.621381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:07.621381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:07.621381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:07.621381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:07.621381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:07.621381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:07.621381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:07.621381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:07.621381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:07.621381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:07.621381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:07.621381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:07.621381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:07.621381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:07.622880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:07.622880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:07.622880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:07.622880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:07.622880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:07.622880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:07.622880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:07.622880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:07.622880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:07.622880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:07.622880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:07.622880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:07.622880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:07.622880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:07.622880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:07.622880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:07.623741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:07.623741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:07.623741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:07.623741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:07.623741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:07.623741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:07.623741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:07.623741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:07.623741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:07.623741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:07.623741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:07.623741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:07.632639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 291/551] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:52:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:07.632639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee9a46-eb2c-46fe-856b-285055e44daa None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:07.633148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee9a46-eb2c-46fe-856b-285055e44daa None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:07.633795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee9a46-eb2c-46fe-856b-285055e44daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:07.663025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-63ee9a46-eb2c-46fe-856b-285055e44daa None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:07.665203 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-63ee9a46-eb2c-46fe-856b-285055e44daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:07.746434 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d00a4f-a1ed-4df9-8cc3-65a89444c607 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:07.790216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0a07e-6d72-44a9-a7fc-ab920af09df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:07.791460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0a07e-6d72-44a9-a7fc-ab920af09df8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:07.791943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0a07e-6d72-44a9-a7fc-ab920af09df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:07.792405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0a07e-6d72-44a9-a7fc-ab920af09df8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:07.793278 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 292/552] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:07.795015 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee9a46-eb2c-46fe-856b-285055e44daa None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:07.803031 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0a07e-6d72-44a9-a7fc-ab920af09df8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:07.804946 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0a07e-6d72-44a9-a7fc-ab920af09df8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:07.822295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d1a0a07e-6d72-44a9-a7fc-ab920af09df8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:52:07.822295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:07.822295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:07.822295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:07.822295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:07.822295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:07.822295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:07.822295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:07.822295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:07.822295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:07.822295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:07.822295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:07.822295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:07.822295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:07.822295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:07.822295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:07.823356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:07.823356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:07.823356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:07.823356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:07.823356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:07.823356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:07.823356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:07.823356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:07.823356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:07.823356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:07.823356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:07.823356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:07.823356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:07.823356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:07.823356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:07.823356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:07.823356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:07.823356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:07.824359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:07.824359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:07.824359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:07.824359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:07.824359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:07.824359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:07.824359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:07.824359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:07.824359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:52:07.824359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:07.830526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 261/553] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:52:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:07.830526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0a07e-6d72-44a9-a7fc-ab920af09df8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:07.845150 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:07.890856 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:07.944077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0a07e-6d72-44a9-a7fc-ab920af09df8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:07.953062 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee9a46-eb2c-46fe-856b-285055e44daa None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:07.982794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3d618-3b44-485e-89f6-2f0a7432f97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:07.983704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3d618-3b44-485e-89f6-2f0a7432f97e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:07.983992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3d618-3b44-485e-89f6-2f0a7432f97e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:07.984313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3d618-3b44-485e-89f6-2f0a7432f97e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:07.996647 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3d618-3b44-485e-89f6-2f0a7432f97e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:08.000486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c902f-521b-4d20-83cc-49cbfba540a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:08.001437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c902f-521b-4d20-83cc-49cbfba540a9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:08.001908 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c902f-521b-4d20-83cc-49cbfba540a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:08.002450 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c902f-521b-4d20-83cc-49cbfba540a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:08.003402 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c902f-521b-4d20-83cc-49cbfba540a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:08.003911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c902f-521b-4d20-83cc-49cbfba540a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:08.005359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-99d3d618-3b44-485e-89f6-2f0a7432f97e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:08.005359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:08.005359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:08.005359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:08.005359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:08.005359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:08.005359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:08.005359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:08.005359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:08.005359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:08.005359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:08.005359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:08.005359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:08.005359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:08.005359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:08.005359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:08.006292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:08.006292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:08.006292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:08.006292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:08.006292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:08.006292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:08.006292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:08.006292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:08.006292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:08.006292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:08.006292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:08.006292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:08.006292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:08.006292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:08.006292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:08.006292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:08.007174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:08.007174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:08.007174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:08.007174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:08.007174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:08.007174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:08.007174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:08.007174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:08.007174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:08.007174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:08.007174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:08.007174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:08.008776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c902f-521b-4d20-83cc-49cbfba540a9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:08.011912 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 262/554] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:52:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:08.012915 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3d618-3b44-485e-89f6-2f0a7432f97e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:08.026288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 293/555] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 19 10:52:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:08.026288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c902f-521b-4d20-83cc-49cbfba540a9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:08.137746 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:08.146364 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3d618-3b44-485e-89f6-2f0a7432f97e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:08.161198 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:08.167456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c902f-521b-4d20-83cc-49cbfba540a9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:08.191504 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034ec38-47a6-4bcd-b333-44e1afd8c0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:08.193566 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034ec38-47a6-4bcd-b333-44e1afd8c0fd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:08.194095 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034ec38-47a6-4bcd-b333-44e1afd8c0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:08.194701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034ec38-47a6-4bcd-b333-44e1afd8c0fd None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:08.195874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034ec38-47a6-4bcd-b333-44e1afd8c0fd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:08.196636 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034ec38-47a6-4bcd-b333-44e1afd8c0fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:08.199201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034ec38-47a6-4bcd-b333-44e1afd8c0fd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:08.209412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd13a23-bb99-4e4b-ae3a-f717e6858fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:08.210088 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd13a23-bb99-4e4b-ae3a-f717e6858fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:08.210484 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd13a23-bb99-4e4b-ae3a-f717e6858fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:08.210829 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd13a23-bb99-4e4b-ae3a-f717e6858fd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:08.211672 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd13a23-bb99-4e4b-ae3a-f717e6858fd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:08.212052 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd13a23-bb99-4e4b-ae3a-f717e6858fd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:08.214459 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd13a23-bb99-4e4b-ae3a-f717e6858fd2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:08.228415 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 294/557] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 19 10:52:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:08.228644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 263/557] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jul 19 10:52:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:08.229659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd13a23-bb99-4e4b-ae3a-f717e6858fd2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:08.230035 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034ec38-47a6-4bcd-b333-44e1afd8c0fd None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:08.349817 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd13a23-bb99-4e4b-ae3a-f717e6858fd2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:08.380007 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034ec38-47a6-4bcd-b333-44e1afd8c0fd None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:08.393927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09abba-8d1a-44d2-9d43-88361f6acba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:08.396065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09abba-8d1a-44d2-9d43-88361f6acba9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:08.396559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09abba-8d1a-44d2-9d43-88361f6acba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:08.397081 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09abba-8d1a-44d2-9d43-88361f6acba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:08.414076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09abba-8d1a-44d2-9d43-88361f6acba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:08.416954 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09abba-8d1a-44d2-9d43-88361f6acba9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:08.421565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:08.444565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d2347-6bda-40d6-8e1f-5aa67720998e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:08.446289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d2347-6bda-40d6-8e1f-5aa67720998e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:08.446930 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d2347-6bda-40d6-8e1f-5aa67720998e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:08.447553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d2347-6bda-40d6-8e1f-5aa67720998e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:08.452495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-ae09abba-8d1a-44d2-9d43-88361f6acba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:08.452495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:08.452495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:08.452495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:08.452495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:08.452495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:08.452495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:08.452495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:08.452495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:08.452495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:08.452495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:08.452495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:08.452495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:08.452495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:08.452495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:08.453556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:08.453556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:08.453556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:08.453556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:08.453556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:08.453556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:08.453556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:08.453556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:08.453556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:08.453556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:08.453556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:08.453556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:08.453556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:08.453556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:08.453556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:08.453556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:08.453556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:08.454721 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:08.454721 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:08.454721 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:08.454721 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:08.462236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 295/558] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:08.463634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09abba-8d1a-44d2-9d43-88361f6acba9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:08.473776 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d2347-6bda-40d6-8e1f-5aa67720998e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:08.477538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d2347-6bda-40d6-8e1f-5aa67720998e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:08.518660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d61d2347-6bda-40d6-8e1f-5aa67720998e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:08.518660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:08.518660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:08.518660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:08.518660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:08.518660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:08.518660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:08.518660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:08.518660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:08.518660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:08.518660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:08.518660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:08.518660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:08.518660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:08.518660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:08.519704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:08.519704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:08.519704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:08.519704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:08.519704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:08.519704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:08.519704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:08.519704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:08.519704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:08.519704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:08.519704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:08.519704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:08.519704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:08.519704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:08.519704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:08.519704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:08.519704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:08.520648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:08.520648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:08.520648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:08.520648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:08.527555 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 264/559] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:08.529571 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d2347-6bda-40d6-8e1f-5aa67720998e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:08.584334 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:08.604927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09abba-8d1a-44d2-9d43-88361f6acba9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:08.651916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da0f82-ce8f-43aa-81e7-756eccc4481f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:08.653300 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da0f82-ce8f-43aa-81e7-756eccc4481f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:08.653809 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da0f82-ce8f-43aa-81e7-756eccc4481f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:08.654282 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da0f82-ce8f-43aa-81e7-756eccc4481f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:08.758361 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:08.768091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da0f82-ce8f-43aa-81e7-756eccc4481f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:08.770041 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d2347-6bda-40d6-8e1f-5aa67720998e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:08.770223 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da0f82-ce8f-43aa-81e7-756eccc4481f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:08.842716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6f870-4941-41fc-91c0-052503279594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:08.843564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6f870-4941-41fc-91c0-052503279594 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:08.844097 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6f870-4941-41fc-91c0-052503279594 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:08.844664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6f870-4941-41fc-91c0-052503279594 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:08.846280 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca6f870-4941-41fc-91c0-052503279594 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:08.847555 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca6f870-4941-41fc-91c0-052503279594 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:08.850040 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca6f870-4941-41fc-91c0-052503279594 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:08.881094 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 265/560] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:08.881094 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6f870-4941-41fc-91c0-052503279594 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:08.975976 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 296/561] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:08.977572 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da0f82-ce8f-43aa-81e7-756eccc4481f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:09.012132 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:09.036892 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6f870-4941-41fc-91c0-052503279594 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:09.077479 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519fa67-0758-4583-b659-98335a04b1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:09.078617 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519fa67-0758-4583-b659-98335a04b1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:09.079072 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519fa67-0758-4583-b659-98335a04b1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:09.079521 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519fa67-0758-4583-b659-98335a04b1d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:09.080689 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519fa67-0758-4583-b659-98335a04b1d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:09.081224 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519fa67-0758-4583-b659-98335a04b1d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:09.083768 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519fa67-0758-4583-b659-98335a04b1d8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:09.099744 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 266/562] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:09.102019 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784587b-0fac-470d-add5-a84b919a4f91 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:09.102449 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784587b-0fac-470d-add5-a84b919a4f91 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:09.102858 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784587b-0fac-470d-add5-a84b919a4f91 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:09.107770 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 267/563] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:09.107984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:09.108115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4e6ff-ec93-4236-8797-84e0ad45451a None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:09.108115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4e6ff-ec93-4236-8797-84e0ad45451a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:09.108686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4e6ff-ec93-4236-8797-84e0ad45451a None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:09.111716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 268/564] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:09.113161 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4e6ff-ec93-4236-8797-84e0ad45451a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:09.114684 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da0f82-ce8f-43aa-81e7-756eccc4481f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:09.163812 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04546af-cd54-4736-ba3b-740146f5b086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:09.165091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04546af-cd54-4736-ba3b-740146f5b086 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:09.165438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04546af-cd54-4736-ba3b-740146f5b086 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:09.165774 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04546af-cd54-4736-ba3b-740146f5b086 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:09.174753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04546af-cd54-4736-ba3b-740146f5b086 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:09.176524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04546af-cd54-4736-ba3b-740146f5b086 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:09.194549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-b04546af-cd54-4736-ba3b-740146f5b086 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:52:09.194549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:09.194549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:09.194549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:09.194549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:09.194549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:09.194549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:09.194549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:09.194549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:09.194549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:09.194549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:09.194549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:09.194549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:09.194549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:09.194549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:09.194549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:09.195927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:09.195927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:09.195927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:09.195927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:09.195927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:09.195927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:09.195927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:09.195927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:09.195927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:09.195927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:09.195927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:09.195927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:09.195927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:09.195927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:09.195927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:09.195927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:09.195927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:09.195927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:09.198438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:09.198438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:09.198438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:09.198438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:09.198438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:09.198438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:09.198438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:09.198438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:09.198438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:52:09.198438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:09.198438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 297/565] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 19 10:52:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:09.198438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04546af-cd54-4736-ba3b-740146f5b086 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:09.254195 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4e6ff-ec93-4236-8797-84e0ad45451a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:09.308345 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877c196-404f-4d9f-a4c9-684914ccf0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:09.309513 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877c196-404f-4d9f-a4c9-684914ccf0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:09.309958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877c196-404f-4d9f-a4c9-684914ccf0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:09.310399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877c196-404f-4d9f-a4c9-684914ccf0e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:09.323389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877c196-404f-4d9f-a4c9-684914ccf0e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:09.325349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877c196-404f-4d9f-a4c9-684914ccf0e9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:09.328055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:09.339187 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04546af-cd54-4736-ba3b-740146f5b086 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:09.350764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-b877c196-404f-4d9f-a4c9-684914ccf0e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:09.350764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:09.350764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:09.350764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:09.350764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:09.350764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:09.350764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:09.350764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:09.350764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:09.350764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:09.350764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:09.350764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:09.350764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:09.350764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:09.350764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:09.352846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:09.352846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:09.352846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:09.352846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:09.352846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:09.352846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:09.352846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:09.352846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:09.352846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:09.352846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:09.352846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:09.352846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:09.352846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:09.352846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:09.352846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:09.352846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:09.352846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:09.354558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:09.354558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:09.354558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:09.354558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:09.354558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 269/566] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:09.355687 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc46a5b-b37e-49ca-b5d8-e21d722c1717 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:09.356175 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc46a5b-b37e-49ca-b5d8-e21d722c1717 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:09.356644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc46a5b-b37e-49ca-b5d8-e21d722c1717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:09.377248 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-0cc46a5b-b37e-49ca-b5d8-e21d722c1717 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:09.378677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0cc46a5b-b37e-49ca-b5d8-e21d722c1717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:09.392956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732a9de-9176-456b-b492-af1d4427ea9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:09.394028 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732a9de-9176-456b-b492-af1d4427ea9c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:09.394936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732a9de-9176-456b-b492-af1d4427ea9c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:09.394936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732a9de-9176-456b-b492-af1d4427ea9c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:09.403857 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732a9de-9176-456b-b492-af1d4427ea9c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:09.405835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732a9de-9176-456b-b492-af1d4427ea9c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:09.422974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-b732a9de-9176-456b-b492-af1d4427ea9c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 10:52:09.422974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:09.422974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:09.422974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:09.422974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:09.422974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:09.422974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:09.422974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:09.422974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:09.422974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:09.422974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:09.422974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:09.422974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:09.422974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:09.422974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:09.422974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:09.432909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:09.432909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:09.432909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:09.432909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:09.432909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:09.432909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:09.432909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:09.432909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:09.432909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:09.432909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:09.432909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:09.432909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:09.432909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:09.432909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:09.432909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:09.432909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:09.432909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:09.432909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:09.434870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:09.434870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:09.434870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:09.434870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:09.434870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:09.434870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:09.434870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:09.434870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:09.434870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 10:52:09.434870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:09.434870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 298/567] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:09.434870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5b774-5a92-4fe6-ad35-43b25ed7bd37 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:09.434870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5b774-5a92-4fe6-ad35-43b25ed7bd37 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:09.436166 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5b774-5a92-4fe6-ad35-43b25ed7bd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:09.454116 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-88f5b774-5a92-4fe6-ad35-43b25ed7bd37 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:09.455842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-88f5b774-5a92-4fe6-ad35-43b25ed7bd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:09.475523 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:09.479556 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 270/568] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:09.479556 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc46a5b-b37e-49ca-b5d8-e21d722c1717 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:09.557539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 299/569] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:09.558868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5b774-5a92-4fe6-ad35-43b25ed7bd37 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:09.628506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc46a5b-b37e-49ca-b5d8-e21d722c1717 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:09.666928 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:09.682400 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32e673-0154-4e6b-a610-71eb5467c754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:09.683524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32e673-0154-4e6b-a610-71eb5467c754 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:09.684024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32e673-0154-4e6b-a610-71eb5467c754 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:09.684486 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32e673-0154-4e6b-a610-71eb5467c754 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:09.686128 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32e673-0154-4e6b-a610-71eb5467c754 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:09.686680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32e673-0154-4e6b-a610-71eb5467c754 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:09.689413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32e673-0154-4e6b-a610-71eb5467c754 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:09.690184 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5b774-5a92-4fe6-ad35-43b25ed7bd37 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:09.715362 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 271/570] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 19 10:52:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:09.716222 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32e673-0154-4e6b-a610-71eb5467c754 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:09.741097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72554a56-9f18-4bc4-9699-87151c88de05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:09.742237 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72554a56-9f18-4bc4-9699-87151c88de05 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:09.742734 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72554a56-9f18-4bc4-9699-87151c88de05 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:09.743226 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72554a56-9f18-4bc4-9699-87151c88de05 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:09.744608 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72554a56-9f18-4bc4-9699-87151c88de05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:09.745178 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72554a56-9f18-4bc4-9699-87151c88de05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:09.747751 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72554a56-9f18-4bc4-9699-87151c88de05 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:09.769951 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 300/571] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:09.771472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72554a56-9f18-4bc4-9699-87151c88de05 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:09.787882 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:09.830480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32e673-0154-4e6b-a610-71eb5467c754 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:09.873770 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745bcd7-c8b1-4d5f-922a-f28ae4a22f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:09.874793 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745bcd7-c8b1-4d5f-922a-f28ae4a22f5b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:09.875239 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745bcd7-c8b1-4d5f-922a-f28ae4a22f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:09.875668 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745bcd7-c8b1-4d5f-922a-f28ae4a22f5b None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:09.877163 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745bcd7-c8b1-4d5f-922a-f28ae4a22f5b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:09.877660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745bcd7-c8b1-4d5f-922a-f28ae4a22f5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:09.880153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745bcd7-c8b1-4d5f-922a-f28ae4a22f5b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:09.906024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 272/572] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jul 19 10:52:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:09.907378 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745bcd7-c8b1-4d5f-922a-f28ae4a22f5b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:09.939962 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72554a56-9f18-4bc4-9699-87151c88de05 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:09.967339 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:09.988813 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377ddd9-eb31-4df0-bf88-f164f27ca1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:09.990077 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377ddd9-eb31-4df0-bf88-f164f27ca1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:09.995256 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377ddd9-eb31-4df0-bf88-f164f27ca1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:09.995256 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377ddd9-eb31-4df0-bf88-f164f27ca1e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:10.007878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377ddd9-eb31-4df0-bf88-f164f27ca1e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:10.017163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-1377ddd9-eb31-4df0-bf88-f164f27ca1e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:10.017163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:10.017163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:10.017163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:10.017163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:10.017163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:10.017163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:10.017163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:10.017163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:10.017163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:10.017163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:10.017163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:10.017163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:10.017163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:10.017163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:10.017163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:10.019026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:10.019026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:10.019026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:10.019026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:10.019026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:10.019026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:10.019026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:10.019026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:10.019026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:10.019026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:10.019026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:10.019026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:10.019026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:10.019026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:10.019026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:10.019026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:10.020850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:10.020850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:10.020850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:10.020850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:10.020850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:10.020850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:10.020850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:10.020850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:10.020850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:10.020850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:10.020850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:10.020850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:10.020850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 301/573] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:52:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:10.020850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377ddd9-eb31-4df0-bf88-f164f27ca1e1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:10.062940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745bcd7-c8b1-4d5f-922a-f28ae4a22f5b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:10.099078 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:10.108370 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6f7ec-8f88-48d5-b430-37260db67d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:10.109527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6f7ec-8f88-48d5-b430-37260db67d0d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:10.109911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6f7ec-8f88-48d5-b430-37260db67d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:10.110253 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6f7ec-8f88-48d5-b430-37260db67d0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:10.122719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6f7ec-8f88-48d5-b430-37260db67d0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:10.130686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-85e6f7ec-8f88-48d5-b430-37260db67d0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:10.130686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:10.130686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:10.130686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:10.130686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:10.130686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:10.130686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:10.130686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:10.130686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:10.130686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:10.130686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:10.130686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:10.130686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:10.130686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:10.130686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:10.130686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:10.132448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:10.132448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:10.132448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:10.132448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:10.132448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:10.132448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:10.132448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:10.132448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:10.132448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:10.132448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:10.132448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:10.132448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:10.132448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:10.132448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:10.132448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:10.132448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:10.133452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:10.133452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:10.133452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:10.133452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:10.133452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:10.133452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:10.133452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:10.133452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:10.133452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:10.133452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:10.133452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:10.133452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:10.133452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 273/574] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:52:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:10.133452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6f7ec-8f88-48d5-b430-37260db67d0d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:10.151833 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377ddd9-eb31-4df0-bf88-f164f27ca1e1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:10.197926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b088082-d23d-46e9-bffc-827f1feb6b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:10.199230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b088082-d23d-46e9-bffc-827f1feb6b77 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:10.199717 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b088082-d23d-46e9-bffc-827f1feb6b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:10.200184 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b088082-d23d-46e9-bffc-827f1feb6b77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:10.220329 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b088082-d23d-46e9-bffc-827f1feb6b77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:10.223107 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b088082-d23d-46e9-bffc-827f1feb6b77 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:10.243914 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:10.246441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-7b088082-d23d-46e9-bffc-827f1feb6b77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:10.246441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:10.246441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:10.246441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:10.246441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:10.246441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:10.246441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:10.246441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:10.246441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:10.246441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:10.246441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:10.246441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:10.246441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:10.246441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:10.246441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:10.248599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:10.248599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:10.248599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:10.248599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:10.248599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:10.248599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:10.248599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:10.248599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:10.248599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:10.248599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:10.248599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:10.248599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:10.248599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:10.248599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:10.248599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:10.248599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:10.248599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:10.251051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:10.251051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:10.251051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:10.251051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:10.251483 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6f7ec-8f88-48d5-b430-37260db67d0d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:10.251620 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 302/575] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:10.251620 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b088082-d23d-46e9-bffc-827f1feb6b77 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:10.300997 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a8137-6d5d-4f70-9e39-03d986f8f8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:10.302272 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a8137-6d5d-4f70-9e39-03d986f8f8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:10.302722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a8137-6d5d-4f70-9e39-03d986f8f8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:10.303223 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a8137-6d5d-4f70-9e39-03d986f8f8c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:10.315412 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a8137-6d5d-4f70-9e39-03d986f8f8c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:10.317995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a8137-6d5d-4f70-9e39-03d986f8f8c2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:10.342889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-386a8137-6d5d-4f70-9e39-03d986f8f8c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:10.342889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:10.342889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:10.342889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:10.342889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:10.342889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:10.342889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:10.342889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:10.342889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:10.342889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:10.342889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:10.342889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:10.342889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:10.342889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:10.342889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:10.344843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:10.344843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:10.344843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:10.344843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:10.344843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:10.344843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:10.344843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:10.344843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:10.344843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:10.344843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:10.344843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:10.344843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:10.344843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:10.344843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:10.344843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:10.344843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:10.344843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:10.346624 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:10.346624 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:10.346624 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:10.346624 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:10.346624 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:10.346624 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:10.346624 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:10.346624 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:10.346624 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 274/576] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:10.346624 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a8137-6d5d-4f70-9e39-03d986f8f8c2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:10.409882 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b088082-d23d-46e9-bffc-827f1feb6b77 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:10.435472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:10.463614 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40df32-9a52-43b2-ae1e-b5ae26573b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:10.464638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40df32-9a52-43b2-ae1e-b5ae26573b2f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:10.465127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40df32-9a52-43b2-ae1e-b5ae26573b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:10.465567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40df32-9a52-43b2-ae1e-b5ae26573b2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:10.482594 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40df32-9a52-43b2-ae1e-b5ae26573b2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:10.484383 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40df32-9a52-43b2-ae1e-b5ae26573b2f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:10.490431 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a8137-6d5d-4f70-9e39-03d986f8f8c2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:10.504296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-af40df32-9a52-43b2-ae1e-b5ae26573b2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:10.504296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:10.504296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:10.504296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:10.504296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:10.504296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:10.504296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:10.504296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:10.504296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:10.504296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:10.504296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:10.504296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:10.504296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:10.504296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:10.504296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:10.506243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:10.506243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:10.506243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:10.506243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:10.506243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:10.506243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:10.506243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:10.506243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:10.506243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:10.506243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:10.506243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:10.506243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:10.506243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:10.506243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:10.506243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:10.506243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:10.506243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:10.507964 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:10.507964 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:10.507964 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:10.507964 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:10.507964 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 303/577] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:10.507964 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40df32-9a52-43b2-ae1e-b5ae26573b2f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:10.542797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f693a37-3871-4b6e-a53c-def15ee47422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:10.543940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f693a37-3871-4b6e-a53c-def15ee47422 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:10.544434 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f693a37-3871-4b6e-a53c-def15ee47422 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:10.544952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f693a37-3871-4b6e-a53c-def15ee47422 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:10.546015 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f693a37-3871-4b6e-a53c-def15ee47422 None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:10.546564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f693a37-3871-4b6e-a53c-def15ee47422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:10.549093 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f693a37-3871-4b6e-a53c-def15ee47422 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:10.564119 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 275/578] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 19 10:52:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:10.565424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f693a37-3871-4b6e-a53c-def15ee47422 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:10.611117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:10.625782 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40df32-9a52-43b2-ae1e-b5ae26573b2f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:10.667121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1909c-d895-4ce6-b15d-a0b774b4bd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:10.667709 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1909c-d895-4ce6-b15d-a0b774b4bd67 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:10.668235 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1909c-d895-4ce6-b15d-a0b774b4bd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:10.668512 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1909c-d895-4ce6-b15d-a0b774b4bd67 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:10.669390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1909c-d895-4ce6-b15d-a0b774b4bd67 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:10.669698 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1909c-d895-4ce6-b15d-a0b774b4bd67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:10.671439 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1909c-d895-4ce6-b15d-a0b774b4bd67 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:10.681440 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 304/579] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 19 10:52:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:10.682876 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1909c-d895-4ce6-b15d-a0b774b4bd67 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:10.709673 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f693a37-3871-4b6e-a53c-def15ee47422 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:10.731109 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:10.755802 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dadc2a7-49a5-4727-acf8-884109c58eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:10.756551 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadc2a7-49a5-4727-acf8-884109c58eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:10.756877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadc2a7-49a5-4727-acf8-884109c58eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:10.757153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadc2a7-49a5-4727-acf8-884109c58eb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:10.757891 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dadc2a7-49a5-4727-acf8-884109c58eb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:10.758196 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dadc2a7-49a5-4727-acf8-884109c58eb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:10.759600 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dadc2a7-49a5-4727-acf8-884109c58eb8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:10.772882 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 276/580] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:10.773763 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dadc2a7-49a5-4727-acf8-884109c58eb8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:10.827998 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1909c-d895-4ce6-b15d-a0b774b4bd67 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:10.880221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b754d-bbbf-4335-afef-b2c2cc63930d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:10.881487 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b754d-bbbf-4335-afef-b2c2cc63930d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:10.881930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b754d-bbbf-4335-afef-b2c2cc63930d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:10.882365 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b754d-bbbf-4335-afef-b2c2cc63930d None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:10.883712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b754d-bbbf-4335-afef-b2c2cc63930d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:10.884195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b754d-bbbf-4335-afef-b2c2cc63930d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:10.886545 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b754d-bbbf-4335-afef-b2c2cc63930d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:10.897846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:10.905072 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 305/581] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:10.907164 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b754d-bbbf-4335-afef-b2c2cc63930d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:10.921904 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dadc2a7-49a5-4727-acf8-884109c58eb8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:10.965022 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589f27d-20f2-483c-a126-bc5a643b9d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:10.965782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589f27d-20f2-483c-a126-bc5a643b9d94 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:10.966130 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589f27d-20f2-483c-a126-bc5a643b9d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:10.966494 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589f27d-20f2-483c-a126-bc5a643b9d94 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:10.967352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589f27d-20f2-483c-a126-bc5a643b9d94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:10.967789 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589f27d-20f2-483c-a126-bc5a643b9d94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:10.969412 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589f27d-20f2-483c-a126-bc5a643b9d94 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:10.986048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 277/582] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:10.987396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589f27d-20f2-483c-a126-bc5a643b9d94 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:11.033692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:11.047927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b754d-bbbf-4335-afef-b2c2cc63930d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:11.097695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c3dde-0224-4506-aa6b-7ad716929090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:11.098985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c3dde-0224-4506-aa6b-7ad716929090 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:11.099423 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c3dde-0224-4506-aa6b-7ad716929090 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:11.099893 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c3dde-0224-4506-aa6b-7ad716929090 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:11.114274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c3dde-0224-4506-aa6b-7ad716929090 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:11.116018 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c3dde-0224-4506-aa6b-7ad716929090 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:11.135290 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589f27d-20f2-483c-a126-bc5a643b9d94 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:11.136378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-ad1c3dde-0224-4506-aa6b-7ad716929090 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:11.136378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:11.136378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:11.136378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:11.136378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:11.136378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:11.136378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:11.136378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:11.136378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:11.136378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:11.136378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:11.136378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:11.136378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:11.136378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:11.136378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:11.138087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:11.138087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:11.138087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:11.138087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:11.138087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:11.138087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:11.138087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:11.138087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:11.138087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:11.138087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:11.138087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:11.138087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:11.138087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:11.138087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:11.138087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:11.138087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:11.138087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:11.139264 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:11.139264 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:11.139264 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:11.139264 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:11.139264 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 306/583] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:11.139547 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c3dde-0224-4506-aa6b-7ad716929090 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:11.187989 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6dab8-bdcd-45f8-85ea-956349c21fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:11.189271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6dab8-bdcd-45f8-85ea-956349c21fcf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:11.189720 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6dab8-bdcd-45f8-85ea-956349c21fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:11.190163 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6dab8-bdcd-45f8-85ea-956349c21fcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:11.206297 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6dab8-bdcd-45f8-85ea-956349c21fcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:11.207911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6dab8-bdcd-45f8-85ea-956349c21fcf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:11.210400 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:11.232469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-5bd6dab8-bdcd-45f8-85ea-956349c21fcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:11.232469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:11.232469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:11.232469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:11.232469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:11.232469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:11.232469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:11.232469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:11.232469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:11.232469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:11.232469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:11.232469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:11.232469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:11.232469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:11.232469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:11.234279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:11.234279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:11.234279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:11.234279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:11.234279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:11.234279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:11.234279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:11.234279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:11.234279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:11.234279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:11.234279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:11.234279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:11.234279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:11.234279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:11.234279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:11.234279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:11.234279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:11.236027 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:11.236027 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:11.236027 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:11.236027 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:11.236027 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 278/584] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:11.236027 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6dab8-bdcd-45f8-85ea-956349c21fcf None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:11.280599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c3dde-0224-4506-aa6b-7ad716929090 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:11.327584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69752696-2ac2-4bda-b1ce-a8859d3bc731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:11.328858 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69752696-2ac2-4bda-b1ce-a8859d3bc731 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:11.329292 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69752696-2ac2-4bda-b1ce-a8859d3bc731 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:11.329724 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69752696-2ac2-4bda-b1ce-a8859d3bc731 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:11.338690 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69752696-2ac2-4bda-b1ce-a8859d3bc731 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:11.340324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69752696-2ac2-4bda-b1ce-a8859d3bc731 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:11.362486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-69752696-2ac2-4bda-b1ce-a8859d3bc731 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:11.362486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:11.362486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:11.362486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:11.362486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:11.362486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:11.362486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:11.362486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:11.362486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:11.362486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:11.362486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:11.362486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:11.362486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:11.362486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:11.362486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:11.364404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:11.364404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:11.364404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:11.364404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:11.364404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:11.364404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:11.364404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:11.364404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:11.364404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:11.364404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:11.364404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:11.364404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:11.364404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:11.364404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:11.364404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:11.364404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:11.364404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:11.366245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:11.366245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:11.366245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:11.366245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:11.366245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:11.366245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:11.366245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:11.366245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:11.366245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 307/585] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:11.366245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69752696-2ac2-4bda-b1ce-a8859d3bc731 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:11.370940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:11.378807 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6dab8-bdcd-45f8-85ea-956349c21fcf None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:11.420523 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e8e95-3072-4d6c-b1f9-b417adbc4252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:11.421306 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e8e95-3072-4d6c-b1f9-b417adbc4252 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:11.421743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e8e95-3072-4d6c-b1f9-b417adbc4252 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:11.422165 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e8e95-3072-4d6c-b1f9-b417adbc4252 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:11.423224 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e8e95-3072-4d6c-b1f9-b417adbc4252 None admin] RBAC: Adding query filter params (role.id=669088b4ca4644f4bb586dfeaf427fb0, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=4fa6a9aa611640f893b5e717a094acf7) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:11.423681 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e8e95-3072-4d6c-b1f9-b417adbc4252 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:11.428647 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e8e95-3072-4d6c-b1f9-b417adbc4252 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:11.434187 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 279/586] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:11 2022] GET /identity/v3/role_assignments?user.id=4fa6a9aa611640f893b5e717a094acf7&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=669088b4ca4644f4bb586dfeaf427fb0 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:11.435252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e8e95-3072-4d6c-b1f9-b417adbc4252 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:11.518346 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69752696-2ac2-4bda-b1ce-a8859d3bc731 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:11.519218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:11.578792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e8e95-3072-4d6c-b1f9-b417adbc4252 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:11.584939 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e5662-855e-4ad0-ab00-04df1a2db3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:11.586339 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e5662-855e-4ad0-ab00-04df1a2db3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:11.586841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e5662-855e-4ad0-ab00-04df1a2db3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:11.587317 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e5662-855e-4ad0-ab00-04df1a2db3a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:11.600956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e5662-855e-4ad0-ab00-04df1a2db3a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:11.604460 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e5662-855e-4ad0-ab00-04df1a2db3a9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:11.630322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-947e5662-855e-4ad0-ab00-04df1a2db3a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:11.630322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:11.630322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:11.630322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:11.630322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:11.630322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:11.630322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:11.630322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:11.630322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:11.630322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:11.630322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:11.630322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:11.630322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:11.630322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:11.630322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:11.631566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:11.631566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:11.631566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:11.631566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:11.631566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:11.631566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:11.631566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:11.631566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:11.631566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:11.631566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:11.631566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:11.631566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:11.631566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:11.631566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:11.631566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:11.631566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:11.631566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:11.632649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:11.632649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:11.632649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:11.632649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:11.632649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:11.632649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:11.632649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:11.632649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:11.636339 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd053a-533b-42bf-b406-5de59125a82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:11.637136 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 308/587] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:11.637548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd053a-533b-42bf-b406-5de59125a82b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:11.638010 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd053a-533b-42bf-b406-5de59125a82b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:11.638460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd053a-533b-42bf-b406-5de59125a82b None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:11.638958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e5662-855e-4ad0-ab00-04df1a2db3a9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:11.639851 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd053a-533b-42bf-b406-5de59125a82b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:11.640366 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd053a-533b-42bf-b406-5de59125a82b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:11.643018 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd053a-533b-42bf-b406-5de59125a82b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:11.668622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 280/588] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:11.669721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd053a-533b-42bf-b406-5de59125a82b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:11.722137 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:11.789081 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e5662-855e-4ad0-ab00-04df1a2db3a9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:11.824271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd053a-533b-42bf-b406-5de59125a82b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:11.849222 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca861843-1378-4fac-9b49-11272122efaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:11.850308 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca861843-1378-4fac-9b49-11272122efaf None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:11.850775 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca861843-1378-4fac-9b49-11272122efaf None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:11.851225 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca861843-1378-4fac-9b49-11272122efaf None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:11.851451 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:11.853111 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca861843-1378-4fac-9b49-11272122efaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:11.853288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca861843-1378-4fac-9b49-11272122efaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:11.855346 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca861843-1378-4fac-9b49-11272122efaf None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:11.876324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 309/589] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:11.876324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca861843-1378-4fac-9b49-11272122efaf None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:11.886829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9cdcf-718c-4620-b0a3-71451e4760bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:11.888628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9cdcf-718c-4620-b0a3-71451e4760bd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:11.889168 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9cdcf-718c-4620-b0a3-71451e4760bd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:11.889651 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9cdcf-718c-4620-b0a3-71451e4760bd None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:11.891719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9cdcf-718c-4620-b0a3-71451e4760bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:11.892648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9cdcf-718c-4620-b0a3-71451e4760bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:11.896059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9cdcf-718c-4620-b0a3-71451e4760bd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:11.916146 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 281/590] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:11.917612 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9cdcf-718c-4620-b0a3-71451e4760bd None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:12.035291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca861843-1378-4fac-9b49-11272122efaf None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:12.081769 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:12.095880 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9cdcf-718c-4620-b0a3-71451e4760bd None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:12.101176 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e60f94-8923-483b-9187-feaf39543259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:12.102881 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e60f94-8923-483b-9187-feaf39543259 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:12.103628 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e60f94-8923-483b-9187-feaf39543259 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:12.104309 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e60f94-8923-483b-9187-feaf39543259 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:12.105913 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e60f94-8923-483b-9187-feaf39543259 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:12.106648 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e60f94-8923-483b-9187-feaf39543259 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:12.109413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e60f94-8923-483b-9187-feaf39543259 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:12.131396 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 310/591] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:12.132833 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e60f94-8923-483b-9187-feaf39543259 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:12.156039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c0a66-6d91-41b8-86c9-0fcc5b520b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:12.157263 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c0a66-6d91-41b8-86c9-0fcc5b520b94 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:12.157783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c0a66-6d91-41b8-86c9-0fcc5b520b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:12.158391 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c0a66-6d91-41b8-86c9-0fcc5b520b94 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:12.168506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c0a66-6d91-41b8-86c9-0fcc5b520b94 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:12.170494 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c0a66-6d91-41b8-86c9-0fcc5b520b94 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:12.188190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d94c0a66-6d91-41b8-86c9-0fcc5b520b94 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 19 10:52:12.188190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:12.188190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:12.188190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:12.188190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:12.188190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:12.188190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:12.188190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:12.188190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:12.188190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:12.188190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:12.188190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:12.188190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:12.188190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:12.188190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:12.188190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:12.190075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:12.190075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:12.190075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:12.190075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:12.190075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:12.190075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:12.190075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:12.190075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:12.190075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:12.190075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:12.190075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:12.190075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:12.190075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:12.190075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:12.190075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:12.190075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:12.190075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:12.190075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:12.191890 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:12.191890 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:12.191890 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:12.191890 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:12.191890 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:12.191890 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:12.191890 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:12.191890 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:12.191890 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 19 10:52:12.191890 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:12.191890 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 282/592] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:12.191890 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c0a66-6d91-41b8-86c9-0fcc5b520b94 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:12.256770 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:12.326535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e60f94-8923-483b-9187-feaf39543259 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:12.346723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c0a66-6d91-41b8-86c9-0fcc5b520b94 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:12.370810 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a35c6-441f-48c2-aefb-4ea6137d65d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:12.371893 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a35c6-441f-48c2-aefb-4ea6137d65d0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:12.372306 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a35c6-441f-48c2-aefb-4ea6137d65d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:12.372701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a35c6-441f-48c2-aefb-4ea6137d65d0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:12.382746 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a35c6-441f-48c2-aefb-4ea6137d65d0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:12.384487 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a35c6-441f-48c2-aefb-4ea6137d65d0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:12.404089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-281a35c6-441f-48c2-aefb-4ea6137d65d0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 10:52:12.404089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:12.404089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:12.404089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:12.404089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:12.404089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:12.404089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:12.404089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:12.404089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:12.404089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:12.404089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:12.404089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:12.404089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:12.404089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:12.404089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:12.404089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:12.406208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:12.406208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:12.406208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:12.406208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:12.406208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:12.406208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:12.406208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:12.406208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:12.406208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:12.406208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:12.406208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:12.406208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:12.406208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:12.406208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:12.406208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:12.406208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:12.406208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:12.406208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:12.408016 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:12.408016 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:12.408016 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:12.408016 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:12.408016 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:12.408016 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:12.408016 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:12.408016 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:12.408016 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 10:52:12.408016 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:12.408016 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 311/593] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:52:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:12.408016 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a35c6-441f-48c2-aefb-4ea6137d65d0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:12.421404 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fddc25-4ba0-4cf0-9f27-68fbc3a3c3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:12.423368 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fddc25-4ba0-4cf0-9f27-68fbc3a3c3a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:12.423600 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fddc25-4ba0-4cf0-9f27-68fbc3a3c3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:12.428526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fddc25-4ba0-4cf0-9f27-68fbc3a3c3a2 None admin] PATH_INFO: `/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/3c50a821e9ef44cb9fccd49ee4af7dbf/roles/669088b4ca4644f4bb586dfeaf427fb0` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:12.458249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fddc25-4ba0-4cf0-9f27-68fbc3a3c3a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=789e54670f7c40ffb67f20478aba00f2, user_id=3c50a821e9ef44cb9fccd49ee4af7dbf, role_id=669088b4ca4644f4bb586dfeaf427fb0)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:12.461239 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fddc25-4ba0-4cf0-9f27-68fbc3a3c3a2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:12.483252 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:12.485175 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 283/594] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:52:12 2022] PUT /identity/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/3c50a821e9ef44cb9fccd49ee4af7dbf/roles/669088b4ca4644f4bb586dfeaf427fb0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:52:12.486483 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fddc25-4ba0-4cf0-9f27-68fbc3a3c3a2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:12.596907 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a35c6-441f-48c2-aefb-4ea6137d65d0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:12.668215 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468f9b6-71ba-4a14-b1a7-b811cf7a4739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:12.669699 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468f9b6-71ba-4a14-b1a7-b811cf7a4739 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:12.670145 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468f9b6-71ba-4a14-b1a7-b811cf7a4739 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:12.670576 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468f9b6-71ba-4a14-b1a7-b811cf7a4739 None admin] PATH_INFO: `/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/8112def59003484483552fc76f14e281/roles/669088b4ca4644f4bb586dfeaf427fb0` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:12.703699 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468f9b6-71ba-4a14-b1a7-b811cf7a4739 None admin] RBAC: Authorizing `identity:create_grant(project_id=789e54670f7c40ffb67f20478aba00f2, user_id=8112def59003484483552fc76f14e281, role_id=669088b4ca4644f4bb586dfeaf427fb0)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:12.707989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468f9b6-71ba-4a14-b1a7-b811cf7a4739 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:12.727922 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:12.735569 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 312/595] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:52:12 2022] PUT /identity/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/8112def59003484483552fc76f14e281/roles/669088b4ca4644f4bb586dfeaf427fb0 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:52:12.737290 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468f9b6-71ba-4a14-b1a7-b811cf7a4739 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:12.766082 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fddc25-4ba0-4cf0-9f27-68fbc3a3c3a2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:12.864793 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3546353-07fe-41ea-af30-c022e097a3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:12.867863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3546353-07fe-41ea-af30-c022e097a3ea None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:12.871329 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3546353-07fe-41ea-af30-c022e097a3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:12.872940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3546353-07fe-41ea-af30-c022e097a3ea None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:12.878025 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3546353-07fe-41ea-af30-c022e097a3ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:12.879011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3546353-07fe-41ea-af30-c022e097a3ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:12.886129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3546353-07fe-41ea-af30-c022e097a3ea None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:12.962889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 284/596] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jul 19 10:52:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 477 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:12.965137 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3546353-07fe-41ea-af30-c022e097a3ea None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:12.983528 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:12.991367 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468f9b6-71ba-4a14-b1a7-b811cf7a4739 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:13.038070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19217578-d39c-4b18-b934-fef845e9837a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:13.039735 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19217578-d39c-4b18-b934-fef845e9837a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:13.042509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19217578-d39c-4b18-b934-fef845e9837a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:13.045748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19217578-d39c-4b18-b934-fef845e9837a None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:13.050705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19217578-d39c-4b18-b934-fef845e9837a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:13.051328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19217578-d39c-4b18-b934-fef845e9837a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:13.054323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19217578-d39c-4b18-b934-fef845e9837a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:13.100752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 313/597] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Jul 19 10:52:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:13.106562 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19217578-d39c-4b18-b934-fef845e9837a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:13.238190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3546353-07fe-41ea-af30-c022e097a3ea None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:13.320424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e88c1-ca1a-4f09-87b2-773c30e2f36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:13.322186 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e88c1-ca1a-4f09-87b2-773c30e2f36f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:13.322924 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e88c1-ca1a-4f09-87b2-773c30e2f36f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:13.323642 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e88c1-ca1a-4f09-87b2-773c30e2f36f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:13.362568 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e88c1-ca1a-4f09-87b2-773c30e2f36f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:13.366024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e88c1-ca1a-4f09-87b2-773c30e2f36f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:13.394996 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:13.424759 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19217578-d39c-4b18-b934-fef845e9837a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:13.441538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-cb7e88c1-ca1a-4f09-87b2-773c30e2f36f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:13.441538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:13.441538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:13.441538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:13.441538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:13.441538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:13.441538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:13.441538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:13.441538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:13.441538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:13.441538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:13.441538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:13.441538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:13.441538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:13.441538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:13.443868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:13.443868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:13.443868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:13.443868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:13.443868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:13.443868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:13.443868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:13.443868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:13.443868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:13.443868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:13.443868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:13.443868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:13.443868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:13.443868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:13.443868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:13.443868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:13.443868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:13.445707 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:13.445707 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:13.445707 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:13.445707 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:13.457344 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 285/598] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 493 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:13.467303 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e88c1-ca1a-4f09-87b2-773c30e2f36f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:13.499362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29538ffd-2dc7-4bb8-8033-54fa88c5e751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:13.500863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29538ffd-2dc7-4bb8-8033-54fa88c5e751 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:13.501312 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29538ffd-2dc7-4bb8-8033-54fa88c5e751 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:13.501736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29538ffd-2dc7-4bb8-8033-54fa88c5e751 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:13.523229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29538ffd-2dc7-4bb8-8033-54fa88c5e751 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:13.526278 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29538ffd-2dc7-4bb8-8033-54fa88c5e751 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:13.562898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-29538ffd-2dc7-4bb8-8033-54fa88c5e751 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:13.562898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:13.562898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:13.562898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:13.562898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:13.562898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:13.562898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:13.562898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:13.562898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:13.562898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:13.562898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:13.562898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:13.562898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:13.562898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:13.562898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:13.564677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:13.564677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:13.564677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:13.564677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:13.564677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:13.564677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:13.564677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:13.564677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:13.564677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:13.564677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:13.564677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:13.564677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:13.564677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:13.564677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:13.564677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:13.564677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:13.564677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:13.566422 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:13.566422 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:13.566422 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:13.566422 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:13.566422 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 314/599] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 460 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:13.577175 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29538ffd-2dc7-4bb8-8033-54fa88c5e751 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:13.582560 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:13.719166 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e88c1-ca1a-4f09-87b2-773c30e2f36f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:13.784523 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934ddb3-f53f-4072-9e8f-ce48f972b653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:13.785580 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934ddb3-f53f-4072-9e8f-ce48f972b653 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:13.786062 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934ddb3-f53f-4072-9e8f-ce48f972b653 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:13.786553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934ddb3-f53f-4072-9e8f-ce48f972b653 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:13.788011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934ddb3-f53f-4072-9e8f-ce48f972b653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:13.788566 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934ddb3-f53f-4072-9e8f-ce48f972b653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:13.791228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934ddb3-f53f-4072-9e8f-ce48f972b653 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:13.815111 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 286/600] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:13.825562 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934ddb3-f53f-4072-9e8f-ce48f972b653 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:13.883939 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29538ffd-2dc7-4bb8-8033-54fa88c5e751 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:13.949027 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:14.029715 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934ddb3-f53f-4072-9e8f-ce48f972b653 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:14.042954 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f9666-f721-4bf8-a8c8-f0884b064219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:14.043894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f9666-f721-4bf8-a8c8-f0884b064219 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:14.044326 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f9666-f721-4bf8-a8c8-f0884b064219 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:14.044789 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f9666-f721-4bf8-a8c8-f0884b064219 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:14.046003 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f9666-f721-4bf8-a8c8-f0884b064219 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:14.046488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f9666-f721-4bf8-a8c8-f0884b064219 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:14.057019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f9666-f721-4bf8-a8c8-f0884b064219 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:14.095205 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc4260-8270-4912-b252-096d21602635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:14.096570 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc4260-8270-4912-b252-096d21602635 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:14.097201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc4260-8270-4912-b252-096d21602635 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:14.097694 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc4260-8270-4912-b252-096d21602635 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:14.100532 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 315/601] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 524 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:14.111848 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc4260-8270-4912-b252-096d21602635 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:14.114285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f9666-f721-4bf8-a8c8-f0884b064219 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:14.114619 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc4260-8270-4912-b252-096d21602635 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:14.143564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-7fcc4260-8270-4912-b252-096d21602635 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:14.143564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:14.143564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:14.143564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:14.143564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:14.143564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:14.143564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:14.143564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:14.143564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:14.143564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:14.143564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:14.143564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:14.143564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:14.143564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:14.143564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:14.145604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:14.145604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:14.145604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:14.145604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:14.145604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:14.145604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:14.145604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:14.145604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:14.145604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:14.145604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:14.145604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:14.145604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:14.145604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:14.145604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:14.145604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:14.145604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:14.145604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:14.147268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:14.147268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:14.147268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:14.147268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:14.147268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:14.147268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:14.147268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:14.147268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:14.148011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 287/602] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:14.158223 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc4260-8270-4912-b252-096d21602635 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:14.295252 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:14.324069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc4260-8270-4912-b252-096d21602635 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:14.351989 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:14.363753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f9666-f721-4bf8-a8c8-f0884b064219 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:14.386249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ac1ee-553f-44c8-8f29-f9adc536d428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:14.387819 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ac1ee-553f-44c8-8f29-f9adc536d428 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:14.388233 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ac1ee-553f-44c8-8f29-f9adc536d428 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:14.388755 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ac1ee-553f-44c8-8f29-f9adc536d428 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:14.391122 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ac1ee-553f-44c8-8f29-f9adc536d428 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:14.391711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ac1ee-553f-44c8-8f29-f9adc536d428 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:14.395196 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ac1ee-553f-44c8-8f29-f9adc536d428 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:14.413096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 288/603] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:14.414505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4bbbc-89df-4ee9-afc2-852e8a15ffdf None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:14.414793 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4bbbc-89df-4ee9-afc2-852e8a15ffdf None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:14.415074 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4bbbc-89df-4ee9-afc2-852e8a15ffdf None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:14.415256 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6582da-9f79-4a2f-b491-532a3dd4a3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:14.416687 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6582da-9f79-4a2f-b491-532a3dd4a3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:14.417258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6582da-9f79-4a2f-b491-532a3dd4a3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:14.417689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6582da-9f79-4a2f-b491-532a3dd4a3a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:14.420830 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 289/604] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:14.423167 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d702d3-810e-4d08-a0d5-ae408c95cce0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:14.423418 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d702d3-810e-4d08-a0d5-ae408c95cce0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:14.423694 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d702d3-810e-4d08-a0d5-ae408c95cce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:14.431866 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6582da-9f79-4a2f-b491-532a3dd4a3a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:14.433411 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6582da-9f79-4a2f-b491-532a3dd4a3a1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:14.455656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-cd6582da-9f79-4a2f-b491-532a3dd4a3a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:14.455656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:14.455656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:14.455656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:14.455656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:14.455656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:14.455656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:14.455656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:14.455656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:14.455656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:14.455656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:14.455656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:14.455656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:14.455656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:14.455656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:14.457695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:14.457695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:14.457695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:14.457695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:14.457695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:14.457695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:14.457695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:14.457695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:14.457695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:14.457695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:14.457695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:14.457695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:14.457695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:14.457695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:14.457695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:14.457695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:14.457695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:14.459479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:14.459479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:14.459479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:14.459479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:14.459479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:14.459479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:14.459479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:14.459479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:14.459479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 316/605] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:14.459479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6582da-9f79-4a2f-b491-532a3dd4a3a1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:14.466566 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-07d702d3-810e-4d08-a0d5-ae408c95cce0 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:14.469545 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-07d702d3-810e-4d08-a0d5-ae408c95cce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:14.549696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 290/606] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:14.550834 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d702d3-810e-4d08-a0d5-ae408c95cce0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:14.629255 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6582da-9f79-4a2f-b491-532a3dd4a3a1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:14.659925 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d702d3-810e-4d08-a0d5-ae408c95cce0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:14.666382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c25255-feec-41d1-b6b5-7437c14cbb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:14.667702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c25255-feec-41d1-b6b5-7437c14cbb2a None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:14.668038 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c25255-feec-41d1-b6b5-7437c14cbb2a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:14.668421 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c25255-feec-41d1-b6b5-7437c14cbb2a None admin] PATH_INFO: `/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/d1bcfbee5a5e4016a77901d0a637da63/roles/669088b4ca4644f4bb586dfeaf427fb0` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:14.669754 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:14.672012 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:14.689300 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c25255-feec-41d1-b6b5-7437c14cbb2a None admin] RBAC: Authorizing `identity:create_grant(project_id=789e54670f7c40ffb67f20478aba00f2, user_id=d1bcfbee5a5e4016a77901d0a637da63, role_id=669088b4ca4644f4bb586dfeaf427fb0)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:14.690955 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c25255-feec-41d1-b6b5-7437c14cbb2a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:14.702276 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf31748-2e69-416b-be4d-99b24a66e9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:14.703190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf31748-2e69-416b-be4d-99b24a66e9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:14.703541 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf31748-2e69-416b-be4d-99b24a66e9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:14.703919 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf31748-2e69-416b-be4d-99b24a66e9c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:14.704816 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf31748-2e69-416b-be4d-99b24a66e9c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:14.705202 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf31748-2e69-416b-be4d-99b24a66e9c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:14.706742 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf31748-2e69-416b-be4d-99b24a66e9c4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:14.712062 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 317/607] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:52:14 2022] PUT /identity/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/d1bcfbee5a5e4016a77901d0a637da63/roles/669088b4ca4644f4bb586dfeaf427fb0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:52:14.713211 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c25255-feec-41d1-b6b5-7437c14cbb2a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:14.721304 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 291/608] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:14.730044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf31748-2e69-416b-be4d-99b24a66e9c4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:14.837574 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c25255-feec-41d1-b6b5-7437c14cbb2a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:14.886585 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9d116-cbbb-4eda-af4b-de4531840429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:14.887555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9d116-cbbb-4eda-af4b-de4531840429 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:14.887972 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9d116-cbbb-4eda-af4b-de4531840429 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:14.888249 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9d116-cbbb-4eda-af4b-de4531840429 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:14.904320 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9d116-cbbb-4eda-af4b-de4531840429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:14.913712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-48e9d116-cbbb-4eda-af4b-de4531840429 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:14.913712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:14.913712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:14.913712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:14.913712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:14.913712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:14.913712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:14.913712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:14.913712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:14.913712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:14.913712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:14.913712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:14.913712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:14.913712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:14.913712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:14.913712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:14.914919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:14.914919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:14.914919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:14.914919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:14.914919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:14.914919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:14.914919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:14.914919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:14.914919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:14.914919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:14.914919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:14.914919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:14.914919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:14.914919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:14.914919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:14.914919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:14.915863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:14.915863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:14.915863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:14.915863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:14.915863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:14.915863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:14.915863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:14.915863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:14.915863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:14.915863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:14.915863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:14.915863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:14.917075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 318/609] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:52:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:14.924814 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9d116-cbbb-4eda-af4b-de4531840429 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:14.953458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf31748-2e69-416b-be4d-99b24a66e9c4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:15.012681 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:15.058571 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97299f76-79ef-4b97-a1ac-6be5aad34e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:15.059902 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97299f76-79ef-4b97-a1ac-6be5aad34e72 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:15.060460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97299f76-79ef-4b97-a1ac-6be5aad34e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:15.061035 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97299f76-79ef-4b97-a1ac-6be5aad34e72 None admin] PATH_INFO: `/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/07eaacc831ae481d99e8ab03ee295e23/roles/669088b4ca4644f4bb586dfeaf427fb0` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:15.098907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97299f76-79ef-4b97-a1ac-6be5aad34e72 None admin] RBAC: Authorizing `identity:create_grant(project_id=789e54670f7c40ffb67f20478aba00f2, user_id=07eaacc831ae481d99e8ab03ee295e23, role_id=669088b4ca4644f4bb586dfeaf427fb0)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:15.101057 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97299f76-79ef-4b97-a1ac-6be5aad34e72 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:15.130171 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 292/610] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:52:14 2022] PUT /identity/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/07eaacc831ae481d99e8ab03ee295e23/roles/669088b4ca4644f4bb586dfeaf427fb0 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:52:15.144108 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9d116-cbbb-4eda-af4b-de4531840429 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:15.205777 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dabdc4-95e1-4ee2-806a-a345d1e06db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:15.207006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dabdc4-95e1-4ee2-806a-a345d1e06db8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:15.207532 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dabdc4-95e1-4ee2-806a-a345d1e06db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:15.208058 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dabdc4-95e1-4ee2-806a-a345d1e06db8 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:15.209147 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dabdc4-95e1-4ee2-806a-a345d1e06db8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:15.209674 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dabdc4-95e1-4ee2-806a-a345d1e06db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:15.211346 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dabdc4-95e1-4ee2-806a-a345d1e06db8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:15.235706 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 319/611] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 19 10:52:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:15.238751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97299f76-79ef-4b97-a1ac-6be5aad34e72 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:15.278016 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:15.401822 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97299f76-79ef-4b97-a1ac-6be5aad34e72 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:15.448146 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f60cc2-9fff-4a2a-b51b-89fdf4e8da36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:15.449370 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f60cc2-9fff-4a2a-b51b-89fdf4e8da36 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:15.449873 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f60cc2-9fff-4a2a-b51b-89fdf4e8da36 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:15.450336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f60cc2-9fff-4a2a-b51b-89fdf4e8da36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:15.463311 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f60cc2-9fff-4a2a-b51b-89fdf4e8da36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:15.465222 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f60cc2-9fff-4a2a-b51b-89fdf4e8da36 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:15.486228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-86f60cc2-9fff-4a2a-b51b-89fdf4e8da36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:15.486228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:15.486228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:15.486228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:15.486228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:15.486228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:15.486228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:15.486228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:15.486228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:15.486228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:15.486228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:15.486228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:15.486228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:15.486228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:15.486228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:15.487581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:15.487581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:15.487581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:15.487581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:15.487581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:15.487581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:15.487581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:15.487581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:15.487581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:15.487581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:15.487581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:15.487581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:15.487581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:15.487581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:15.487581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:15.487581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:15.487581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:15.488450 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:15.488450 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:15.488450 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:15.488450 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:15.495489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 293/612] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:15.497430 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dabdc4-95e1-4ee2-806a-a345d1e06db8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:15.627930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:15.635691 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dabdc4-95e1-4ee2-806a-a345d1e06db8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:15.672964 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fb7bf-98c9-469d-b99f-acfa01625534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:15.673985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fb7bf-98c9-469d-b99f-acfa01625534 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:15.674472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fb7bf-98c9-469d-b99f-acfa01625534 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:15.674950 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fb7bf-98c9-469d-b99f-acfa01625534 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:15.675875 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fb7bf-98c9-469d-b99f-acfa01625534 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:15.676376 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fb7bf-98c9-469d-b99f-acfa01625534 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:15.678155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fb7bf-98c9-469d-b99f-acfa01625534 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:15.696862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 320/613] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:15.698902 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f60cc2-9fff-4a2a-b51b-89fdf4e8da36 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:15.785431 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:15.813566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df29828-61e9-46ff-8e31-ad40a0c457b8 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:15.814164 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df29828-61e9-46ff-8e31-ad40a0c457b8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:15.814566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df29828-61e9-46ff-8e31-ad40a0c457b8 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:15.816913 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 321/614] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:15.822425 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330538c-9e57-4259-9f2c-141b4dba3d10 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:15.822728 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330538c-9e57-4259-9f2c-141b4dba3d10 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:15.822962 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330538c-9e57-4259-9f2c-141b4dba3d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:15.839210 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f60cc2-9fff-4a2a-b51b-89fdf4e8da36 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:15.851409 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f330538c-9e57-4259-9f2c-141b4dba3d10 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:15.853842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f330538c-9e57-4259-9f2c-141b4dba3d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:15.883771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ec4ac-0588-43ae-b416-cb0da5a6d7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:15.885058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ec4ac-0588-43ae-b416-cb0da5a6d7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:15.885539 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ec4ac-0588-43ae-b416-cb0da5a6d7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:15.886008 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ec4ac-0588-43ae-b416-cb0da5a6d7d2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:15.895044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ec4ac-0588-43ae-b416-cb0da5a6d7d2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:15.897267 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ec4ac-0588-43ae-b416-cb0da5a6d7d2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:15.915218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-af4ec4ac-0588-43ae-b416-cb0da5a6d7d2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:52:15.915218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:15.915218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:15.915218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:15.915218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:15.915218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:15.915218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:15.915218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:15.915218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:15.915218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:15.915218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:15.915218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:15.915218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:15.915218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:15.915218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:15.915218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:15.916217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:15.916217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:15.916217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:15.916217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:15.916217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:15.916217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:15.916217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:15.916217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:15.916217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:15.916217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:15.916217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:15.916217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:15.916217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:15.916217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:15.916217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:15.916217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:15.916217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:15.916217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:15.917153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:15.917153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:15.917153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:15.917153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:15.917153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:15.917153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:15.917153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:15.917153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:15.917153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:52:15.917153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:15.920046 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 294/615] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:52:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:15.921934 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e051e-03f5-4ecd-a7b3-45ecca54993e None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:15.922470 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e051e-03f5-4ecd-a7b3-45ecca54993e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:15.922935 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e051e-03f5-4ecd-a7b3-45ecca54993e None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:15.925398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 295/616] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:15.926571 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e051e-03f5-4ecd-a7b3-45ecca54993e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:15.948462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 322/617] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:15.949918 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7158b7-8783-4a4b-957b-e52106694b8e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:15.950211 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7158b7-8783-4a4b-957b-e52106694b8e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:15.950487 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7158b7-8783-4a4b-957b-e52106694b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:15.976334 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2b7158b7-8783-4a4b-957b-e52106694b8e None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:15.977943 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2b7158b7-8783-4a4b-957b-e52106694b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:16.052989 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e051e-03f5-4ecd-a7b3-45ecca54993e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:16.057642 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 323/618] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:16.058363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7158b7-8783-4a4b-957b-e52106694b8e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:16.078380 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:16.094642 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:16.103279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed18ede-423d-4b08-a534-67d518a1453b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:16.104369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed18ede-423d-4b08-a534-67d518a1453b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:16.104898 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed18ede-423d-4b08-a534-67d518a1453b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:16.105390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed18ede-423d-4b08-a534-67d518a1453b None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:16.106443 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed18ede-423d-4b08-a534-67d518a1453b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:16.106958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed18ede-423d-4b08-a534-67d518a1453b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:16.108668 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed18ede-423d-4b08-a534-67d518a1453b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:16.131347 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 296/619] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jul 19 10:52:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:16.132623 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed18ede-423d-4b08-a534-67d518a1453b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:16.184048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7158b7-8783-4a4b-957b-e52106694b8e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:16.226187 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a3946-debe-4dc0-9bfb-9f77a0722085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:16.227370 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a3946-debe-4dc0-9bfb-9f77a0722085 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:16.227650 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a3946-debe-4dc0-9bfb-9f77a0722085 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:16.227920 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a3946-debe-4dc0-9bfb-9f77a0722085 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:16.242941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a3946-debe-4dc0-9bfb-9f77a0722085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:16.251639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-4f5a3946-debe-4dc0-9bfb-9f77a0722085 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:16.251639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:16.251639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:16.251639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:16.251639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:16.251639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:16.251639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:16.251639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:16.251639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:16.251639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:16.251639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:16.251639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:16.251639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:16.251639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:16.251639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:16.251639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:16.252664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:16.252664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:16.252664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:16.252664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:16.252664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:16.252664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:16.252664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:16.252664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:16.252664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:16.252664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:16.252664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:16.252664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:16.252664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:16.252664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:16.252664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:16.252664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:16.253659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:16.253659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:16.253659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:16.253659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:16.253659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:16.253659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:16.253659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:16.253659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:16.253659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:16.253659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:16.253659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:16.253659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:16.260251 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 324/620] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:52:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:16.260251 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a3946-debe-4dc0-9bfb-9f77a0722085 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:16.274353 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed18ede-423d-4b08-a534-67d518a1453b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:16.320371 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd45f52-58fb-4aad-82a7-7af08e7de8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:16.321866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd45f52-58fb-4aad-82a7-7af08e7de8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:16.322992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd45f52-58fb-4aad-82a7-7af08e7de8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:16.323521 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd45f52-58fb-4aad-82a7-7af08e7de8c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:16.340334 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd45f52-58fb-4aad-82a7-7af08e7de8c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:16.352071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-8dd45f52-58fb-4aad-82a7-7af08e7de8c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:16.352071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:16.352071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:16.352071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:16.352071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:16.352071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:16.352071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:16.352071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:16.352071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:16.352071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:16.352071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:16.352071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:16.352071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:16.352071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:16.352071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:16.352071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:16.353124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:16.353124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:16.353124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:16.353124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:16.353124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:16.353124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:16.353124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:16.353124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:16.353124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:16.353124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:16.353124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:16.353124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:16.353124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:16.353124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:16.353124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:16.353124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:16.353960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:16.353960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:16.353960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:16.353960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:16.353960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:16.353960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:16.353960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:16.353960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:16.353960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:16.353960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:16.353960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:16.353960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:16.357421 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 297/621] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:52:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:16.358866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd45f52-58fb-4aad-82a7-7af08e7de8c2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:16.370926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:16.400217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a3946-debe-4dc0-9bfb-9f77a0722085 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:16.425172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:16.446173 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e6651-e4a1-4ac0-baf6-9bb4642b447d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:16.447305 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e6651-e4a1-4ac0-baf6-9bb4642b447d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:16.447834 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e6651-e4a1-4ac0-baf6-9bb4642b447d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:16.448260 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e6651-e4a1-4ac0-baf6-9bb4642b447d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:16.462431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e6651-e4a1-4ac0-baf6-9bb4642b447d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:16.464234 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e6651-e4a1-4ac0-baf6-9bb4642b447d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:16.484431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-3d5e6651-e4a1-4ac0-baf6-9bb4642b447d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:16.484431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:16.484431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:16.484431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:16.484431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:16.484431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:16.484431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:16.484431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:16.484431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:16.484431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:16.484431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:16.484431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:16.484431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:16.484431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:16.484431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:16.485413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:16.485413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:16.485413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:16.485413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:16.485413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:16.485413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:16.485413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:16.485413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:16.485413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:16.485413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:16.485413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:16.485413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:16.485413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:16.485413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:16.485413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:16.485413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:16.485413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:16.486270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:16.486270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:16.486270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:16.486270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:16.486592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd45f52-58fb-4aad-82a7-7af08e7de8c2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:16.488996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 325/622] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:16.490204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e6651-e4a1-4ac0-baf6-9bb4642b447d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:16.525867 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad830eba-b869-4a83-92e0-d5f12d4a70d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:16.526584 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad830eba-b869-4a83-92e0-d5f12d4a70d0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:16.526873 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad830eba-b869-4a83-92e0-d5f12d4a70d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:16.527156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad830eba-b869-4a83-92e0-d5f12d4a70d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:16.528045 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad830eba-b869-4a83-92e0-d5f12d4a70d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:16.528268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad830eba-b869-4a83-92e0-d5f12d4a70d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:16.529803 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad830eba-b869-4a83-92e0-d5f12d4a70d0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:16.544958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 298/623] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 19 10:52:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:16.545850 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad830eba-b869-4a83-92e0-d5f12d4a70d0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:16.613801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e6651-e4a1-4ac0-baf6-9bb4642b447d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:16.649190 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:16.656104 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad830eba-b869-4a83-92e0-d5f12d4a70d0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:16.657435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007abaa2-964a-4b53-a9c2-1922fd7f19a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:16.660013 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007abaa2-964a-4b53-a9c2-1922fd7f19a2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:16.660586 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007abaa2-964a-4b53-a9c2-1922fd7f19a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:16.661108 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007abaa2-964a-4b53-a9c2-1922fd7f19a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:16.662245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007abaa2-964a-4b53-a9c2-1922fd7f19a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:16.662825 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007abaa2-964a-4b53-a9c2-1922fd7f19a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:16.664453 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007abaa2-964a-4b53-a9c2-1922fd7f19a2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:16.670743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:16.679231 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 326/624] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 19 10:52:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:16.680539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007abaa2-964a-4b53-a9c2-1922fd7f19a2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:16.704246 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b26af0-7877-4909-b415-dd9d8d8aae8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:16.704902 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b26af0-7877-4909-b415-dd9d8d8aae8e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:16.705189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b26af0-7877-4909-b415-dd9d8d8aae8e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:16.705464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b26af0-7877-4909-b415-dd9d8d8aae8e None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:16.706200 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b26af0-7877-4909-b415-dd9d8d8aae8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:16.706660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b26af0-7877-4909-b415-dd9d8d8aae8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:16.708119 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b26af0-7877-4909-b415-dd9d8d8aae8e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:16.722671 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 299/625] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:16.723732 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b26af0-7877-4909-b415-dd9d8d8aae8e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:16.841422 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007abaa2-964a-4b53-a9c2-1922fd7f19a2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:16.863591 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b26af0-7877-4909-b415-dd9d8d8aae8e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:16.915173 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83468c5b-2061-4272-a504-c3ff7b44cb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:16.917436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83468c5b-2061-4272-a504-c3ff7b44cb63 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:16.918413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83468c5b-2061-4272-a504-c3ff7b44cb63 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:16.919204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83468c5b-2061-4272-a504-c3ff7b44cb63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:16.923946 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f88ec8-b53b-4cba-8a63-e47d41ee4d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:16.925778 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f88ec8-b53b-4cba-8a63-e47d41ee4d21 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:16.925778 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f88ec8-b53b-4cba-8a63-e47d41ee4d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:16.926359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f88ec8-b53b-4cba-8a63-e47d41ee4d21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:16.942593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83468c5b-2061-4272-a504-c3ff7b44cb63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:16.945114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f88ec8-b53b-4cba-8a63-e47d41ee4d21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:16.946302 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83468c5b-2061-4272-a504-c3ff7b44cb63 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:16.947906 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f88ec8-b53b-4cba-8a63-e47d41ee4d21 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:16.973509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-83468c5b-2061-4272-a504-c3ff7b44cb63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:16.973509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:16.973509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:16.973509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:16.973509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:16.973509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:16.973509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:16.973509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:16.973509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:16.973509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:16.973509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:16.973509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:16.973509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:16.973509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:16.973509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:16.975764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:16.975764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:16.975764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:16.975764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:16.975764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:16.975764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:16.975764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:16.975764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:16.975764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:16.975764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:16.975764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:16.975764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:16.975764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:16.975764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:16.975764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:16.975764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:16.975764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:16.977706 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:16.977706 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:16.977706 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:16.977706 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:16.988928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 327/626] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:16.988928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83468c5b-2061-4272-a504-c3ff7b44cb63 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:16.989183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-37f88ec8-b53b-4cba-8a63-e47d41ee4d21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:16.989183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:16.989183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:16.989183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:16.989183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:16.989183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:16.989183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:16.989183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:16.989183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:16.989183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:16.989183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:16.989183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:16.989183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:16.989183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:16.989183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:16.990052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:16.990052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:16.990052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:16.990052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:16.990052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:16.990052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:16.990052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:16.990052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:16.990052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:16.990052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:16.990052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:16.990052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:16.990052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:16.990052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:16.990052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:16.990052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:16.990052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:16.991030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:16.991030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:16.991030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:16.991030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:16.991030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 300/627] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:16.991030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f88ec8-b53b-4cba-8a63-e47d41ee4d21 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:17.020755 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:17.082655 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:17.149325 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83468c5b-2061-4272-a504-c3ff7b44cb63 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:17.154415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f88ec8-b53b-4cba-8a63-e47d41ee4d21 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:17.186363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc724bf9-44b7-4c48-8e72-b8f58fb34047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:17.187500 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc724bf9-44b7-4c48-8e72-b8f58fb34047 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:17.187963 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc724bf9-44b7-4c48-8e72-b8f58fb34047 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:17.188432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc724bf9-44b7-4c48-8e72-b8f58fb34047 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:17.196932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc724bf9-44b7-4c48-8e72-b8f58fb34047 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:17.198719 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc724bf9-44b7-4c48-8e72-b8f58fb34047 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:17.214401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-fc724bf9-44b7-4c48-8e72-b8f58fb34047 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:17.214401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:17.214401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:17.214401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:17.214401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:17.214401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:17.214401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:17.214401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:17.214401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:17.214401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:17.214401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:17.214401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:17.214401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:17.214401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:17.214401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:17.215391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:17.215391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:17.215391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:17.215391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:17.215391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:17.215391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:17.215391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:17.215391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:17.215391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:17.215391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:17.215391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:17.215391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:17.215391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:17.215391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:17.215391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:17.215391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:17.215391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:17.216268 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:17.216268 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:17.216268 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:17.216268 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:17.216268 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:17.216268 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:17.216268 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:17.216268 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:17.219253 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 328/628] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:17.220385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc724bf9-44b7-4c48-8e72-b8f58fb34047 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:17.231253 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446990f3-4659-408b-bb2e-58c619f1a2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:17.232283 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446990f3-4659-408b-bb2e-58c619f1a2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:17.232806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446990f3-4659-408b-bb2e-58c619f1a2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:17.233302 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446990f3-4659-408b-bb2e-58c619f1a2b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:17.234818 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446990f3-4659-408b-bb2e-58c619f1a2b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:17.235375 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446990f3-4659-408b-bb2e-58c619f1a2b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:17.237981 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446990f3-4659-408b-bb2e-58c619f1a2b7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:17.266842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 301/629] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:17.266842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446990f3-4659-408b-bb2e-58c619f1a2b7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:17.343852 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc724bf9-44b7-4c48-8e72-b8f58fb34047 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:17.346199 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:17.386283 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a942d-352b-4f2a-af53-843da4638551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:17.387340 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a942d-352b-4f2a-af53-843da4638551 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:17.387798 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a942d-352b-4f2a-af53-843da4638551 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:17.388243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a942d-352b-4f2a-af53-843da4638551 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:17.389198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a942d-352b-4f2a-af53-843da4638551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:17.389689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a942d-352b-4f2a-af53-843da4638551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:17.391310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a942d-352b-4f2a-af53-843da4638551 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:17.410923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 329/630] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:17.412319 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a942d-352b-4f2a-af53-843da4638551 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:17.465867 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:17.502311 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446990f3-4659-408b-bb2e-58c619f1a2b7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:17.539372 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a942d-352b-4f2a-af53-843da4638551 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:17.564176 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b27fd-20aa-401e-b49f-7bfe63952fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:17.565875 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b27fd-20aa-401e-b49f-7bfe63952fad None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:17.566328 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b27fd-20aa-401e-b49f-7bfe63952fad None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:17.566767 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b27fd-20aa-401e-b49f-7bfe63952fad None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:17.567664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b27fd-20aa-401e-b49f-7bfe63952fad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:17.568156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b27fd-20aa-401e-b49f-7bfe63952fad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:17.570072 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b27fd-20aa-401e-b49f-7bfe63952fad None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:17.581467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbd6c9-646a-4212-ba91-c8fe7dce698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:17.582593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbd6c9-646a-4212-ba91-c8fe7dce698e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:17.583017 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbd6c9-646a-4212-ba91-c8fe7dce698e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:17.583357 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbd6c9-646a-4212-ba91-c8fe7dce698e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:17.585958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 302/631] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:17.586779 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b27fd-20aa-401e-b49f-7bfe63952fad None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:17.596048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbd6c9-646a-4212-ba91-c8fe7dce698e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:17.598164 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbd6c9-646a-4212-ba91-c8fe7dce698e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:17.615103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-aebbd6c9-646a-4212-ba91-c8fe7dce698e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 10:52:17.615103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:17.615103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:17.615103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:17.615103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:17.615103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:17.615103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:17.615103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:17.615103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:17.615103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:17.615103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:17.615103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:17.615103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:17.615103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:17.615103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:17.615103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:17.617105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:17.617105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:17.617105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:17.617105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:17.617105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:17.617105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:17.617105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:17.617105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:17.617105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:17.617105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:17.617105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:17.617105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:17.617105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:17.617105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:17.617105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:17.617105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:17.617105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:17.617105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:17.618941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:17.618941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:17.618941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:17.618941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:17.618941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:17.618941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:17.618941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:17.618941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:17.618941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 10:52:17.618941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:17.618941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 330/632] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:17.618941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ed290-40b4-49b1-bc6a-dfd779f6d050 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:17.618941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ed290-40b4-49b1-bc6a-dfd779f6d050 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:17.620298 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ed290-40b4-49b1-bc6a-dfd779f6d050 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:17.620298 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 331/633] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:17.621928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f77fc3-bf53-4b81-b925-cc73745b7289 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:17.622448 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f77fc3-bf53-4b81-b925-cc73745b7289 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:17.622952 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f77fc3-bf53-4b81-b925-cc73745b7289 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:17.625476 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 332/634] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:17.626756 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f77fc3-bf53-4b81-b925-cc73745b7289 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:17.653693 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:17.737867 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b27fd-20aa-401e-b49f-7bfe63952fad None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:17.784746 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f77fc3-bf53-4b81-b925-cc73745b7289 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:17.788745 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69ac6c-2e19-4c10-8e99-ae5b4f8dbcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:17.789593 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69ac6c-2e19-4c10-8e99-ae5b4f8dbcfb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:17.789875 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69ac6c-2e19-4c10-8e99-ae5b4f8dbcfb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:17.790147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69ac6c-2e19-4c10-8e99-ae5b4f8dbcfb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:17.803775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69ac6c-2e19-4c10-8e99-ae5b4f8dbcfb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:17.806542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69ac6c-2e19-4c10-8e99-ae5b4f8dbcfb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:17.824978 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daaf4a1-1282-4bb8-a915-62a763561b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:17.826036 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daaf4a1-1282-4bb8-a915-62a763561b2d None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:17.826402 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daaf4a1-1282-4bb8-a915-62a763561b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:17.826778 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daaf4a1-1282-4bb8-a915-62a763561b2d None admin] PATH_INFO: `/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/4fa6a9aa611640f893b5e717a094acf7/roles/669088b4ca4644f4bb586dfeaf427fb0` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:17.834277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-1a69ac6c-2e19-4c10-8e99-ae5b4f8dbcfb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:52:17.834277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:17.834277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:17.834277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:17.834277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:17.834277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:17.834277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:17.834277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:17.834277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:17.834277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:17.834277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:17.834277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:17.834277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:17.834277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:17.834277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:17.834277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:17.835356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:17.835356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:17.835356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:17.835356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:17.835356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:17.835356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:17.835356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:17.835356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:17.835356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:17.835356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:17.835356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:17.835356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:17.835356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:17.835356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:17.835356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:17.835356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:17.835356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:17.835356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:17.836601 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:17.836601 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:17.836601 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:17.836601 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:17.836601 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:17.836601 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:17.836601 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:17.836601 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:17.836601 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:52:17.836601 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:17.836601 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 303/635] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 19 10:52:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:17.838112 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69ac6c-2e19-4c10-8e99-ae5b4f8dbcfb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:17.841657 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:17.850725 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daaf4a1-1282-4bb8-a915-62a763561b2d None admin] RBAC: Authorizing `identity:create_grant(project_id=789e54670f7c40ffb67f20478aba00f2, user_id=4fa6a9aa611640f893b5e717a094acf7, role_id=669088b4ca4644f4bb586dfeaf427fb0)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:17.852911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daaf4a1-1282-4bb8-a915-62a763561b2d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:17.870431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 333/636] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:52:17 2022] PUT /identity/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/4fa6a9aa611640f893b5e717a094acf7/roles/669088b4ca4644f4bb586dfeaf427fb0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:52:17.872758 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39718776-561e-4b5b-b81d-3eda2113488a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:17.873250 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39718776-561e-4b5b-b81d-3eda2113488a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:17.873708 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39718776-561e-4b5b-b81d-3eda2113488a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:17.901200 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-39718776-561e-4b5b-b81d-3eda2113488a None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:17.903158 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-39718776-561e-4b5b-b81d-3eda2113488a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:18.011223 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69ac6c-2e19-4c10-8e99-ae5b4f8dbcfb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:18.032765 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 334/637] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:18.032765 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602e59e-da2c-46ae-84f5-9f7951cb9e4d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:18.032765 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602e59e-da2c-46ae-84f5-9f7951cb9e4d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:18.032765 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602e59e-da2c-46ae-84f5-9f7951cb9e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:18.034321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:18.057424 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3602e59e-da2c-46ae-84f5-9f7951cb9e4d None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:18.059249 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3602e59e-da2c-46ae-84f5-9f7951cb9e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:18.090012 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d8984-8ad2-4d4d-91bf-61f6b4958ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:18.090714 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d8984-8ad2-4d4d-91bf-61f6b4958ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:18.091000 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d8984-8ad2-4d4d-91bf-61f6b4958ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:18.091277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d8984-8ad2-4d4d-91bf-61f6b4958ac8 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:18.092139 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d8984-8ad2-4d4d-91bf-61f6b4958ac8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:18.092453 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d8984-8ad2-4d4d-91bf-61f6b4958ac8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:18.094123 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d8984-8ad2-4d4d-91bf-61f6b4958ac8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:18.116397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 304/638] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jul 19 10:52:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:18.120689 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d8984-8ad2-4d4d-91bf-61f6b4958ac8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:18.185833 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 335/639] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:18.190048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602e59e-da2c-46ae-84f5-9f7951cb9e4d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:18.214199 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:18.294245 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d8984-8ad2-4d4d-91bf-61f6b4958ac8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:18.355618 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de1280-7870-4d9d-84e0-7561c43f963f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:18.356531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de1280-7870-4d9d-84e0-7561c43f963f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:18.357038 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de1280-7870-4d9d-84e0-7561c43f963f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:18.357501 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de1280-7870-4d9d-84e0-7561c43f963f None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:18.358983 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de1280-7870-4d9d-84e0-7561c43f963f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:18.359504 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de1280-7870-4d9d-84e0-7561c43f963f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:18.361744 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de1280-7870-4d9d-84e0-7561c43f963f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:18.371651 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602e59e-da2c-46ae-84f5-9f7951cb9e4d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:18.393538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 305/640] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 19 10:52:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:18.395264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de1280-7870-4d9d-84e0-7561c43f963f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:18.428181 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:18.435186 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189667a3-f99f-411a-898e-4ff4b0bedd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:18.436205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189667a3-f99f-411a-898e-4ff4b0bedd3b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:18.436614 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189667a3-f99f-411a-898e-4ff4b0bedd3b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:18.437080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189667a3-f99f-411a-898e-4ff4b0bedd3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:18.454452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189667a3-f99f-411a-898e-4ff4b0bedd3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:18.464027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-189667a3-f99f-411a-898e-4ff4b0bedd3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:18.464027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:18.464027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:18.464027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:18.464027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:18.464027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:18.464027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:18.464027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:18.464027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:18.464027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:18.464027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:18.464027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:18.464027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:18.464027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:18.464027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:18.464027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:18.466201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:18.466201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:18.466201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:18.466201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:18.466201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:18.466201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:18.466201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:18.466201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:18.466201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:18.466201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:18.466201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:18.466201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:18.466201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:18.466201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:18.466201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:18.466201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:18.467828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:18.467828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:18.467828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:18.467828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:18.467828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:18.467828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:18.467828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:18.467828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:18.467828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:18.467828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:18.467828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:18.467828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:18.467828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 336/641] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:52:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:18.467828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189667a3-f99f-411a-898e-4ff4b0bedd3b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:18.601357 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de1280-7870-4d9d-84e0-7561c43f963f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:18.603720 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189667a3-f99f-411a-898e-4ff4b0bedd3b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:18.633499 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:18.649845 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a149dda-ec28-4bdc-8552-42b070b6d6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:18.650852 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a149dda-ec28-4bdc-8552-42b070b6d6ef None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:18.651324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a149dda-ec28-4bdc-8552-42b070b6d6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:18.651809 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a149dda-ec28-4bdc-8552-42b070b6d6ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:18.665440 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a149dda-ec28-4bdc-8552-42b070b6d6ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:18.665853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff8295-3447-4559-a678-49a07fb0d6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:18.666845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff8295-3447-4559-a678-49a07fb0d6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:18.667369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff8295-3447-4559-a678-49a07fb0d6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:18.667870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff8295-3447-4559-a678-49a07fb0d6a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:18.675884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-0a149dda-ec28-4bdc-8552-42b070b6d6ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:18.675884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:18.675884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:18.675884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:18.675884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:18.675884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:18.675884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:18.675884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:18.675884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:18.675884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:18.675884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:18.675884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:18.675884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:18.675884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:18.675884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:18.675884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:18.678057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:18.678057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:18.678057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:18.678057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:18.678057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:18.678057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:18.678057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:18.678057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:18.678057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:18.678057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:18.678057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:18.678057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:18.678057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:18.678057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:18.678057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:18.678057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:18.680353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:18.680353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:18.680353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:18.680353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:18.680353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:18.680353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:18.680353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:18.680353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:18.680353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:18.680353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:18.680353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:18.680353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:18.680353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 337/642] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:52:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:18.680353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a149dda-ec28-4bdc-8552-42b070b6d6ef None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:18.773176 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:18.798701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff8295-3447-4559-a678-49a07fb0d6a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:18.800823 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff8295-3447-4559-a678-49a07fb0d6a5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:18.858806 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a149dda-ec28-4bdc-8552-42b070b6d6ef None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:18.917857 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8fd54-6a2b-428f-a802-2cdd992d4819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:18.919072 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8fd54-6a2b-428f-a802-2cdd992d4819 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:18.919573 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8fd54-6a2b-428f-a802-2cdd992d4819 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:18.920051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8fd54-6a2b-428f-a802-2cdd992d4819 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:18.941814 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 306/643] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:18.941814 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff8295-3447-4559-a678-49a07fb0d6a5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:18.966746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:19.042569 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8fd54-6a2b-428f-a802-2cdd992d4819 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:19.045109 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8fd54-6a2b-428f-a802-2cdd992d4819 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:19.107688 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff8295-3447-4559-a678-49a07fb0d6a5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:19.140802 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:19.169834 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1224395-98fb-4f16-ac41-324416ac7cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:19.170876 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1224395-98fb-4f16-ac41-324416ac7cee None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:19.171391 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1224395-98fb-4f16-ac41-324416ac7cee None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:19.171869 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1224395-98fb-4f16-ac41-324416ac7cee None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:19.173297 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1224395-98fb-4f16-ac41-324416ac7cee None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:19.173850 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1224395-98fb-4f16-ac41-324416ac7cee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:19.176385 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1224395-98fb-4f16-ac41-324416ac7cee None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:19.191744 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 307/644] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 19 10:52:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:19.193317 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1224395-98fb-4f16-ac41-324416ac7cee None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:19.246231 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 338/645] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:19.248928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8fd54-6a2b-428f-a802-2cdd992d4819 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:19.332558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:19.366278 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1224395-98fb-4f16-ac41-324416ac7cee None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:19.409988 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619159f-c640-413e-8c47-d80e4f97a665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:19.410473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8fd54-6a2b-428f-a802-2cdd992d4819 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:19.410945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619159f-c640-413e-8c47-d80e4f97a665 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:19.411351 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619159f-c640-413e-8c47-d80e4f97a665 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:19.411749 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619159f-c640-413e-8c47-d80e4f97a665 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:19.412674 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619159f-c640-413e-8c47-d80e4f97a665 None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:19.413327 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619159f-c640-413e-8c47-d80e4f97a665 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:19.415130 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619159f-c640-413e-8c47-d80e4f97a665 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:19.427985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 308/646] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 19 10:52:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:19.427985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619159f-c640-413e-8c47-d80e4f97a665 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:19.486196 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955885ae-c180-4e0b-a163-72439fc688b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:19.487552 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955885ae-c180-4e0b-a163-72439fc688b0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:19.488044 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955885ae-c180-4e0b-a163-72439fc688b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:19.488524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955885ae-c180-4e0b-a163-72439fc688b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:19.507884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955885ae-c180-4e0b-a163-72439fc688b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:19.510676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955885ae-c180-4e0b-a163-72439fc688b0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:19.544540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-955885ae-c180-4e0b-a163-72439fc688b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:19.544540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:19.544540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:19.544540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:19.544540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:19.544540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:19.544540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:19.544540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:19.544540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:19.544540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:19.544540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:19.544540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:19.544540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:19.544540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:19.544540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:19.545630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:19.545630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:19.545630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:19.545630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:19.545630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:19.545630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:19.545630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:19.545630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:19.545630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:19.545630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:19.545630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:19.545630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:19.545630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:19.545630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:19.545630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:19.545630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:19.545630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:19.546721 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:19.546721 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:19.546721 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:19.546721 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:19.546952 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 339/647] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:19.548237 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955885ae-c180-4e0b-a163-72439fc688b0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:19.555117 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:19.572601 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619159f-c640-413e-8c47-d80e4f97a665 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:19.631138 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515a4a5-a4f8-4208-9583-9111f8aee53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:19.632916 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515a4a5-a4f8-4208-9583-9111f8aee53d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:19.633392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515a4a5-a4f8-4208-9583-9111f8aee53d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:19.633850 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515a4a5-a4f8-4208-9583-9111f8aee53d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:19.647000 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515a4a5-a4f8-4208-9583-9111f8aee53d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:19.648988 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515a4a5-a4f8-4208-9583-9111f8aee53d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:19.651351 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:19.685677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-a515a4a5-a4f8-4208-9583-9111f8aee53d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:19.685677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:19.685677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:19.685677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:19.685677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:19.685677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:19.685677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:19.685677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:19.685677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:19.685677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:19.685677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:19.685677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:19.685677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:19.685677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:19.685677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:19.687397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:19.687397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:19.687397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:19.687397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:19.687397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:19.687397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:19.687397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:19.687397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:19.687397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:19.687397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:19.687397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:19.687397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:19.687397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:19.687397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:19.687397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:19.687397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:19.687397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:19.689202 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:19.689202 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:19.689202 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:19.689202 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:19.693524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 309/648] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:19.694681 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515a4a5-a4f8-4208-9583-9111f8aee53d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:19.714621 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955885ae-c180-4e0b-a163-72439fc688b0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:19.754948 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac3870-e8d5-4881-aef8-f6396ceb6b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:19.756774 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac3870-e8d5-4881-aef8-f6396ceb6b17 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:19.757051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac3870-e8d5-4881-aef8-f6396ceb6b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:19.757323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac3870-e8d5-4881-aef8-f6396ceb6b17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:19.770328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac3870-e8d5-4881-aef8-f6396ceb6b17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:19.772247 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac3870-e8d5-4881-aef8-f6396ceb6b17 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:19.791474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-99ac3870-e8d5-4881-aef8-f6396ceb6b17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:19.791474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:19.791474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:19.791474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:19.791474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:19.791474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:19.791474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:19.791474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:19.791474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:19.791474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:19.791474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:19.791474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:19.791474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:19.791474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:19.791474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:19.792668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:19.792668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:19.792668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:19.792668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:19.792668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:19.792668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:19.792668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:19.792668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:19.792668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:19.792668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:19.792668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:19.792668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:19.792668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:19.792668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:19.792668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:19.792668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:19.792668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:19.794472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:19.794472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:19.794472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:19.794472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:19.794472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 340/649] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:19.794472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac3870-e8d5-4881-aef8-f6396ceb6b17 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:19.875950 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:19.880268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515a4a5-a4f8-4208-9583-9111f8aee53d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:19.939474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac3870-e8d5-4881-aef8-f6396ceb6b17 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:19.942292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fb8bc-d867-4006-9b63-388f0430f8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:19.944231 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fb8bc-d867-4006-9b63-388f0430f8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:19.944231 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fb8bc-d867-4006-9b63-388f0430f8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:19.944749 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fb8bc-d867-4006-9b63-388f0430f8d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:19.965163 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fb8bc-d867-4006-9b63-388f0430f8d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:19.967958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fb8bc-d867-4006-9b63-388f0430f8d9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:19.998651 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e50dfd-242b-43d7-9d76-69f1fdd08b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:19.999778 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e50dfd-242b-43d7-9d76-69f1fdd08b1a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:20.000258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e50dfd-242b-43d7-9d76-69f1fdd08b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:20.000747 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e50dfd-242b-43d7-9d76-69f1fdd08b1a None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:20.002122 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e50dfd-242b-43d7-9d76-69f1fdd08b1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:20.002599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e50dfd-242b-43d7-9d76-69f1fdd08b1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:20.003232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-206fb8bc-d867-4006-9b63-388f0430f8d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:20.003232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:20.003232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:20.003232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:20.003232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:20.003232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:20.003232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:20.003232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:20.003232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:20.003232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:20.003232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:20.003232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:20.003232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:20.003232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:20.003232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:20.004069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:20.004069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:20.004069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:20.004069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:20.004069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:20.004069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:20.004069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:20.004069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:20.004069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:20.004069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:20.004069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:20.004069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:20.004069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:20.004069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:20.004069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:20.004069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:20.004069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:20.005345 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:20.005345 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:20.005345 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:20.005345 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:20.005574 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e50dfd-242b-43d7-9d76-69f1fdd08b1a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:20.013066 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 310/650] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:20.014491 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fb8bc-d867-4006-9b63-388f0430f8d9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:20.031007 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 341/651] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:20.031007 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e50dfd-242b-43d7-9d76-69f1fdd08b1a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:20.112088 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:20.167170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e50dfd-242b-43d7-9d76-69f1fdd08b1a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:20.189004 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:20.219243 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fb8bc-d867-4006-9b63-388f0430f8d9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:20.221637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b094a-59f3-414d-8ba1-d70b2dfcadb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:20.222631 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b094a-59f3-414d-8ba1-d70b2dfcadb2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:20.222983 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b094a-59f3-414d-8ba1-d70b2dfcadb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:20.223321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b094a-59f3-414d-8ba1-d70b2dfcadb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:20.224644 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b094a-59f3-414d-8ba1-d70b2dfcadb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:20.225143 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b094a-59f3-414d-8ba1-d70b2dfcadb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:20.227065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b094a-59f3-414d-8ba1-d70b2dfcadb2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:20.242201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 342/652] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:20.243208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b094a-59f3-414d-8ba1-d70b2dfcadb2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:20.290749 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407962b9-67a2-4b40-8202-9b9e7e9ffb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:20.291778 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407962b9-67a2-4b40-8202-9b9e7e9ffb78 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:20.292253 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407962b9-67a2-4b40-8202-9b9e7e9ffb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:20.292747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407962b9-67a2-4b40-8202-9b9e7e9ffb78 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:20.294149 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407962b9-67a2-4b40-8202-9b9e7e9ffb78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:20.294678 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407962b9-67a2-4b40-8202-9b9e7e9ffb78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:20.297373 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407962b9-67a2-4b40-8202-9b9e7e9ffb78 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:20.313761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 311/653] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:20.314874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407962b9-67a2-4b40-8202-9b9e7e9ffb78 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:20.372534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b094a-59f3-414d-8ba1-d70b2dfcadb2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:20.425004 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548305f-72b0-4e90-b080-e4009671a506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:20.426071 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548305f-72b0-4e90-b080-e4009671a506 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:20.426363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548305f-72b0-4e90-b080-e4009671a506 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:20.426689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548305f-72b0-4e90-b080-e4009671a506 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:20.427907 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548305f-72b0-4e90-b080-e4009671a506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:20.428430 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548305f-72b0-4e90-b080-e4009671a506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:20.431047 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548305f-72b0-4e90-b080-e4009671a506 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:20.447713 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407962b9-67a2-4b40-8202-9b9e7e9ffb78 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:20.450262 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 343/654] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:20.451154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548305f-72b0-4e90-b080-e4009671a506 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:20.457414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:20.488682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756adbb6-fbdd-4144-a76c-932cb8b55c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:20.489437 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756adbb6-fbdd-4144-a76c-932cb8b55c03 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:20.489720 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756adbb6-fbdd-4144-a76c-932cb8b55c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:20.490043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756adbb6-fbdd-4144-a76c-932cb8b55c03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:20.497580 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756adbb6-fbdd-4144-a76c-932cb8b55c03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:20.499054 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756adbb6-fbdd-4144-a76c-932cb8b55c03 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:20.511082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:20.515322 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-756adbb6-fbdd-4144-a76c-932cb8b55c03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:20.515322 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:20.515322 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:20.515322 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:20.515322 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:20.515322 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:20.515322 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:20.515322 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:20.515322 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:20.515322 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:20.515322 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:20.515322 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:20.515322 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:20.515322 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:20.515322 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:20.517069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:20.517069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:20.517069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:20.517069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:20.517069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:20.517069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:20.517069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:20.517069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:20.517069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:20.517069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:20.517069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:20.517069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:20.517069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:20.517069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:20.517069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:20.517069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:20.517069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:20.518620 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:20.518620 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:20.518620 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:20.518620 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:20.518620 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:20.518620 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:20.518620 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:20.518620 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:20.518620 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 312/655] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:20.518620 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca8b26-1340-4696-9d6b-3d7b7eec8b90 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:20.518620 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca8b26-1340-4696-9d6b-3d7b7eec8b90 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:20.519789 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca8b26-1340-4696-9d6b-3d7b7eec8b90 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:20.519789 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 313/656] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:20.520609 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca8b26-1340-4696-9d6b-3d7b7eec8b90 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:20.619831 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548305f-72b0-4e90-b080-e4009671a506 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:20.643799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca8b26-1340-4696-9d6b-3d7b7eec8b90 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:20.668963 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd575d-0eb4-4e97-afe5-2e312f980240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:20.670075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd575d-0eb4-4e97-afe5-2e312f980240 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:20.670484 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd575d-0eb4-4e97-afe5-2e312f980240 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:20.670884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd575d-0eb4-4e97-afe5-2e312f980240 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:20.680093 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd575d-0eb4-4e97-afe5-2e312f980240 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:20.681604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd575d-0eb4-4e97-afe5-2e312f980240 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:20.689655 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ed9ff-7eae-4bd2-9999-e28cef45a5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:20.690883 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ed9ff-7eae-4bd2-9999-e28cef45a5ba None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:20.691287 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ed9ff-7eae-4bd2-9999-e28cef45a5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:20.691720 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ed9ff-7eae-4bd2-9999-e28cef45a5ba None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:20.705045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-a0dd575d-0eb4-4e97-afe5-2e312f980240 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:20.705045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:20.705045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:20.705045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:20.705045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:20.705045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:20.705045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:20.705045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:20.705045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:20.705045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:20.705045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:20.705045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:20.705045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:20.705045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:20.705045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:20.706801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:20.706801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:20.706801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:20.706801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:20.706801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:20.706801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:20.706801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:20.706801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:20.706801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:20.706801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:20.706801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:20.706801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:20.706801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:20.706801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:20.706801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:20.706801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:20.706801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:20.708947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:20.708947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:20.708947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:20.708947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:20.708947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:20.708947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:20.708947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:20.708947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:20.710407 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ed9ff-7eae-4bd2-9999-e28cef45a5ba None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:20.710607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 344/657] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:20.710607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd575d-0eb4-4e97-afe5-2e312f980240 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:20.710936 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ed9ff-7eae-4bd2-9999-e28cef45a5ba None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:20.734092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-230ed9ff-7eae-4bd2-9999-e28cef45a5ba None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 10:52:20.734092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:20.734092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:20.734092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:20.734092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:20.734092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:20.734092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:20.734092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:20.734092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:20.734092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:20.734092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:20.734092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:20.734092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:20.734092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:20.734092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:20.734092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:20.735572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:20.735572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:20.735572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:20.735572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:20.735572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:20.735572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:20.735572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:20.735572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:20.735572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:20.735572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:20.735572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:20.735572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:20.735572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:20.735572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:20.735572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:20.735572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:20.735572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:20.735572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:20.736952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:20.736952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:20.736952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:20.736952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:20.736952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:20.736952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:20.736952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:20.736952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:20.736952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 10:52:20.736952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:20.736952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 314/658] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:52:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:20.738303 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ed9ff-7eae-4bd2-9999-e28cef45a5ba None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:20.786239 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:20.843171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:20.850149 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd575d-0eb4-4e97-afe5-2e312f980240 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:20.894825 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b74b8-de82-4da6-bb2a-0e4b12247cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:20.895835 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ed9ff-7eae-4bd2-9999-e28cef45a5ba None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:20.896045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b74b8-de82-4da6-bb2a-0e4b12247cde None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:20.896585 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b74b8-de82-4da6-bb2a-0e4b12247cde None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:20.897056 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b74b8-de82-4da6-bb2a-0e4b12247cde None admin] PATH_INFO: `/v3/users/glance` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:20.909985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b74b8-de82-4da6-bb2a-0e4b12247cde None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:20.912287 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b74b8-de82-4da6-bb2a-0e4b12247cde None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:20.928618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-413b74b8-de82-4da6-bb2a-0e4b12247cde None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 19 10:52:20.928618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:20.928618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:20.928618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:20.928618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:20.928618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:20.928618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:20.928618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:20.928618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:20.928618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:20.928618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:20.928618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:20.928618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:20.928618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:20.928618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:20.928618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:20.930534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:20.930534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:20.930534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:20.930534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:20.930534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:20.930534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:20.930534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:20.930534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:20.930534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:20.930534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:20.930534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:20.930534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:20.930534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:20.930534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:20.930534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:20.930534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:20.930534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:20.930534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:20.932289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:20.932289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:20.932289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:20.932289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:20.932289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:20.932289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:20.932289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:20.932289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:20.932289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 19 10:52:20.932289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:20.932289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 345/659] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:20.933460 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ea197-0186-468a-bc07-bd79531af7f0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:20.933632 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ea197-0186-468a-bc07-bd79531af7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:20.934102 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ea197-0186-468a-bc07-bd79531af7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:20.950980 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25844f3-8819-44c6-928e-440b2ea751e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:20.952051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25844f3-8819-44c6-928e-440b2ea751e1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:20.952493 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25844f3-8819-44c6-928e-440b2ea751e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:20.952981 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25844f3-8819-44c6-928e-440b2ea751e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:20.954272 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25844f3-8819-44c6-928e-440b2ea751e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:20.954708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25844f3-8819-44c6-928e-440b2ea751e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:20.956409 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25844f3-8819-44c6-928e-440b2ea751e1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:20.960455 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a54ea197-0186-468a-bc07-bd79531af7f0 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:20.961765 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a54ea197-0186-468a-bc07-bd79531af7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:20.971677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 315/660] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:20.973179 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25844f3-8819-44c6-928e-440b2ea751e1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:21.058404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 346/661] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:21.059423 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ea197-0186-468a-bc07-bd79531af7f0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:21.089341 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:21.109578 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25844f3-8819-44c6-928e-440b2ea751e1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:21.153533 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f1fcf-424b-420d-9af6-e5421d41af02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:21.154497 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f1fcf-424b-420d-9af6-e5421d41af02 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:21.154989 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f1fcf-424b-420d-9af6-e5421d41af02 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:21.155398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f1fcf-424b-420d-9af6-e5421d41af02 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:21.156345 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f1fcf-424b-420d-9af6-e5421d41af02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:21.156956 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f1fcf-424b-420d-9af6-e5421d41af02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:21.158977 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f1fcf-424b-420d-9af6-e5421d41af02 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:21.173387 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 316/662] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:21.174649 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f1fcf-424b-420d-9af6-e5421d41af02 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:21.186397 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:21.210835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ea197-0186-468a-bc07-bd79531af7f0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:21.260559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95daa98-c263-43d4-8c54-2d22ce988f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:21.261453 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95daa98-c263-43d4-8c54-2d22ce988f8f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:21.261847 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95daa98-c263-43d4-8c54-2d22ce988f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:21.262220 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95daa98-c263-43d4-8c54-2d22ce988f8f None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:21.263225 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95daa98-c263-43d4-8c54-2d22ce988f8f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:21.263635 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95daa98-c263-43d4-8c54-2d22ce988f8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:21.265413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95daa98-c263-43d4-8c54-2d22ce988f8f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:21.287068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 347/663] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Jul 19 10:52:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:21.288314 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95daa98-c263-43d4-8c54-2d22ce988f8f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:21.321701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f1fcf-424b-420d-9af6-e5421d41af02 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:21.374930 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6ec9f-bc35-41b8-8d9a-d6a292b7c31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:21.375980 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6ec9f-bc35-41b8-8d9a-d6a292b7c31e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:21.376422 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6ec9f-bc35-41b8-8d9a-d6a292b7c31e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:21.376901 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6ec9f-bc35-41b8-8d9a-d6a292b7c31e None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:21.378377 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6ec9f-bc35-41b8-8d9a-d6a292b7c31e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:21.378838 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6ec9f-bc35-41b8-8d9a-d6a292b7c31e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:21.381244 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6ec9f-bc35-41b8-8d9a-d6a292b7c31e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:21.405762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 317/664] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jul 19 10:52:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:21.406879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6ec9f-bc35-41b8-8d9a-d6a292b7c31e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:21.416409 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:21.450623 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95daa98-c263-43d4-8c54-2d22ce988f8f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:21.498898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8fe10-e2c7-463d-9d58-3a8cc6fe7ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:21.499724 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8fe10-e2c7-463d-9d58-3a8cc6fe7ced None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:21.500065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8fe10-e2c7-463d-9d58-3a8cc6fe7ced None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:21.500397 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8fe10-e2c7-463d-9d58-3a8cc6fe7ced None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:21.501521 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8fe10-e2c7-463d-9d58-3a8cc6fe7ced None admin] RBAC: Adding query filter params (role.id=669088b4ca4644f4bb586dfeaf427fb0, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=8112def59003484483552fc76f14e281) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:21.501908 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8fe10-e2c7-463d-9d58-3a8cc6fe7ced None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:21.503527 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8fe10-e2c7-463d-9d58-3a8cc6fe7ced None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:21.510800 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 348/665] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:21 2022] GET /identity/v3/role_assignments?user.id=8112def59003484483552fc76f14e281&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=669088b4ca4644f4bb586dfeaf427fb0 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:21.512188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8fe10-e2c7-463d-9d58-3a8cc6fe7ced None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:21.529012 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:21.615160 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6ec9f-bc35-41b8-8d9a-d6a292b7c31e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:21.663436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033efab-9674-4468-95bc-731241400be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:21.665029 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033efab-9674-4468-95bc-731241400be3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:21.666011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033efab-9674-4468-95bc-731241400be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:21.666214 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033efab-9674-4468-95bc-731241400be3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:21.676545 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8fe10-e2c7-463d-9d58-3a8cc6fe7ced None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:21.687242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033efab-9674-4468-95bc-731241400be3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:21.702827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-f033efab-9674-4468-95bc-731241400be3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:21.702827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:21.702827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:21.702827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:21.702827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:21.702827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:21.702827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:21.702827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:21.702827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:21.702827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:21.702827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:21.702827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:21.702827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:21.702827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:21.702827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:21.702827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:21.703812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:21.703812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:21.703812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:21.703812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:21.703812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:21.703812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:21.703812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:21.703812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:21.703812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:21.703812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:21.703812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:21.703812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:21.703812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:21.703812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:21.703812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:21.703812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:21.704621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:21.704621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:21.704621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:21.704621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:21.704621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:21.704621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:21.704621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:21.704621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:21.704621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:21.704621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:21.704621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:21.704621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:21.705290 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 318/666] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:52:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:21.706685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033efab-9674-4468-95bc-731241400be3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:21.739266 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2599e-5249-4e9e-9b8b-0b5be02c29d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:21.739983 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2599e-5249-4e9e-9b8b-0b5be02c29d3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:21.740431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2599e-5249-4e9e-9b8b-0b5be02c29d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:21.742509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2599e-5249-4e9e-9b8b-0b5be02c29d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:21.743022 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2599e-5249-4e9e-9b8b-0b5be02c29d3 None admin] RBAC: Adding query filter params (role.id=669088b4ca4644f4bb586dfeaf427fb0, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=3c50a821e9ef44cb9fccd49ee4af7dbf) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:21.743701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2599e-5249-4e9e-9b8b-0b5be02c29d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:21.746598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2599e-5249-4e9e-9b8b-0b5be02c29d3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:21.759281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 349/667] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:21 2022] GET /identity/v3/role_assignments?user.id=3c50a821e9ef44cb9fccd49ee4af7dbf&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=669088b4ca4644f4bb586dfeaf427fb0 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:21.760736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2599e-5249-4e9e-9b8b-0b5be02c29d3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:21.819875 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:21.896697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033efab-9674-4468-95bc-731241400be3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:21.897240 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:21.952994 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2599e-5249-4e9e-9b8b-0b5be02c29d3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:21.962875 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f696e79-67c9-474c-b5c9-4cd7e1f3157b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:21.964242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f696e79-67c9-474c-b5c9-4cd7e1f3157b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:21.964943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f696e79-67c9-474c-b5c9-4cd7e1f3157b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:21.965573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f696e79-67c9-474c-b5c9-4cd7e1f3157b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:22.015176 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395bcdd-0e1a-484b-880c-d8eb1fcc25be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:22.016233 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395bcdd-0e1a-484b-880c-d8eb1fcc25be None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:22.016696 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395bcdd-0e1a-484b-880c-d8eb1fcc25be None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:22.017196 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395bcdd-0e1a-484b-880c-d8eb1fcc25be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:22.086452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f696e79-67c9-474c-b5c9-4cd7e1f3157b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:22.088287 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f696e79-67c9-474c-b5c9-4cd7e1f3157b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:22.155438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395bcdd-0e1a-484b-880c-d8eb1fcc25be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:22.158794 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395bcdd-0e1a-484b-880c-d8eb1fcc25be None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:22.183036 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:22.250405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 319/668] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:22.252411 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f696e79-67c9-474c-b5c9-4cd7e1f3157b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:22.291952 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:22.353103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 350/669] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:22.354612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395bcdd-0e1a-484b-880c-d8eb1fcc25be None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:22.456207 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f696e79-67c9-474c-b5c9-4cd7e1f3157b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:22.526642 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169447ad-30a5-429d-bedd-cd634fc1912a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:22.528740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169447ad-30a5-429d-bedd-cd634fc1912a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:22.529567 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169447ad-30a5-429d-bedd-cd634fc1912a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:22.530039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169447ad-30a5-429d-bedd-cd634fc1912a None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:22.532751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169447ad-30a5-429d-bedd-cd634fc1912a None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:22.533328 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169447ad-30a5-429d-bedd-cd634fc1912a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:22.537395 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169447ad-30a5-429d-bedd-cd634fc1912a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:22.537934 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395bcdd-0e1a-484b-880c-d8eb1fcc25be None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:22.560046 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 320/670] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 19 10:52:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:22.562096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169447ad-30a5-429d-bedd-cd634fc1912a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:22.595149 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc987a8-9b44-4a0d-a51d-c70d2561997e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:22.596425 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc987a8-9b44-4a0d-a51d-c70d2561997e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:22.596937 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc987a8-9b44-4a0d-a51d-c70d2561997e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:22.597382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc987a8-9b44-4a0d-a51d-c70d2561997e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:22.615426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc987a8-9b44-4a0d-a51d-c70d2561997e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:22.618109 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc987a8-9b44-4a0d-a51d-c70d2561997e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:22.619313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:22.650328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-bdc987a8-9b44-4a0d-a51d-c70d2561997e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:22.650328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:22.650328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:22.650328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:22.650328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:22.650328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:22.650328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:22.650328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:22.650328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:22.650328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:22.650328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:22.650328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:22.650328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:22.650328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:22.650328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:22.652019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:22.652019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:22.652019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:22.652019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:22.652019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:22.652019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:22.652019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:22.652019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:22.652019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:22.652019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:22.652019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:22.652019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:22.652019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:22.652019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:22.652019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:22.652019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:22.652019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:22.654497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:22.654497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:22.654497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:22.654497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:22.654497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 351/671] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:22.654497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc987a8-9b44-4a0d-a51d-c70d2561997e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:22.700988 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:22.778381 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169447ad-30a5-429d-bedd-cd634fc1912a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:22.835376 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc987a8-9b44-4a0d-a51d-c70d2561997e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:22.852566 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a5aca-19a4-4893-aede-a0817d6caff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:22.854346 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a5aca-19a4-4893-aede-a0817d6caff5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:22.854822 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a5aca-19a4-4893-aede-a0817d6caff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:22.855281 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a5aca-19a4-4893-aede-a0817d6caff5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:22.880206 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a5aca-19a4-4893-aede-a0817d6caff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:22.883223 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a5aca-19a4-4893-aede-a0817d6caff5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:22.897870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf29704-716d-44ac-979d-91378219ebd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:22.899860 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf29704-716d-44ac-979d-91378219ebd5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:22.900467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf29704-716d-44ac-979d-91378219ebd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:22.901111 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf29704-716d-44ac-979d-91378219ebd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:22.918039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-bb6a5aca-19a4-4893-aede-a0817d6caff5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:22.918039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:22.918039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:22.918039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:22.918039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:22.918039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:22.918039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:22.918039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:22.918039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:22.918039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:22.918039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:22.918039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:22.918039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:22.918039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:22.918039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:22.920047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:22.920047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:22.920047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:22.920047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:22.920047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:22.920047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:22.920047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:22.920047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:22.920047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:22.920047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:22.920047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:22.920047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:22.920047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:22.920047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:22.920047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:22.920047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:22.920047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:22.922017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:22.922017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:22.922017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:22.922017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:22.922446 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf29704-716d-44ac-979d-91378219ebd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:22.922446 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf29704-716d-44ac-979d-91378219ebd5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:22.932905 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 321/672] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:22.934803 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a5aca-19a4-4893-aede-a0817d6caff5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:22.955771 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-dcf29704-716d-44ac-979d-91378219ebd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:22.955771 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:22.955771 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:22.955771 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:22.955771 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:22.955771 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:22.955771 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:22.955771 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:22.955771 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:22.955771 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:22.955771 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:22.955771 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:22.955771 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:22.955771 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:22.955771 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:22.957533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:22.957533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:22.957533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:22.957533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:22.957533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:22.957533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:22.957533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:22.957533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:22.957533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:22.957533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:22.957533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:22.957533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:22.957533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:22.957533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:22.957533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:22.957533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:22.957533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:22.959347 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:22.959347 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:22.959347 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:22.959347 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:22.964572 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 352/673] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:22.966075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf29704-716d-44ac-979d-91378219ebd5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:23.077468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:23.103669 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:23.122964 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a5aca-19a4-4893-aede-a0817d6caff5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:23.149102 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf29704-716d-44ac-979d-91378219ebd5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:23.166349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f382f-1818-4d63-9c97-8da0a62eb341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:23.166674 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f382f-1818-4d63-9c97-8da0a62eb341 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:23.167057 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f382f-1818-4d63-9c97-8da0a62eb341 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:23.167208 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f382f-1818-4d63-9c97-8da0a62eb341 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:23.167897 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f382f-1818-4d63-9c97-8da0a62eb341 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:23.168205 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f382f-1818-4d63-9c97-8da0a62eb341 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:23.169641 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f382f-1818-4d63-9c97-8da0a62eb341 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:23.187999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 322/674] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:23.189006 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f382f-1818-4d63-9c97-8da0a62eb341 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:23.222803 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680be4fc-3666-4299-942c-10bf3461ca35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:23.224455 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680be4fc-3666-4299-942c-10bf3461ca35 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:23.225307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680be4fc-3666-4299-942c-10bf3461ca35 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:23.226803 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680be4fc-3666-4299-942c-10bf3461ca35 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:23.228507 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680be4fc-3666-4299-942c-10bf3461ca35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:23.229375 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680be4fc-3666-4299-942c-10bf3461ca35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:23.232414 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680be4fc-3666-4299-942c-10bf3461ca35 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:23.258461 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 353/675] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:23.260702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680be4fc-3666-4299-942c-10bf3461ca35 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:23.297795 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f382f-1818-4d63-9c97-8da0a62eb341 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:23.335191 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb07b47-bf63-4905-9aba-6db507af1876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:23.335868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb07b47-bf63-4905-9aba-6db507af1876 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:23.336148 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb07b47-bf63-4905-9aba-6db507af1876 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:23.336413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb07b47-bf63-4905-9aba-6db507af1876 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:23.337176 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb07b47-bf63-4905-9aba-6db507af1876 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:23.337478 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb07b47-bf63-4905-9aba-6db507af1876 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:23.338869 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb07b47-bf63-4905-9aba-6db507af1876 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:23.346531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:23.356542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 323/676] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:23.357643 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb07b47-bf63-4905-9aba-6db507af1876 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:23.458447 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680be4fc-3666-4299-942c-10bf3461ca35 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:23.496222 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb07b47-bf63-4905-9aba-6db507af1876 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:23.520147 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f011d11-5388-4698-a02c-7d835e9ec59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:23.522374 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f011d11-5388-4698-a02c-7d835e9ec59d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:23.523162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f011d11-5388-4698-a02c-7d835e9ec59d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:23.523941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f011d11-5388-4698-a02c-7d835e9ec59d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:23.530070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:23.535268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f01ae-81db-49ab-8dd9-c0767941a104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:23.536380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f01ae-81db-49ab-8dd9-c0767941a104 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:23.537429 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f01ae-81db-49ab-8dd9-c0767941a104 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:23.537867 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f01ae-81db-49ab-8dd9-c0767941a104 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:23.540543 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f011d11-5388-4698-a02c-7d835e9ec59d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:23.543865 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f011d11-5388-4698-a02c-7d835e9ec59d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:23.547196 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f01ae-81db-49ab-8dd9-c0767941a104 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:23.549198 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f01ae-81db-49ab-8dd9-c0767941a104 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:23.564896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-0b1f01ae-81db-49ab-8dd9-c0767941a104 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:23.564896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:23.564896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:23.564896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:23.564896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:23.564896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:23.564896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:23.564896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:23.564896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:23.564896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:23.564896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:23.564896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:23.564896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:23.564896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:23.564896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:23.565874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:23.565874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:23.565874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:23.565874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:23.565874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:23.565874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:23.565874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:23.565874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:23.565874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:23.565874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:23.565874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:23.565874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:23.565874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:23.565874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:23.565874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:23.565874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:23.565874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:23.566724 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:23.566724 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:23.566724 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:23.566724 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:23.566724 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:23.566724 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:23.566724 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:23.566724 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:23.569730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 324/677] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:23.570819 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f01ae-81db-49ab-8dd9-c0767941a104 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:23.575883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-5f011d11-5388-4698-a02c-7d835e9ec59d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:23.575883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:23.575883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:23.575883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:23.575883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:23.575883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:23.575883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:23.575883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:23.575883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:23.575883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:23.575883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:23.575883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:23.575883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:23.575883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:23.575883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:23.576841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:23.576841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:23.576841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:23.576841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:23.576841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:23.576841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:23.576841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:23.576841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:23.576841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:23.576841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:23.576841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:23.576841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:23.576841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:23.576841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:23.576841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:23.576841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:23.576841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:23.577723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:23.577723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:23.577723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:23.577723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:23.577723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:23.577723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:23.577723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:23.577723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:23.584105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 354/678] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:23.584105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f011d11-5388-4698-a02c-7d835e9ec59d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:23.645848 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:23.694435 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f01ae-81db-49ab-8dd9-c0767941a104 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:23.737252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac3a95-0bdc-4cd5-be41-5ed0e3c08f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:23.738377 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac3a95-0bdc-4cd5-be41-5ed0e3c08f5b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:23.738893 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac3a95-0bdc-4cd5-be41-5ed0e3c08f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:23.739369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac3a95-0bdc-4cd5-be41-5ed0e3c08f5b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:23.748158 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac3a95-0bdc-4cd5-be41-5ed0e3c08f5b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:23.749973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac3a95-0bdc-4cd5-be41-5ed0e3c08f5b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:23.766293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-25ac3a95-0bdc-4cd5-be41-5ed0e3c08f5b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:52:23.766293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:23.766293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:23.766293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:23.766293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:23.766293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:23.766293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:23.766293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:23.766293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:23.766293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:23.766293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:23.766293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:23.766293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:23.766293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:23.766293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:23.766293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:23.767279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:23.767279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:23.767279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:23.767279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:23.767279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:23.767279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:23.767279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:23.767279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:23.767279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:23.767279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:23.767279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:23.767279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:23.767279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:23.767279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:23.767279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:23.767279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:23.767279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:23.767279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:23.768172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:23.768172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:23.768172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:23.768172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:23.768172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:23.768172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:23.768172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:23.768172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:23.768172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:52:23.768172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:23.775899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 325/679] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:52:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:23.777334 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac3a95-0bdc-4cd5-be41-5ed0e3c08f5b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:23.787997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f011d11-5388-4698-a02c-7d835e9ec59d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:23.863160 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c422101-422b-414d-a41c-d97fa2298576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:23.864233 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c422101-422b-414d-a41c-d97fa2298576 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:23.864780 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c422101-422b-414d-a41c-d97fa2298576 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:23.865352 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c422101-422b-414d-a41c-d97fa2298576 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:23.866338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c422101-422b-414d-a41c-d97fa2298576 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:23.866837 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c422101-422b-414d-a41c-d97fa2298576 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:23.868493 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c422101-422b-414d-a41c-d97fa2298576 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:23.886787 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 355/680] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:23.888254 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c422101-422b-414d-a41c-d97fa2298576 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:23.926475 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac3a95-0bdc-4cd5-be41-5ed0e3c08f5b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:23.968117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:23.969809 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:24.008978 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327e33b-afbb-470b-b89d-282fc5ddb27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:24.010763 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327e33b-afbb-470b-b89d-282fc5ddb27a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:24.011289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327e33b-afbb-470b-b89d-282fc5ddb27a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:24.011802 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327e33b-afbb-470b-b89d-282fc5ddb27a None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:24.013822 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327e33b-afbb-470b-b89d-282fc5ddb27a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:24.014678 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327e33b-afbb-470b-b89d-282fc5ddb27a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:24.018324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327e33b-afbb-470b-b89d-282fc5ddb27a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:24.036227 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c422101-422b-414d-a41c-d97fa2298576 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:24.058029 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 326/681] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:24.058029 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327e33b-afbb-470b-b89d-282fc5ddb27a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:24.100216 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23eac1d-d9cf-4635-9c77-197861ee2c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:24.101621 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23eac1d-d9cf-4635-9c77-197861ee2c00 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:24.102745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23eac1d-d9cf-4635-9c77-197861ee2c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:24.102745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23eac1d-d9cf-4635-9c77-197861ee2c00 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:24.104194 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23eac1d-d9cf-4635-9c77-197861ee2c00 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:24.104780 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23eac1d-d9cf-4635-9c77-197861ee2c00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:24.107608 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23eac1d-d9cf-4635-9c77-197861ee2c00 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:24.148118 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 356/682] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jul 19 10:52:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:24.148118 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23eac1d-d9cf-4635-9c77-197861ee2c00 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:24.180167 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327e33b-afbb-470b-b89d-282fc5ddb27a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:24.218090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9b80b-bd70-4b90-bc96-7e21efb5b171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:24.219075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9b80b-bd70-4b90-bc96-7e21efb5b171 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:24.219560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9b80b-bd70-4b90-bc96-7e21efb5b171 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:24.220023 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9b80b-bd70-4b90-bc96-7e21efb5b171 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:24.221077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9b80b-bd70-4b90-bc96-7e21efb5b171 None admin] RBAC: Adding query filter params (role.id=669088b4ca4644f4bb586dfeaf427fb0, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=d1bcfbee5a5e4016a77901d0a637da63) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:24.221579 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9b80b-bd70-4b90-bc96-7e21efb5b171 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:24.223221 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9b80b-bd70-4b90-bc96-7e21efb5b171 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:24.231321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 327/683] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:24 2022] GET /identity/v3/role_assignments?user.id=d1bcfbee5a5e4016a77901d0a637da63&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=669088b4ca4644f4bb586dfeaf427fb0 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:24.232458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9b80b-bd70-4b90-bc96-7e21efb5b171 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:24.283890 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:24.328749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23eac1d-d9cf-4635-9c77-197861ee2c00 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:24.353759 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:24.355376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9b80b-bd70-4b90-bc96-7e21efb5b171 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:24.384499 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c179e2-8c54-42cf-a164-73b947ecac7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:24.385329 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c179e2-8c54-42cf-a164-73b947ecac7b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:24.385644 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c179e2-8c54-42cf-a164-73b947ecac7b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:24.386008 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c179e2-8c54-42cf-a164-73b947ecac7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:24.387526 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c179e2-8c54-42cf-a164-73b947ecac7b None admin] RBAC: Adding query filter params (role.id=669088b4ca4644f4bb586dfeaf427fb0, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=07eaacc831ae481d99e8ab03ee295e23) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:24.387821 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c179e2-8c54-42cf-a164-73b947ecac7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:24.389637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c179e2-8c54-42cf-a164-73b947ecac7b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:24.399216 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 357/684] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:24 2022] GET /identity/v3/role_assignments?user.id=07eaacc831ae481d99e8ab03ee295e23&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=669088b4ca4644f4bb586dfeaf427fb0 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:24.399876 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb97206-3a47-48b8-ba68-a52e5e604a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:24.400547 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb97206-3a47-48b8-ba68-a52e5e604a83 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:24.405626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb97206-3a47-48b8-ba68-a52e5e604a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:24.406662 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb97206-3a47-48b8-ba68-a52e5e604a83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:24.414531 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b3485-89a5-4f7b-97c6-085bfd60c7d9 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:24.415461 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b3485-89a5-4f7b-97c6-085bfd60c7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:24.416332 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b3485-89a5-4f7b-97c6-085bfd60c7d9 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:24.422311 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 358/685] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:24 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:24.448683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6034cee-090d-4c1e-84be-a0bc696f39d6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:24.449220 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6034cee-090d-4c1e-84be-a0bc696f39d6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:24.449400 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6034cee-090d-4c1e-84be-a0bc696f39d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:24.480778 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c6034cee-090d-4c1e-84be-a0bc696f39d6 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:24.483357 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c6034cee-090d-4c1e-84be-a0bc696f39d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:24.616201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb97206-3a47-48b8-ba68-a52e5e604a83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:24.618977 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb97206-3a47-48b8-ba68-a52e5e604a83 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:24.644670 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 359/686] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:24.669109 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6034cee-090d-4c1e-84be-a0bc696f39d6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:24.686279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:24.752232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 328/687] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:24.766269 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb97206-3a47-48b8-ba68-a52e5e604a83 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:24.895165 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6034cee-090d-4c1e-84be-a0bc696f39d6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:24.907750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:24.944203 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831567b-7994-4f60-80df-88ef59d0b29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:24.945112 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831567b-7994-4f60-80df-88ef59d0b29f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:24.945407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831567b-7994-4f60-80df-88ef59d0b29f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:24.945682 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831567b-7994-4f60-80df-88ef59d0b29f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:24.946357 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831567b-7994-4f60-80df-88ef59d0b29f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:24.947775 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831567b-7994-4f60-80df-88ef59d0b29f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:24.979850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-3831567b-7994-4f60-80df-88ef59d0b29f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 10:52:24.979850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:24.979850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:52:24.979850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:52:24.979850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:52:24.979850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:52:24.979850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:52:24.979850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:24.979850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 10:52:24.979850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:24.979850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:52:24.979850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:24.979850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:24.979850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:24.979850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:24.979850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:24.981667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:24.981667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:24.981667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:24.981667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:24.981667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:24.981667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:24.981667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:24.981667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:52:24.981667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:52:24.981667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:52:24.981667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:52:24.981667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:24.981667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:24.981667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:24.981667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:24.981667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:24.983958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:24.983958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:24.983958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:24.983958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:24.983958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:24.983958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:24.983958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:24.983958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:24.983958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:24.983958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:24.983958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:24.983958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:52:24.983958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:24.983958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 10:52:24.983958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:24.983958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 360/688] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Jul 19 10:52:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:24.988633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831567b-7994-4f60-80df-88ef59d0b29f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:25.055335 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb97206-3a47-48b8-ba68-a52e5e604a83 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:25.116245 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61d07d-10c5-4e32-901c-7b326c57ae61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:25.117648 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831567b-7994-4f60-80df-88ef59d0b29f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:25.117844 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61d07d-10c5-4e32-901c-7b326c57ae61 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:25.118165 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61d07d-10c5-4e32-901c-7b326c57ae61 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:25.118642 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61d07d-10c5-4e32-901c-7b326c57ae61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:25.138018 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61d07d-10c5-4e32-901c-7b326c57ae61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:25.140239 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61d07d-10c5-4e32-901c-7b326c57ae61 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:25.143612 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:25.165905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6aeb5-81e8-448e-9511-543204640a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:25.167029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6aeb5-81e8-448e-9511-543204640a35 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:25.167648 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6aeb5-81e8-448e-9511-543204640a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:25.168208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6aeb5-81e8-448e-9511-543204640a35 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:25.169660 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6aeb5-81e8-448e-9511-543204640a35 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:25.170287 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6aeb5-81e8-448e-9511-543204640a35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:25.172966 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6aeb5-81e8-448e-9511-543204640a35 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:25.179913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-3c61d07d-10c5-4e32-901c-7b326c57ae61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:25.179913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:25.179913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:25.179913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:25.179913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:25.179913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:25.179913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:25.179913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:25.179913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:25.179913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:25.179913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:25.179913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:25.179913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:25.179913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:25.179913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:25.181723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:25.181723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:25.181723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:25.181723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:25.181723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:25.181723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:25.181723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:25.181723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:25.181723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:25.181723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:25.181723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:25.181723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:25.181723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:25.181723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:25.181723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:25.181723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:25.181723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:25.183440 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:25.183440 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:25.183440 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:25.183440 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:25.186849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 329/689] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:25.189602 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d84972-bbc5-454e-a13c-20c514edae91 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:25.190412 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d84972-bbc5-454e-a13c-20c514edae91 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:25.191174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d84972-bbc5-454e-a13c-20c514edae91 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:25.193439 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 361/690] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jul 19 10:52:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:25.197834 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6aeb5-81e8-448e-9511-543204640a35 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:25.198416 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 330/691] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:25.200037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d5a03-f4dc-42bd-b69e-6a1cdc8f3da6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:25.200641 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d5a03-f4dc-42bd-b69e-6a1cdc8f3da6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:25.201216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d5a03-f4dc-42bd-b69e-6a1cdc8f3da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:25.219598 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-829d5a03-f4dc-42bd-b69e-6a1cdc8f3da6 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:25.221351 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-829d5a03-f4dc-42bd-b69e-6a1cdc8f3da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:25.260252 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:25.305860 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 331/692] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:25.306081 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d5a03-f4dc-42bd-b69e-6a1cdc8f3da6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:25.357476 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6aeb5-81e8-448e-9511-543204640a35 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:25.404762 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd681ec-7a8a-4e95-8f27-3891a39728fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:25.405850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd681ec-7a8a-4e95-8f27-3891a39728fc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:25.406328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd681ec-7a8a-4e95-8f27-3891a39728fc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:25.406881 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd681ec-7a8a-4e95-8f27-3891a39728fc None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:25.407941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd681ec-7a8a-4e95-8f27-3891a39728fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:25.408462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd681ec-7a8a-4e95-8f27-3891a39728fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:25.410245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd681ec-7a8a-4e95-8f27-3891a39728fc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:25.428504 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 362/693] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:25.429784 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd681ec-7a8a-4e95-8f27-3891a39728fc None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:25.445986 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d5a03-f4dc-42bd-b69e-6a1cdc8f3da6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:25.474853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:25.489923 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc79ecc-9f74-47be-8473-321146eab2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:25.490859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc79ecc-9f74-47be-8473-321146eab2de None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:25.491313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc79ecc-9f74-47be-8473-321146eab2de None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:25.491643 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc79ecc-9f74-47be-8473-321146eab2de None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:25.492411 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc79ecc-9f74-47be-8473-321146eab2de None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:25.492774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc79ecc-9f74-47be-8473-321146eab2de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:25.494482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc79ecc-9f74-47be-8473-321146eab2de None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:25.508886 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 332/694] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jul 19 10:52:25 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:25.509967 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc79ecc-9f74-47be-8473-321146eab2de None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:25.562632 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:25.571648 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd681ec-7a8a-4e95-8f27-3891a39728fc None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:25.615328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3169c-8d9b-4133-9a53-275dda314243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:25.616589 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3169c-8d9b-4133-9a53-275dda314243 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:25.617119 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3169c-8d9b-4133-9a53-275dda314243 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:25.617624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3169c-8d9b-4133-9a53-275dda314243 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:25.631816 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a3169c-8d9b-4133-9a53-275dda314243 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:25.640195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-07a3169c-8d9b-4133-9a53-275dda314243 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:25.640195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:25.640195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:25.640195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:25.640195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:25.640195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:25.640195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:25.640195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:25.640195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:25.640195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:25.640195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:25.640195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:25.640195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:25.640195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:25.640195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:25.640195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:25.641265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:25.641265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:25.641265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:25.641265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:25.641265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:25.641265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:25.641265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:25.641265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:25.641265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:25.641265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:25.641265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:25.641265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:25.641265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:25.641265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:25.641265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:25.641265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:25.642140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:25.642140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:25.642140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:25.642140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:25.642140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:25.642140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:25.642140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:25.642140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:25.642140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:25.642140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:25.642140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:25.642140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:25.645304 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 363/695] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:52:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:25.658121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3169c-8d9b-4133-9a53-275dda314243 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:25.741580 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc79ecc-9f74-47be-8473-321146eab2de None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:25.826830 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27064d4-4244-46fb-800c-26489b00e419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:25.828237 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27064d4-4244-46fb-800c-26489b00e419 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:25.828743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27064d4-4244-46fb-800c-26489b00e419 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:25.831550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27064d4-4244-46fb-800c-26489b00e419 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:25.833515 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3169c-8d9b-4133-9a53-275dda314243 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:25.855676 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27064d4-4244-46fb-800c-26489b00e419 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:25.858704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27064d4-4244-46fb-800c-26489b00e419 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:25.886424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e27064d4-4244-46fb-800c-26489b00e419 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:25.886424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:25.886424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:25.886424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:25.886424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:25.886424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:25.886424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:25.886424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:25.886424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:25.886424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:25.886424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:25.886424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:25.886424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:25.886424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:25.886424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:25.887414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:25.887414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:25.887414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:25.887414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:25.887414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:25.887414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:25.887414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:25.887414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:25.887414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:25.887414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:25.887414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:25.887414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:25.887414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:25.887414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:25.887414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:25.887414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:25.887414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:25.888291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:25.888291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:25.888291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:25.888291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:25.888291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:25.888291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:25.888291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:25.888291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:25.889266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 333/696] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:25.890865 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e2c56-70a1-43d9-855d-d34b9f901fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:25.891554 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e2c56-70a1-43d9-855d-d34b9f901fff None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:25.891832 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e2c56-70a1-43d9-855d-d34b9f901fff None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:25.892106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e2c56-70a1-43d9-855d-d34b9f901fff None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:25.892909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e2c56-70a1-43d9-855d-d34b9f901fff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:25.893216 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e2c56-70a1-43d9-855d-d34b9f901fff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:25.894638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e2c56-70a1-43d9-855d-d34b9f901fff None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:25.897290 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27064d4-4244-46fb-800c-26489b00e419 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:25.908032 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 364/697] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:25.914188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e2c56-70a1-43d9-855d-d34b9f901fff None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:25.953360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:26.001202 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:26.093338 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27064d4-4244-46fb-800c-26489b00e419 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:26.122518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e2c56-70a1-43d9-855d-d34b9f901fff None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:26.135543 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc89199-604c-4acd-86af-4fbd53b6822e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:26.136356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc89199-604c-4acd-86af-4fbd53b6822e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:26.136733 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc89199-604c-4acd-86af-4fbd53b6822e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:26.137091 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc89199-604c-4acd-86af-4fbd53b6822e None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:26.137978 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc89199-604c-4acd-86af-4fbd53b6822e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:26.138356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc89199-604c-4acd-86af-4fbd53b6822e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:26.139909 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc89199-604c-4acd-86af-4fbd53b6822e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:26.155464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 334/698] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:26.164343 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc89199-604c-4acd-86af-4fbd53b6822e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:26.222505 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d03c24-ab2b-4c68-b7ed-bf1a81200f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:26.223708 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d03c24-ab2b-4c68-b7ed-bf1a81200f35 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:26.224237 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d03c24-ab2b-4c68-b7ed-bf1a81200f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:26.224751 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d03c24-ab2b-4c68-b7ed-bf1a81200f35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:26.253770 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d03c24-ab2b-4c68-b7ed-bf1a81200f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:26.255699 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d03c24-ab2b-4c68-b7ed-bf1a81200f35 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:26.296752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-97d03c24-ab2b-4c68-b7ed-bf1a81200f35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:26.296752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:26.296752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:26.296752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:26.296752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:26.296752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:26.296752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:26.296752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:26.296752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:26.296752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:26.296752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:26.296752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:26.296752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:26.296752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:26.296752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:26.297702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:26.297702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:26.297702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:26.297702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:26.297702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:26.297702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:26.297702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:26.297702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:26.297702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:26.297702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:26.297702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:26.297702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:26.297702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:26.297702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:26.297702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:26.297702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:26.297702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:26.298561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:26.298561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:26.298561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:26.298561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:26.304788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc89199-604c-4acd-86af-4fbd53b6822e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:26.305621 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 365/699] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:26.311399 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d03c24-ab2b-4c68-b7ed-bf1a81200f35 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:26.317272 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:26.346178 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcae7f8-e0cb-4940-9769-b2f846b5f4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:26.347147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcae7f8-e0cb-4940-9769-b2f846b5f4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:26.347531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcae7f8-e0cb-4940-9769-b2f846b5f4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:26.347903 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcae7f8-e0cb-4940-9769-b2f846b5f4a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:26.348899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcae7f8-e0cb-4940-9769-b2f846b5f4a0 None admin] RBAC: Adding query filter params (role.id=669088b4ca4644f4bb586dfeaf427fb0, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=4fa6a9aa611640f893b5e717a094acf7) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:26.350108 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcae7f8-e0cb-4940-9769-b2f846b5f4a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:26.356764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcae7f8-e0cb-4940-9769-b2f846b5f4a0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:26.360022 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 335/700] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:26 2022] GET /identity/v3/role_assignments?user.id=4fa6a9aa611640f893b5e717a094acf7&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=669088b4ca4644f4bb586dfeaf427fb0 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:26.422674 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:26.491858 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d03c24-ab2b-4c68-b7ed-bf1a81200f35 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:26.532464 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b75e16-b5ca-4f9a-9305-5cb45397d09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:26.533124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b75e16-b5ca-4f9a-9305-5cb45397d09c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:26.533407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b75e16-b5ca-4f9a-9305-5cb45397d09c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:26.533684 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b75e16-b5ca-4f9a-9305-5cb45397d09c None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:26.534438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b75e16-b5ca-4f9a-9305-5cb45397d09c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:26.534748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b75e16-b5ca-4f9a-9305-5cb45397d09c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:26.536199 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b75e16-b5ca-4f9a-9305-5cb45397d09c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:26.559102 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 366/701] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:26.567548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcae7f8-e0cb-4940-9769-b2f846b5f4a0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:26.709857 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcae7f8-e0cb-4940-9769-b2f846b5f4a0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:26.748117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20441b89-06bc-4b3b-b928-1f9494f8a40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:26.748966 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20441b89-06bc-4b3b-b928-1f9494f8a40e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:26.749249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20441b89-06bc-4b3b-b928-1f9494f8a40e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:26.749526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20441b89-06bc-4b3b-b928-1f9494f8a40e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:26.758287 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20441b89-06bc-4b3b-b928-1f9494f8a40e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:26.759759 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20441b89-06bc-4b3b-b928-1f9494f8a40e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:26.775289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-20441b89-06bc-4b3b-b928-1f9494f8a40e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:52:26.775289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:26.775289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:26.775289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:26.775289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:26.775289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:26.775289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:26.775289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:26.775289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:26.775289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:26.775289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:26.775289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:26.775289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:26.775289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:26.775289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:26.775289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:26.777135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:26.777135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:26.777135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:26.777135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:26.777135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:26.777135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:26.777135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:26.777135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:26.777135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:26.777135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:26.777135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:26.777135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:26.777135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:26.777135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:26.777135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:26.777135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:26.777135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:26.777135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:26.779024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:26.779024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:26.779024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:26.779024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:26.779024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:26.779024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:26.779024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:26.779024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:26.779024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:52:26.779024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:26.779024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 336/702] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 19 10:52:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:26.780073 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d03536-386a-45e4-91e5-d6400a2962e9 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:26.780073 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d03536-386a-45e4-91e5-d6400a2962e9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:26.780073 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d03536-386a-45e4-91e5-d6400a2962e9 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:26.784834 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 367/703] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:26.788421 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4543b-7a5c-4832-8ac7-bdec0cb4151f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:26.788706 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4543b-7a5c-4832-8ac7-bdec0cb4151f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:26.789130 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4543b-7a5c-4832-8ac7-bdec0cb4151f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:26.790326 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d03536-386a-45e4-91e5-d6400a2962e9 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:26.815602 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4eb4543b-7a5c-4832-8ac7-bdec0cb4151f None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:26.817248 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4eb4543b-7a5c-4832-8ac7-bdec0cb4151f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:26.853712 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:26.908927 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 337/704] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:26.927734 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4543b-7a5c-4832-8ac7-bdec0cb4151f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:26.928796 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d03536-386a-45e4-91e5-d6400a2962e9 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:26.967001 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:26.974751 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72cbe3-afc0-4aae-b207-05b2e794ac94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:26.975453 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72cbe3-afc0-4aae-b207-05b2e794ac94 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:26.975732 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72cbe3-afc0-4aae-b207-05b2e794ac94 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:26.976002 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72cbe3-afc0-4aae-b207-05b2e794ac94 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:26.977206 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72cbe3-afc0-4aae-b207-05b2e794ac94 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:26.977512 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72cbe3-afc0-4aae-b207-05b2e794ac94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:26.979001 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72cbe3-afc0-4aae-b207-05b2e794ac94 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:27.003683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 368/705] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 19 10:52:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:27.013322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72cbe3-afc0-4aae-b207-05b2e794ac94 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:27.062085 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4543b-7a5c-4832-8ac7-bdec0cb4151f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:27.103607 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ec6b0-b595-48d5-8f77-2baa3fa73b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:27.105381 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ec6b0-b595-48d5-8f77-2baa3fa73b65 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:27.105944 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ec6b0-b595-48d5-8f77-2baa3fa73b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:27.106444 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ec6b0-b595-48d5-8f77-2baa3fa73b65 None admin] PATH_INFO: `/v3/services/network` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:27.107361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ec6b0-b595-48d5-8f77-2baa3fa73b65 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:27.109025 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ec6b0-b595-48d5-8f77-2baa3fa73b65 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:27.125485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-6c3ec6b0-b595-48d5-8f77-2baa3fa73b65 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 10:52:27.125485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:27.125485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:52:27.125485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:52:27.125485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:52:27.125485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:52:27.125485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:52:27.125485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:27.125485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 10:52:27.125485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:27.125485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:52:27.125485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:27.125485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:27.125485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:27.125485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:27.125485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:27.125485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:27.126527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:27.126527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:27.126527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:27.126527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:27.126527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:27.126527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:27.126527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:52:27.126527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:52:27.126527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:52:27.126527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:52:27.126527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:27.126527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:27.126527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:27.126527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:27.126527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:27.126527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:27.127376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:27.127376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:27.127376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:27.127376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:27.127376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:27.127376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:27.127376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:27.127376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:27.127376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:27.127376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:27.127376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:52:27.127376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:27.127376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 10:52:27.127376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:27.135483 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 338/706] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:26 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:27.137271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ec6b0-b595-48d5-8f77-2baa3fa73b65 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:27.139298 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72cbe3-afc0-4aae-b207-05b2e794ac94 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:27.184134 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f060850-a319-4004-8fda-b4e438ef2b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:27.184829 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f060850-a319-4004-8fda-b4e438ef2b9c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:27.185110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f060850-a319-4004-8fda-b4e438ef2b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:27.185381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f060850-a319-4004-8fda-b4e438ef2b9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:27.196553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:27.258572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ec6b0-b595-48d5-8f77-2baa3fa73b65 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:27.273399 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:27.297181 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f060850-a319-4004-8fda-b4e438ef2b9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:27.301663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f060850-a319-4004-8fda-b4e438ef2b9c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:27.332762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d82623-fd40-44eb-b946-ac46fe630040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:27.334859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d82623-fd40-44eb-b946-ac46fe630040 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:27.335542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d82623-fd40-44eb-b946-ac46fe630040 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:27.337356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d82623-fd40-44eb-b946-ac46fe630040 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:27.338313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d82623-fd40-44eb-b946-ac46fe630040 None admin] RBAC: Adding query filter params (name=network) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:27.339038 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d82623-fd40-44eb-b946-ac46fe630040 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:27.341456 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d82623-fd40-44eb-b946-ac46fe630040 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:27.350942 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 339/707] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 19 10:52:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:27.358186 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d82623-fd40-44eb-b946-ac46fe630040 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:27.514504 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 369/708] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:27.523872 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f060850-a319-4004-8fda-b4e438ef2b9c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:27.557241 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:27.562926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d82623-fd40-44eb-b946-ac46fe630040 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:27.629156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c47103-f755-43f5-a006-335805aaf8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:27.629742 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c47103-f755-43f5-a006-335805aaf8bf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:27.630026 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c47103-f755-43f5-a006-335805aaf8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:27.630525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c47103-f755-43f5-a006-335805aaf8bf None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:27.631338 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c47103-f755-43f5-a006-335805aaf8bf None admin] RBAC: Adding query filter params (type=network) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:27.631649 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c47103-f755-43f5-a006-335805aaf8bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:27.633165 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c47103-f755-43f5-a006-335805aaf8bf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:27.639047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 340/709] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 19 10:52:27 2022] GET /identity/v3/services?type=network => generated 124 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:27.698761 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:27.717526 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f060850-a319-4004-8fda-b4e438ef2b9c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:27.826500 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579ac40-8433-4023-a3de-3b6f93ebc05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:27.827886 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579ac40-8433-4023-a3de-3b6f93ebc05c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:27.828366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579ac40-8433-4023-a3de-3b6f93ebc05c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:27.828876 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579ac40-8433-4023-a3de-3b6f93ebc05c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:27.834501 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac02d8c-f7b7-4f6c-a133-a110f061ba35 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:27.834781 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac02d8c-f7b7-4f6c-a133-a110f061ba35 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:27.835104 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac02d8c-f7b7-4f6c-a133-a110f061ba35 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:27.836811 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 341/710] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:27.843005 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a59fa-4ea3-4c52-8e84-375579356084 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:27.843428 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a59fa-4ea3-4c52-8e84-375579356084 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:27.843717 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a59fa-4ea3-4c52-8e84-375579356084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:27.854113 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579ac40-8433-4023-a3de-3b6f93ebc05c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:27.856931 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579ac40-8433-4023-a3de-3b6f93ebc05c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:27.865401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fc0a59fa-4ea3-4c52-8e84-375579356084 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:27.866635 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fc0a59fa-4ea3-4c52-8e84-375579356084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:27.898412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-b579ac40-8433-4023-a3de-3b6f93ebc05c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:27.898412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:27.898412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:27.898412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:27.898412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:27.898412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:27.898412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:27.898412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:27.898412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:27.898412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:27.898412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:27.898412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:27.898412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:27.898412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:27.898412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:27.899321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:27.899321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:27.899321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:27.899321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:27.899321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:27.899321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:27.899321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:27.899321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:27.899321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:27.899321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:27.899321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:27.899321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:27.899321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:27.899321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:27.899321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:27.899321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:27.899321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:27.900198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:27.900198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:27.900198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:27.900198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:27.902318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 370/711] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:27.911337 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579ac40-8433-4023-a3de-3b6f93ebc05c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:27.960750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 342/712] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:27.994168 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a59fa-4ea3-4c52-8e84-375579356084 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:28.132545 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579ac40-8433-4023-a3de-3b6f93ebc05c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:28.171969 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121114e2-583a-4796-bf54-8b32a061e5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:28.172873 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121114e2-583a-4796-bf54-8b32a061e5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:28.173281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121114e2-583a-4796-bf54-8b32a061e5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:28.173654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121114e2-583a-4796-bf54-8b32a061e5e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:28.174544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121114e2-583a-4796-bf54-8b32a061e5e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:28.174978 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121114e2-583a-4796-bf54-8b32a061e5e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:28.176520 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121114e2-583a-4796-bf54-8b32a061e5e4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:28.186418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:28.190847 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 371/713] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:28.214822 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121114e2-583a-4796-bf54-8b32a061e5e4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:28.219227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:28.252999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a59fa-4ea3-4c52-8e84-375579356084 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:28.336979 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716e0ad-7916-45c7-acd5-2e2c51242b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:28.338348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716e0ad-7916-45c7-acd5-2e2c51242b6b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:28.338854 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716e0ad-7916-45c7-acd5-2e2c51242b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:28.339348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716e0ad-7916-45c7-acd5-2e2c51242b6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:28.370782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716e0ad-7916-45c7-acd5-2e2c51242b6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:28.373814 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716e0ad-7916-45c7-acd5-2e2c51242b6b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:28.472960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-4716e0ad-7916-45c7-acd5-2e2c51242b6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:28.472960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:28.472960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:28.472960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:28.472960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:28.472960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:28.472960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:28.472960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:28.472960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:28.472960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:28.472960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:28.472960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:28.472960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:28.472960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:28.472960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:28.474058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:28.474058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:28.474058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:28.474058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:28.474058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:28.474058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:28.474058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:28.474058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:28.474058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:28.474058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:28.474058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:28.474058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:28.474058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:28.474058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:28.474058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:28.474058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:28.474058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:28.474957 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:28.474957 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:28.474957 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:28.474957 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:28.478293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 343/714] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 485 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:28.486065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716e0ad-7916-45c7-acd5-2e2c51242b6b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:28.539518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121114e2-583a-4796-bf54-8b32a061e5e4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:28.640245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3583e7-2f09-4c20-81a6-0d35b51d959a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:28.641106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3583e7-2f09-4c20-81a6-0d35b51d959a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:28.644655 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3583e7-2f09-4c20-81a6-0d35b51d959a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:28.645022 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3583e7-2f09-4c20-81a6-0d35b51d959a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:28.658840 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3583e7-2f09-4c20-81a6-0d35b51d959a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:28.660337 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3583e7-2f09-4c20-81a6-0d35b51d959a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:28.693097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-fd3583e7-2f09-4c20-81a6-0d35b51d959a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:28.693097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:28.693097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:28.693097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:28.693097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:28.693097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:28.693097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:28.693097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:28.693097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:28.693097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:28.693097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:28.693097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:28.693097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:28.693097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:28.693097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:28.695236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:28.695236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:28.695236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:28.695236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:28.695236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:28.695236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:28.695236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:28.695236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:28.695236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:28.695236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:28.695236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:28.695236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:28.695236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:28.695236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:28.695236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:28.695236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:28.695236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:28.697488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:28.697488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:28.697488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:28.697488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:28.697488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:28.697488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:28.697488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:28.697488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:28.697488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 372/715] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 482 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:28.705739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3583e7-2f09-4c20-81a6-0d35b51d959a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:28.742920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716e0ad-7916-45c7-acd5-2e2c51242b6b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:28.813403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7261b8-5505-4d7a-b6d2-941f3aeeb480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:28.814097 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7261b8-5505-4d7a-b6d2-941f3aeeb480 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:28.814378 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7261b8-5505-4d7a-b6d2-941f3aeeb480 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:28.814649 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7261b8-5505-4d7a-b6d2-941f3aeeb480 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:28.815384 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7261b8-5505-4d7a-b6d2-941f3aeeb480 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:28.815689 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7261b8-5505-4d7a-b6d2-941f3aeeb480 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:28.817115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7261b8-5505-4d7a-b6d2-941f3aeeb480 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:28.829334 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:28.830518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:28.845687 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 344/716] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:28.854987 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7261b8-5505-4d7a-b6d2-941f3aeeb480 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:28.962957 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3583e7-2f09-4c20-81a6-0d35b51d959a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:28.987288 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7261b8-5505-4d7a-b6d2-941f3aeeb480 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:29.038790 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3e2aa-e51d-4378-b2cf-eac79dbd5b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:29.039910 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3e2aa-e51d-4378-b2cf-eac79dbd5b86 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:29.040412 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3e2aa-e51d-4378-b2cf-eac79dbd5b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:29.040968 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3e2aa-e51d-4378-b2cf-eac79dbd5b86 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:29.041943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3e2aa-e51d-4378-b2cf-eac79dbd5b86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:29.043693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3e2aa-e51d-4378-b2cf-eac79dbd5b86 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:29.060747 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6952c8-699c-4ee4-9a8d-0e95c27bfa12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:29.061830 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6952c8-699c-4ee4-9a8d-0e95c27bfa12 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:29.062322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6952c8-699c-4ee4-9a8d-0e95c27bfa12 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:29.062801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6952c8-699c-4ee4-9a8d-0e95c27bfa12 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:29.063851 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6952c8-699c-4ee4-9a8d-0e95c27bfa12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:29.064366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6952c8-699c-4ee4-9a8d-0e95c27bfa12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:29.067703 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6952c8-699c-4ee4-9a8d-0e95c27bfa12 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:29.092296 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 345/717] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 19 10:52:28 2022] POST /identity/v3/users => generated 254 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:52:29.099204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 373/718] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:29.109580 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3e2aa-e51d-4378-b2cf-eac79dbd5b86 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:29.238745 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:29.279655 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e9e1e-3419-4c0d-a6b4-470946799e35 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:29.280628 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e9e1e-3419-4c0d-a6b4-470946799e35 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:29.281457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e9e1e-3419-4c0d-a6b4-470946799e35 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:29.284690 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 374/719] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:29.294369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37978727-a1b7-4c35-8df1-eab205f6084b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:29.295311 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37978727-a1b7-4c35-8df1-eab205f6084b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:29.296018 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37978727-a1b7-4c35-8df1-eab205f6084b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:29.331963 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-37978727-a1b7-4c35-8df1-eab205f6084b None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:29.334587 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-37978727-a1b7-4c35-8df1-eab205f6084b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:29.349139 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3e2aa-e51d-4378-b2cf-eac79dbd5b86 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:29.401423 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5696917-4ee9-4c69-8615-16dd66849f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:29.402114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5696917-4ee9-4c69-8615-16dd66849f01 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:29.402416 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5696917-4ee9-4c69-8615-16dd66849f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:29.402675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5696917-4ee9-4c69-8615-16dd66849f01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:29.403529 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5696917-4ee9-4c69-8615-16dd66849f01 None admin] RBAC: Adding query filter params (role.id=3f9528e7a7914797a4635aa6b536b7ff, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=3c50a821e9ef44cb9fccd49ee4af7dbf) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:29.403850 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5696917-4ee9-4c69-8615-16dd66849f01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:29.405568 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5696917-4ee9-4c69-8615-16dd66849f01 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:29.412627 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 346/720] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:29 2022] GET /identity/v3/role_assignments?user.id=3c50a821e9ef44cb9fccd49ee4af7dbf&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=3f9528e7a7914797a4635aa6b536b7ff => generated 259 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:29.472479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 375/721] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:52:29.501239 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5696917-4ee9-4c69-8615-16dd66849f01 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:29.628602 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5696917-4ee9-4c69-8615-16dd66849f01 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:29.650522 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:29.677640 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c8e26-e6d1-4bcb-ac1a-00ac921dbc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:29.678342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c8e26-e6d1-4bcb-ac1a-00ac921dbc5e None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:29.678629 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c8e26-e6d1-4bcb-ac1a-00ac921dbc5e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:29.678909 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c8e26-e6d1-4bcb-ac1a-00ac921dbc5e None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:29.679737 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c8e26-e6d1-4bcb-ac1a-00ac921dbc5e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:29.681253 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c8e26-e6d1-4bcb-ac1a-00ac921dbc5e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:29.692565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0b185-5668-4420-92a9-977c47d6a8dd None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:29.692979 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0b185-5668-4420-92a9-977c47d6a8dd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:29.693351 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0b185-5668-4420-92a9-977c47d6a8dd None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:29.695183 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 376/722] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:52:29.701400 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99b282-af01-4b3d-90a3-fc885724df67 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:29.701686 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99b282-af01-4b3d-90a3-fc885724df67 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:29.702113 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99b282-af01-4b3d-90a3-fc885724df67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:29.704413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 347/723] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 19 10:52:29 2022] POST /identity/v3/services => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 10:52:29.741796 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bc99b282-af01-4b3d-90a3-fc885724df67 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:29.743187 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bc99b282-af01-4b3d-90a3-fc885724df67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:29.814116 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:29.858969 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 377/724] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:29 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:29.895508 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c8e26-e6d1-4bcb-ac1a-00ac921dbc5e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:30.117495 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c8e26-e6d1-4bcb-ac1a-00ac921dbc5e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:30.173950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2d1e9-d94e-4a63-8c8e-f64020ac9e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:30.175279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2d1e9-d94e-4a63-8c8e-f64020ac9e93 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:30.175784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2d1e9-d94e-4a63-8c8e-f64020ac9e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:30.176287 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2d1e9-d94e-4a63-8c8e-f64020ac9e93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:30.195990 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2d1e9-d94e-4a63-8c8e-f64020ac9e93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:30.211534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e8c2d1e9-d94e-4a63-8c8e-f64020ac9e93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:30.211534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:30.211534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:30.211534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:30.211534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:30.211534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:30.211534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:30.211534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:30.211534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:30.211534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:30.211534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:30.211534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:30.211534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:30.211534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:30.211534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:30.211534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:30.212534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:30.212534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:30.212534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:30.212534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:30.212534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:30.212534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:30.212534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:30.212534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:30.212534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:30.212534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:30.212534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:30.212534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:30.212534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:30.212534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:30.212534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:30.212534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:30.213399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:30.213399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:30.213399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:30.213399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:30.213399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:30.213399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:30.213399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:30.213399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:30.213399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:30.213399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:30.213399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:30.213399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:30.214306 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 348/725] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:52:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:30.221907 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99b282-af01-4b3d-90a3-fc885724df67 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:30.406188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99b282-af01-4b3d-90a3-fc885724df67 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:30.478396 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0143eb-d898-45c1-839d-df2aca4ea915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:30.479555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0143eb-d898-45c1-839d-df2aca4ea915 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:30.480040 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0143eb-d898-45c1-839d-df2aca4ea915 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:30.480519 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0143eb-d898-45c1-839d-df2aca4ea915 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:30.482026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0143eb-d898-45c1-839d-df2aca4ea915 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:30.482486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0143eb-d898-45c1-839d-df2aca4ea915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:30.484752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0143eb-d898-45c1-839d-df2aca4ea915 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:30.507758 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 378/726] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:30.513599 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2d1e9-d94e-4a63-8c8e-f64020ac9e93 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:30.581656 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:30.660397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2d1e9-d94e-4a63-8c8e-f64020ac9e93 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:30.703382 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c04ba-9b19-4044-afe8-5cbab0377c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:30.704227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c04ba-9b19-4044-afe8-5cbab0377c2e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:30.704508 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c04ba-9b19-4044-afe8-5cbab0377c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:30.704817 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c04ba-9b19-4044-afe8-5cbab0377c2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:30.717934 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c04ba-9b19-4044-afe8-5cbab0377c2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:30.719434 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c04ba-9b19-4044-afe8-5cbab0377c2e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:30.739631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-0b1c04ba-9b19-4044-afe8-5cbab0377c2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:30.739631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:30.739631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:30.739631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:30.739631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:30.739631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:30.739631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:30.739631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:30.739631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:30.739631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:30.739631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:30.739631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:30.739631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:30.739631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:30.739631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:30.742794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:30.742794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:30.742794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:30.742794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:30.742794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:30.742794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:30.742794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:30.742794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:30.742794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:30.742794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:30.742794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:30.742794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:30.742794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:30.742794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:30.742794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:30.742794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:30.742794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:30.750262 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:30.750262 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:30.750262 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:30.750262 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:30.750262 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 349/727] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:30.751270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0143eb-d898-45c1-839d-df2aca4ea915 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:30.858551 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:30.988766 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0143eb-d898-45c1-839d-df2aca4ea915 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:31.070059 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7546b3-cdf2-49dd-9235-26ecff39f247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:31.071204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7546b3-cdf2-49dd-9235-26ecff39f247 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:31.071685 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7546b3-cdf2-49dd-9235-26ecff39f247 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:31.072169 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7546b3-cdf2-49dd-9235-26ecff39f247 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:31.073569 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7546b3-cdf2-49dd-9235-26ecff39f247 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:31.074094 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7546b3-cdf2-49dd-9235-26ecff39f247 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:31.076646 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7546b3-cdf2-49dd-9235-26ecff39f247 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:31.105779 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 379/728] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:31.111482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c04ba-9b19-4044-afe8-5cbab0377c2e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:31.290298 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:31.313662 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c04ba-9b19-4044-afe8-5cbab0377c2e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:31.378078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e2744-339b-46eb-a33a-874c80a10548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:31.379469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e2744-339b-46eb-a33a-874c80a10548 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:31.380003 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e2744-339b-46eb-a33a-874c80a10548 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:31.380493 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e2744-339b-46eb-a33a-874c80a10548 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:31.395948 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e2744-339b-46eb-a33a-874c80a10548 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:31.398723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e2744-339b-46eb-a33a-874c80a10548 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:31.429672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d04e2744-339b-46eb-a33a-874c80a10548 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:52:31.429672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:31.429672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:31.429672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:31.429672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:31.429672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:31.429672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:31.429672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:31.429672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:31.429672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:31.429672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:31.429672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:31.429672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:31.429672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:31.429672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:31.429672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:31.431216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:31.431216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:31.431216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:31.431216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:31.431216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:31.431216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:31.431216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:31.431216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:31.431216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:31.431216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:31.431216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:31.431216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:31.431216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:31.431216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:31.431216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:31.431216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:31.431216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:31.431216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:31.432220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:31.432220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:31.432220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:31.432220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:31.432220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:31.432220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:31.432220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:31.432220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:31.432220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:52:31.432220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:31.432220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 350/729] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:52:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:31.445568 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7546b3-cdf2-49dd-9235-26ecff39f247 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:31.615881 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb40706-ccde-4096-ace5-88ef359f6670 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:31.617475 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb40706-ccde-4096-ace5-88ef359f6670 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:31.618251 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb40706-ccde-4096-ace5-88ef359f6670 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:31.621692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 351/730] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:52:31.630993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ebeaf-f362-4b21-bc6a-ae9ec2284e04 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:31.631491 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ebeaf-f362-4b21-bc6a-ae9ec2284e04 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:31.631991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ebeaf-f362-4b21-bc6a-ae9ec2284e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:31.674147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ea6ebeaf-f362-4b21-bc6a-ae9ec2284e04 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:31.676227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ea6ebeaf-f362-4b21-bc6a-ae9ec2284e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:31.703676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:31.710705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7546b3-cdf2-49dd-9235-26ecff39f247 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:31.840773 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b10f82-9f1c-413d-916b-ad8656af5ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:31.841935 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b10f82-9f1c-413d-916b-ad8656af5ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:31.842694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b10f82-9f1c-413d-916b-ad8656af5ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:31.843184 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b10f82-9f1c-413d-916b-ad8656af5ec7 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:31.845446 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b10f82-9f1c-413d-916b-ad8656af5ec7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:31.845972 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b10f82-9f1c-413d-916b-ad8656af5ec7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:31.852975 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b10f82-9f1c-413d-916b-ad8656af5ec7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:31.907147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 352/731] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:52:31.921141 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 380/732] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jul 19 10:52:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 480 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:31.930958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ebeaf-f362-4b21-bc6a-ae9ec2284e04 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:31.952622 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b10f82-9f1c-413d-916b-ad8656af5ec7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:32.176866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:32.210166 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b10f82-9f1c-413d-916b-ad8656af5ec7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:32.251683 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ebeaf-f362-4b21-bc6a-ae9ec2284e04 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:32.295699 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753b555-d3d0-4a15-8aff-a15e204da7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:32.296972 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753b555-d3d0-4a15-8aff-a15e204da7cf None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:32.297426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753b555-d3d0-4a15-8aff-a15e204da7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:32.297876 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753b555-d3d0-4a15-8aff-a15e204da7cf None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:32.299140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753b555-d3d0-4a15-8aff-a15e204da7cf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:32.306074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753b555-d3d0-4a15-8aff-a15e204da7cf None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:32.349467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 381/733] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 19 10:52:31 2022] POST /identity/v3/services => generated 240 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:52:32.350677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f8439-2316-4426-b5b4-7cd306b169f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:32.352247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f8439-2316-4426-b5b4-7cd306b169f1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:32.352766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f8439-2316-4426-b5b4-7cd306b169f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:32.353254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f8439-2316-4426-b5b4-7cd306b169f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:32.486875 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f8439-2316-4426-b5b4-7cd306b169f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:32.488772 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f8439-2316-4426-b5b4-7cd306b169f1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:32.650195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857bdfc-6129-40a4-833a-2a8cf4bf52f7 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:32.650529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857bdfc-6129-40a4-833a-2a8cf4bf52f7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:32.650750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857bdfc-6129-40a4-833a-2a8cf4bf52f7 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:32.652394 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 382/734] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:32.658201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9af82-28d4-4666-ae3b-90db7676bee1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:32.658487 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9af82-28d4-4666-ae3b-90db7676bee1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:32.658772 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9af82-28d4-4666-ae3b-90db7676bee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:32.674926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:32.686690 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-04d9af82-28d4-4666-ae3b-90db7676bee1 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:32.688337 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-04d9af82-28d4-4666-ae3b-90db7676bee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:32.706212 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:32.724879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 353/735] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:31 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 790 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 10:52:32.727666 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f592d-3daf-471f-8595-bc3b15483fb3 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:32.728162 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f592d-3daf-471f-8595-bc3b15483fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:32.728623 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f592d-3daf-471f-8595-bc3b15483fb3 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:32.731531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 354/736] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:32.736213 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f592d-3daf-471f-8595-bc3b15483fb3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:32.829694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 383/737] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:52:32.835739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d42e4-82ba-47d3-bab1-4b8733f343a0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:32.835739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d42e4-82ba-47d3-bab1-4b8733f343a0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:32.836257 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d42e4-82ba-47d3-bab1-4b8733f343a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:32.884494 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-836d42e4-82ba-47d3-bab1-4b8733f343a0 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:32.886571 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-836d42e4-82ba-47d3-bab1-4b8733f343a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:32.985472 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f592d-3daf-471f-8595-bc3b15483fb3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:33.045918 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 384/738] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:52:33.047998 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d42e4-82ba-47d3-bab1-4b8733f343a0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:33.055759 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d1f59-b25c-41ae-b9cd-6f3251f008f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:33.056794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d1f59-b25c-41ae-b9cd-6f3251f008f2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:33.057254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d1f59-b25c-41ae-b9cd-6f3251f008f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:33.057703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d1f59-b25c-41ae-b9cd-6f3251f008f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:33.076931 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d1f59-b25c-41ae-b9cd-6f3251f008f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:33.079705 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d1f59-b25c-41ae-b9cd-6f3251f008f2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:33.115582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-f51d1f59-b25c-41ae-b9cd-6f3251f008f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:33.115582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:33.115582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:33.115582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:33.115582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:33.115582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:33.115582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:33.115582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:33.115582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:33.115582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:33.115582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:33.115582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:33.115582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:33.115582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:33.115582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:33.117342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:33.117342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:33.117342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:33.117342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:33.117342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:33.117342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:33.117342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:33.117342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:33.117342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:33.117342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:33.117342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:33.117342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:33.117342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:33.117342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:33.117342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:33.117342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:33.117342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:33.119072 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:33.119072 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:33.119072 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:33.119072 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:33.124953 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 355/739] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:33.126634 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d1f59-b25c-41ae-b9cd-6f3251f008f2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:33.179284 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:33.200633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:33.265580 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d42e4-82ba-47d3-bab1-4b8733f343a0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:33.314439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d1f59-b25c-41ae-b9cd-6f3251f008f2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:33.342345 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9157f6-cc46-476b-88f7-6df3918aa6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:33.344098 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9157f6-cc46-476b-88f7-6df3918aa6ac None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:33.344992 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9157f6-cc46-476b-88f7-6df3918aa6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:33.345684 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9157f6-cc46-476b-88f7-6df3918aa6ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:33.373228 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9157f6-cc46-476b-88f7-6df3918aa6ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:33.390326 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cf3f9-dbc5-4870-a7c6-3f33f807f268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:33.390848 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-0c9157f6-cc46-476b-88f7-6df3918aa6ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:33.390848 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:33.390848 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:33.390848 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:33.390848 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:33.390848 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:33.390848 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:33.390848 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:33.390848 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:33.390848 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:33.390848 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:33.390848 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:33.390848 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:33.390848 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:33.390848 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:33.390848 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:33.392539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:33.392539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:33.392539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:33.392539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:33.392539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:33.392539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:33.392539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:33.392539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:33.392539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:33.392539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:33.392539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:33.392539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:33.392539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:33.392539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:33.392539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:33.392539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:33.393736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:33.393736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:33.393736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:33.393736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:33.393736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:33.393736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:33.393736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:33.393736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:33.393736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:33.393736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:33.393736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:33.393736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:33.394646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cf3f9-dbc5-4870-a7c6-3f33f807f268 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:33.394646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cf3f9-dbc5-4870-a7c6-3f33f807f268 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:33.394646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cf3f9-dbc5-4870-a7c6-3f33f807f268 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:33.405249 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 385/740] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:52:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:33.407373 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9157f6-cc46-476b-88f7-6df3918aa6ac None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:33.418418 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cf3f9-dbc5-4870-a7c6-3f33f807f268 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:33.434047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e19cf3f9-dbc5-4870-a7c6-3f33f807f268 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:33.434047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:33.434047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:33.434047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:33.434047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:33.434047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:33.434047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:33.434047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:33.434047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:33.434047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:33.434047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:33.434047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:33.434047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:33.434047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:33.434047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:33.434047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:33.435829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:33.435829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:33.435829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:33.435829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:33.435829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:33.435829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:33.435829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:33.435829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:33.435829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:33.435829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:33.435829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:33.435829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:33.435829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:33.435829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:33.435829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:33.435829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:33.437452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:33.437452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:33.437452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:33.437452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:33.437452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:33.437452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:33.437452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:33.437452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:33.437452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:33.437452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:33.437452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:33.437452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:33.437452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 356/741] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:52:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:33.438771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cf3f9-dbc5-4870-a7c6-3f33f807f268 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:33.561790 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9157f6-cc46-476b-88f7-6df3918aa6ac None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:33.600554 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:33.608589 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b858a1-628a-4a60-86ed-f4fc4d9491f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:33.609308 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b858a1-628a-4a60-86ed-f4fc4d9491f6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:33.609589 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b858a1-628a-4a60-86ed-f4fc4d9491f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:33.609861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b858a1-628a-4a60-86ed-f4fc4d9491f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:33.610608 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b858a1-628a-4a60-86ed-f4fc4d9491f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:33.610916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b858a1-628a-4a60-86ed-f4fc4d9491f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:33.612347 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b858a1-628a-4a60-86ed-f4fc4d9491f6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:33.615588 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:33.626302 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 386/742] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:33.627387 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b858a1-628a-4a60-86ed-f4fc4d9491f6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:33.645198 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cf3f9-dbc5-4870-a7c6-3f33f807f268 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:33.708690 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a438886-12f8-4aaa-bb68-864745240e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:33.709939 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a438886-12f8-4aaa-bb68-864745240e71 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:33.710416 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a438886-12f8-4aaa-bb68-864745240e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:33.710898 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a438886-12f8-4aaa-bb68-864745240e71 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:33.712286 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a438886-12f8-4aaa-bb68-864745240e71 None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:33.712873 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a438886-12f8-4aaa-bb68-864745240e71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:33.715418 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a438886-12f8-4aaa-bb68-864745240e71 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:33.736765 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 357/743] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 19 10:52:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:33.736765 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a88f2-9d33-437d-b210-b244c951bcca None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:33.736765 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a88f2-9d33-437d-b210-b244c951bcca None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:33.736765 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a88f2-9d33-437d-b210-b244c951bcca None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:33.737944 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 358/744] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:33.741187 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a88f2-9d33-437d-b210-b244c951bcca None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:33.765737 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b858a1-628a-4a60-86ed-f4fc4d9491f6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:33.806450 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2940ae3-5419-41d5-8c38-78bca0c6f94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:33.807350 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2940ae3-5419-41d5-8c38-78bca0c6f94d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:33.807633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2940ae3-5419-41d5-8c38-78bca0c6f94d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:33.807989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2940ae3-5419-41d5-8c38-78bca0c6f94d None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:33.808778 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2940ae3-5419-41d5-8c38-78bca0c6f94d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:33.809091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2940ae3-5419-41d5-8c38-78bca0c6f94d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:33.810841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2940ae3-5419-41d5-8c38-78bca0c6f94d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:33.821209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 387/745] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:33.822003 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2940ae3-5419-41d5-8c38-78bca0c6f94d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:33.915310 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a88f2-9d33-437d-b210-b244c951bcca None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:33.919569 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:33.961833 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a659b-8185-4290-8e22-22c8c8ce9a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:33.962878 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a659b-8185-4290-8e22-22c8c8ce9a17 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:33.963046 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a659b-8185-4290-8e22-22c8c8ce9a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:33.963219 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a659b-8185-4290-8e22-22c8c8ce9a17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:33.971480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a659b-8185-4290-8e22-22c8c8ce9a17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:33.972874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a659b-8185-4290-8e22-22c8c8ce9a17 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:33.990853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-393a659b-8185-4290-8e22-22c8c8ce9a17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:33.990853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:33.990853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:33.990853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:33.990853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:33.990853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:33.990853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:33.990853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:33.990853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:33.990853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:33.990853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:33.990853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:33.990853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:33.990853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:33.990853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:33.992615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:33.992615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:33.992615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:33.992615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:33.992615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:33.992615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:33.992615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:33.992615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:33.992615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:33.992615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:33.992615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:33.992615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:33.992615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:33.992615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:33.992615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:33.992615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:33.992615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:33.994905 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:33.994905 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:33.994905 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:33.994905 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:33.994905 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:33.994905 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:33.994905 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:33.994905 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:33.994905 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 359/746] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:33.994905 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c92962-1db7-47d7-8f10-c4a27615fa35 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:33.994905 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c92962-1db7-47d7-8f10-c4a27615fa35 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:33.997600 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c92962-1db7-47d7-8f10-c4a27615fa35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:34.010386 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2940ae3-5419-41d5-8c38-78bca0c6f94d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:34.013324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f9c92962-1db7-47d7-8f10-c4a27615fa35 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:34.015495 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f9c92962-1db7-47d7-8f10-c4a27615fa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:34.026659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:34.071671 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e35822-ed30-4955-aa6d-f2d2920090e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:34.072929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e35822-ed30-4955-aa6d-f2d2920090e5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:34.073415 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e35822-ed30-4955-aa6d-f2d2920090e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:34.073864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e35822-ed30-4955-aa6d-f2d2920090e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:34.093565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e35822-ed30-4955-aa6d-f2d2920090e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:34.096049 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e35822-ed30-4955-aa6d-f2d2920090e5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:34.105662 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 360/747] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:52:34.106753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c92962-1db7-47d7-8f10-c4a27615fa35 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:34.127529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-e4e35822-ed30-4955-aa6d-f2d2920090e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:34.127529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:34.127529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:34.127529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:34.127529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:34.127529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:34.127529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:34.127529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:34.127529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:34.127529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:34.127529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:34.127529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:34.127529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:34.127529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:34.127529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:34.128598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:34.128598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:34.128598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:34.128598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:34.128598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:34.128598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:34.128598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:34.128598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:34.128598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:34.128598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:34.128598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:34.128598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:34.128598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:34.128598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:34.128598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:34.128598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:34.128598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:34.129637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:34.129637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:34.129637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:34.129637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:34.136628 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 388/748] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:34.138252 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e35822-ed30-4955-aa6d-f2d2920090e5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:34.237493 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c92962-1db7-47d7-8f10-c4a27615fa35 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:34.294806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264ae8c-fa4f-4949-9660-b5b0ef9aecfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:34.296064 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264ae8c-fa4f-4949-9660-b5b0ef9aecfb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:34.296534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264ae8c-fa4f-4949-9660-b5b0ef9aecfb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:34.297037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264ae8c-fa4f-4949-9660-b5b0ef9aecfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:34.304568 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e35822-ed30-4955-aa6d-f2d2920090e5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:34.314433 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264ae8c-fa4f-4949-9660-b5b0ef9aecfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:34.317075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264ae8c-fa4f-4949-9660-b5b0ef9aecfb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:34.318614 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:34.319545 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:34.349719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d264ae8c-fa4f-4949-9660-b5b0ef9aecfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:34.349719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:34.349719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:34.349719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:34.349719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:34.349719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:34.349719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:34.349719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:34.349719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:34.349719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:34.349719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:34.349719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:34.349719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:34.349719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:34.349719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:34.351938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:34.351938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:34.351938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:34.351938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:34.351938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:34.351938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:34.351938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:34.351938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:34.351938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:34.351938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:34.351938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:34.351938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:34.351938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:34.351938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:34.351938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:34.351938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:34.351938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:34.354342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:34.354342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:34.354342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:34.354342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:34.354342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 361/749] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:34.354342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264ae8c-fa4f-4949-9660-b5b0ef9aecfb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:34.376637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3287e-d7ab-45f9-a321-df05716d802a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:34.377635 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3287e-d7ab-45f9-a321-df05716d802a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:34.378074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3287e-d7ab-45f9-a321-df05716d802a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:34.378505 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3287e-d7ab-45f9-a321-df05716d802a None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:34.379779 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3287e-d7ab-45f9-a321-df05716d802a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:34.380290 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3287e-d7ab-45f9-a321-df05716d802a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:34.382590 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3287e-d7ab-45f9-a321-df05716d802a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:34.402146 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 389/750] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:34.403556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3287e-d7ab-45f9-a321-df05716d802a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:34.531117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264ae8c-fa4f-4949-9660-b5b0ef9aecfb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:34.572163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3287e-d7ab-45f9-a321-df05716d802a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:34.572602 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e379ef0-c061-41e7-9e37-291e5d77e18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:34.573380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e379ef0-c061-41e7-9e37-291e5d77e18e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:34.573714 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e379ef0-c061-41e7-9e37-291e5d77e18e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:34.574043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e379ef0-c061-41e7-9e37-291e5d77e18e None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:34.575007 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e379ef0-c061-41e7-9e37-291e5d77e18e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:34.575374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e379ef0-c061-41e7-9e37-291e5d77e18e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:34.577357 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e379ef0-c061-41e7-9e37-291e5d77e18e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:34.591383 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 362/751] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:34.592826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e379ef0-c061-41e7-9e37-291e5d77e18e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:34.634855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c7fa3-2bdc-491b-970a-5f4b57fe1257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:34.636189 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c7fa3-2bdc-491b-970a-5f4b57fe1257 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:34.636694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c7fa3-2bdc-491b-970a-5f4b57fe1257 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:34.637234 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c7fa3-2bdc-491b-970a-5f4b57fe1257 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:34.638515 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c7fa3-2bdc-491b-970a-5f4b57fe1257 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:34.641205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c7fa3-2bdc-491b-970a-5f4b57fe1257 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:34.665029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d49c7fa3-2bdc-491b-970a-5f4b57fe1257 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 10:52:34.665029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:34.665029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:52:34.665029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:52:34.665029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:52:34.665029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:52:34.665029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:52:34.665029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:34.665029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 10:52:34.665029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:34.665029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:52:34.665029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:34.665029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:34.665029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:34.665029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:34.665029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:34.666902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:34.666902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:34.666902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:34.666902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:34.666902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:34.666902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:34.666902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:34.666902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:52:34.666902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:52:34.666902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:52:34.666902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:52:34.666902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:34.666902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:34.666902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:34.666902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:34.666902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:34.668106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:34.668106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:34.668106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:34.668106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:34.668106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:34.668106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:34.668106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:34.668106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:34.668106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:34.668106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:34.668106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:34.668106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:52:34.668106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:34.668106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 10:52:34.668106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:34.672945 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 390/752] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Jul 19 10:52:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:34.675536 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c7fa3-2bdc-491b-970a-5f4b57fe1257 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:34.680058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:34.732312 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:34.762611 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e379ef0-c061-41e7-9e37-291e5d77e18e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:34.802671 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66786a2c-5984-4b31-8664-fdf709b42ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:34.803344 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66786a2c-5984-4b31-8664-fdf709b42ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:34.803629 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66786a2c-5984-4b31-8664-fdf709b42ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:34.803909 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66786a2c-5984-4b31-8664-fdf709b42ce9 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:34.804635 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66786a2c-5984-4b31-8664-fdf709b42ce9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:34.804972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66786a2c-5984-4b31-8664-fdf709b42ce9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:34.806357 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66786a2c-5984-4b31-8664-fdf709b42ce9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:34.819295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 363/753] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:34.820413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66786a2c-5984-4b31-8664-fdf709b42ce9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:34.839013 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c7fa3-2bdc-491b-970a-5f4b57fe1257 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:34.896539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641810cf-63d4-49b7-84d8-8e835113ae00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:34.897622 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641810cf-63d4-49b7-84d8-8e835113ae00 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:34.898127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641810cf-63d4-49b7-84d8-8e835113ae00 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:34.898620 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641810cf-63d4-49b7-84d8-8e835113ae00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:34.900260 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641810cf-63d4-49b7-84d8-8e835113ae00 None admin] RBAC: Adding query filter params (role.id=3f9528e7a7914797a4635aa6b536b7ff, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=4fa6a9aa611640f893b5e717a094acf7) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:34.900853 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641810cf-63d4-49b7-84d8-8e835113ae00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:34.903599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641810cf-63d4-49b7-84d8-8e835113ae00 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:34.914566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 391/754] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:34 2022] GET /identity/v3/role_assignments?user.id=4fa6a9aa611640f893b5e717a094acf7&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=3f9528e7a7914797a4635aa6b536b7ff => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:34.915352 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641810cf-63d4-49b7-84d8-8e835113ae00 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:34.945782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66786a2c-5984-4b31-8664-fdf709b42ce9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:34.976585 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:35.010513 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e36080-3d44-4623-9988-8ce5a206cf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:35.011441 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e36080-3d44-4623-9988-8ce5a206cf70 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:35.011713 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e36080-3d44-4623-9988-8ce5a206cf70 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:35.011928 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e36080-3d44-4623-9988-8ce5a206cf70 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:35.020932 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e36080-3d44-4623-9988-8ce5a206cf70 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:35.022500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e36080-3d44-4623-9988-8ce5a206cf70 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:35.040077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-37e36080-3d44-4623-9988-8ce5a206cf70 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:52:35.040077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:35.040077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:35.040077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:35.040077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:35.040077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:35.040077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:35.040077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:35.040077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:35.040077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:35.040077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:35.040077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:35.040077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:35.040077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:35.040077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:35.040077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:35.041849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:35.041849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:35.041849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:35.041849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:35.041849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:35.041849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:35.041849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:35.041849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:35.041849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:35.041849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:35.041849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:35.041849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:35.041849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:35.041849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:35.041849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:35.041849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:35.041849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:35.041849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:35.044157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:35.044157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:35.044157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:35.044157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:35.044157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:35.044157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:35.044157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:35.044157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:35.044157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:52:35.044157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:35.044157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 364/755] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jul 19 10:52:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:35.044157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e02f2-1ed6-4ea3-a86a-c6537d858aac None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:35.044157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e02f2-1ed6-4ea3-a86a-c6537d858aac None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:35.047194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e02f2-1ed6-4ea3-a86a-c6537d858aac None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:35.047194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 365/756] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:35.047194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e02f2-1ed6-4ea3-a86a-c6537d858aac None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:35.090887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:35.101366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641810cf-63d4-49b7-84d8-8e835113ae00 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:35.154139 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52688497-72b1-4e39-9494-ef9a976acd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:35.155101 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52688497-72b1-4e39-9494-ef9a976acd6c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:35.155592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52688497-72b1-4e39-9494-ef9a976acd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:35.156078 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52688497-72b1-4e39-9494-ef9a976acd6c None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:35.157452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52688497-72b1-4e39-9494-ef9a976acd6c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:35.157992 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52688497-72b1-4e39-9494-ef9a976acd6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:35.160476 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52688497-72b1-4e39-9494-ef9a976acd6c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:35.177025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 392/757] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jul 19 10:52:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:35.178591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52688497-72b1-4e39-9494-ef9a976acd6c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:35.190769 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e02f2-1ed6-4ea3-a86a-c6537d858aac None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:35.234110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62694f-5ebe-4c3a-a9aa-d715a3a513d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:35.234889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62694f-5ebe-4c3a-a9aa-d715a3a513d6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:35.235175 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62694f-5ebe-4c3a-a9aa-d715a3a513d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:35.235436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62694f-5ebe-4c3a-a9aa-d715a3a513d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:35.244257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62694f-5ebe-4c3a-a9aa-d715a3a513d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:35.245790 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62694f-5ebe-4c3a-a9aa-d715a3a513d6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:35.262044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-bc62694f-5ebe-4c3a-a9aa-d715a3a513d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:52:35.262044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:35.262044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:35.262044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:35.262044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:35.262044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:35.262044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:35.262044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:35.262044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:35.262044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:35.262044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:35.262044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:35.262044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:35.262044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:35.262044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:35.262044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:35.263993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:35.263993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:35.263993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:35.263993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:35.263993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:35.263993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:35.263993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:35.263993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:35.263993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:35.263993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:35.263993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:35.263993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:35.263993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:35.263993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:35.263993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:35.263993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:35.263993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:35.263993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:35.266321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:35.266321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:35.266321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:35.266321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:35.266321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:35.266321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:35.266321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:35.266321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:35.266321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:52:35.266321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:35.266321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 366/758] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 19 10:52:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:35.266321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5820cf1-9d3e-4a7f-80ee-48863063a346 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:35.266321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5820cf1-9d3e-4a7f-80ee-48863063a346 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:35.268665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5820cf1-9d3e-4a7f-80ee-48863063a346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:35.285902 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a5820cf1-9d3e-4a7f-80ee-48863063a346 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:35.287338 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a5820cf1-9d3e-4a7f-80ee-48863063a346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:35.320749 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:35.373845 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52688497-72b1-4e39-9494-ef9a976acd6c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:35.376780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 367/759] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:52:35.376780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5820cf1-9d3e-4a7f-80ee-48863063a346 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:35.454558 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2e744-fb2f-4dbf-ae31-b6d11a7663b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:35.455704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2e744-fb2f-4dbf-ae31-b6d11a7663b3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:35.456181 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2e744-fb2f-4dbf-ae31-b6d11a7663b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:35.456576 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2e744-fb2f-4dbf-ae31-b6d11a7663b3 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:35.458481 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2e744-fb2f-4dbf-ae31-b6d11a7663b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:35.458932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2e744-fb2f-4dbf-ae31-b6d11a7663b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:35.461863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2e744-fb2f-4dbf-ae31-b6d11a7663b3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:35.499689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 393/760] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jul 19 10:52:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:35.499689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2e744-fb2f-4dbf-ae31-b6d11a7663b3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:35.531985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5820cf1-9d3e-4a7f-80ee-48863063a346 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:35.534560 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:35.587575 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254c27b-e07c-4a58-9ef9-16b0a8a2b996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:35.588267 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254c27b-e07c-4a58-9ef9-16b0a8a2b996 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:35.588551 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254c27b-e07c-4a58-9ef9-16b0a8a2b996 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:35.588888 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254c27b-e07c-4a58-9ef9-16b0a8a2b996 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:35.589660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254c27b-e07c-4a58-9ef9-16b0a8a2b996 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:35.589989 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254c27b-e07c-4a58-9ef9-16b0a8a2b996 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:35.591414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254c27b-e07c-4a58-9ef9-16b0a8a2b996 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:35.597193 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 368/761] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jul 19 10:52:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:35.598039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254c27b-e07c-4a58-9ef9-16b0a8a2b996 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:35.651002 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:35.665207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2e744-fb2f-4dbf-ae31-b6d11a7663b3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:35.728837 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29d517-742f-4f69-b8e1-f4655c9c5e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:35.729937 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29d517-742f-4f69-b8e1-f4655c9c5e04 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:35.730651 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29d517-742f-4f69-b8e1-f4655c9c5e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:35.731155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29d517-742f-4f69-b8e1-f4655c9c5e04 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:35.732817 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29d517-742f-4f69-b8e1-f4655c9c5e04 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:35.733394 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29d517-742f-4f69-b8e1-f4655c9c5e04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:35.736050 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254c27b-e07c-4a58-9ef9-16b0a8a2b996 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:35.736188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29d517-742f-4f69-b8e1-f4655c9c5e04 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:35.773038 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 394/762] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 19 10:52:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:35.773038 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29d517-742f-4f69-b8e1-f4655c9c5e04 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:35.783042 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a01802-1ffa-4203-af65-9b781362ca78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:35.784538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a01802-1ffa-4203-af65-9b781362ca78 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:35.784993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a01802-1ffa-4203-af65-9b781362ca78 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:35.785552 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a01802-1ffa-4203-af65-9b781362ca78 None admin] PATH_INFO: `/v3/services/network` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:35.786928 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a01802-1ffa-4203-af65-9b781362ca78 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:35.789513 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a01802-1ffa-4203-af65-9b781362ca78 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:35.811173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-95a01802-1ffa-4203-af65-9b781362ca78 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 10:52:35.811173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:35.811173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:52:35.811173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:52:35.811173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:52:35.811173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:52:35.811173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:52:35.811173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:35.811173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 10:52:35.811173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:35.811173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:52:35.811173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:35.811173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:35.811173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:35.811173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:35.811173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:35.811173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:35.812313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:35.812313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:35.812313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:35.812313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:35.812313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:35.812313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:35.812313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:52:35.812313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:52:35.812313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:52:35.812313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:52:35.812313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:35.812313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:35.812313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:35.812313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:35.812313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:35.812313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:35.813606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:35.813606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:35.813606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:35.813606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:35.813606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:35.813606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:35.813606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:35.813606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:35.813606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:35.813606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:35.813606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:52:35.813606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:35.813606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 10:52:35.813606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:35.813606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 369/763] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:35 2022] GET /identity/v3/services/network => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:35.814812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a01802-1ffa-4203-af65-9b781362ca78 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:35.882721 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:35.917729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29d517-742f-4f69-b8e1-f4655c9c5e04 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:35.958612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae76210-fb60-409e-a6df-30428d94f236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:35.959446 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae76210-fb60-409e-a6df-30428d94f236 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:35.959797 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae76210-fb60-409e-a6df-30428d94f236 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:35.960123 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae76210-fb60-409e-a6df-30428d94f236 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:35.976887 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:35.991490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a01802-1ffa-4203-af65-9b781362ca78 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:36.046347 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2b4c4-cf1b-4ee8-9cc3-1256a2a6306f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:36.047177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2b4c4-cf1b-4ee8-9cc3-1256a2a6306f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:36.047638 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2b4c4-cf1b-4ee8-9cc3-1256a2a6306f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:36.048086 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2b4c4-cf1b-4ee8-9cc3-1256a2a6306f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:36.049498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2b4c4-cf1b-4ee8-9cc3-1256a2a6306f None admin] RBAC: Adding query filter params (interface=public, service_id=fd44c6f6d6ff4fa285828660ddc83572, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:36.050003 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2b4c4-cf1b-4ee8-9cc3-1256a2a6306f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:36.052271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2b4c4-cf1b-4ee8-9cc3-1256a2a6306f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:36.072308 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 370/764] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jul 19 10:52:35 2022] GET /identity/v3/endpoints?service_id=fd44c6f6d6ff4fa285828660ddc83572&interface=public®ion_id=RegionOne => generated 194 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:36.072308 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2b4c4-cf1b-4ee8-9cc3-1256a2a6306f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:36.078293 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae76210-fb60-409e-a6df-30428d94f236 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:36.079976 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae76210-fb60-409e-a6df-30428d94f236 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:36.203220 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:36.235033 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2b4c4-cf1b-4ee8-9cc3-1256a2a6306f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:36.251883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 395/765] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:52:36.253893 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae76210-fb60-409e-a6df-30428d94f236 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:36.291327 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ad15b-c0db-4328-9664-b63e44f86482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:36.292540 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ad15b-c0db-4328-9664-b63e44f86482 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:36.292872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ad15b-c0db-4328-9664-b63e44f86482 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:36.293209 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ad15b-c0db-4328-9664-b63e44f86482 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:36.312847 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ad15b-c0db-4328-9664-b63e44f86482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:36.315503 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ad15b-c0db-4328-9664-b63e44f86482 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:36.349794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-0e5ad15b-c0db-4328-9664-b63e44f86482 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:36.349794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:36.349794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:36.349794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:36.349794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:36.349794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:36.349794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:36.349794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:36.349794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:36.349794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:36.349794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:36.349794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:36.349794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:36.349794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:36.349794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:36.351525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:36.351525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:36.351525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:36.351525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:36.351525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:36.351525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:36.351525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:36.351525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:36.351525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:36.351525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:36.351525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:36.351525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:36.351525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:36.351525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:36.351525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:36.351525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:36.351525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:36.358179 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:36.358179 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:36.358179 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:36.358179 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:36.358179 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 371/766] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:36.358179 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ad15b-c0db-4328-9664-b63e44f86482 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:36.375278 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:36.396791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae76210-fb60-409e-a6df-30428d94f236 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:36.456353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76981e0-ebe6-4e1b-b29a-7e255bd287d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:36.456973 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76981e0-ebe6-4e1b-b29a-7e255bd287d1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:36.457218 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76981e0-ebe6-4e1b-b29a-7e255bd287d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:36.457475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76981e0-ebe6-4e1b-b29a-7e255bd287d1 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:36.458283 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76981e0-ebe6-4e1b-b29a-7e255bd287d1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:36.458586 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76981e0-ebe6-4e1b-b29a-7e255bd287d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:36.460324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76981e0-ebe6-4e1b-b29a-7e255bd287d1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:36.468040 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 396/767] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 19 10:52:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:36.468947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76981e0-ebe6-4e1b-b29a-7e255bd287d1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:36.524220 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:36.526621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ad15b-c0db-4328-9664-b63e44f86482 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:36.588856 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36599a2e-67d0-4747-bda7-6e6624bf5a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:36.590002 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36599a2e-67d0-4747-bda7-6e6624bf5a73 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:36.590554 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36599a2e-67d0-4747-bda7-6e6624bf5a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:36.590973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36599a2e-67d0-4747-bda7-6e6624bf5a73 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:36.592185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36599a2e-67d0-4747-bda7-6e6624bf5a73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:36.593968 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36599a2e-67d0-4747-bda7-6e6624bf5a73 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:36.600057 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 372/768] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 19 10:52:36 2022] GET /identity/v3/services => generated 772 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:36.601334 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36599a2e-67d0-4747-bda7-6e6624bf5a73 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:36.602603 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76981e0-ebe6-4e1b-b29a-7e255bd287d1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:36.682477 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c321b-1db3-4b75-bb99-26fa51108bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:36.684114 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c321b-1db3-4b75-bb99-26fa51108bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:36.684353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c321b-1db3-4b75-bb99-26fa51108bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:36.684872 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c321b-1db3-4b75-bb99-26fa51108bf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:36.709050 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:36.713889 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c321b-1db3-4b75-bb99-26fa51108bf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:36.719488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c321b-1db3-4b75-bb99-26fa51108bf9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:36.751373 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-659c321b-1db3-4b75-bb99-26fa51108bf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:36.751373 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:36.751373 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:36.751373 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:36.751373 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:36.751373 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:36.751373 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:36.751373 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:36.751373 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:36.751373 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:36.751373 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:36.751373 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:36.751373 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:36.751373 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:36.751373 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:36.761148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:36.761148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:36.761148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:36.761148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:36.761148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:36.761148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:36.761148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:36.761148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:36.761148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:36.761148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:36.761148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:36.761148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:36.761148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:36.761148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:36.761148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:36.761148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:36.761148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:36.762930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:36.762930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:36.762930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:36.762930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:36.762930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 397/769] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:36.762930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c321b-1db3-4b75-bb99-26fa51108bf9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:36.773323 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36599a2e-67d0-4747-bda7-6e6624bf5a73 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:36.848272 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12695e1-b7cc-4fe9-ab7b-493e9f2030cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:36.849436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12695e1-b7cc-4fe9-ab7b-493e9f2030cc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:36.851457 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12695e1-b7cc-4fe9-ab7b-493e9f2030cc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:36.852477 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12695e1-b7cc-4fe9-ab7b-493e9f2030cc None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:36.854807 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12695e1-b7cc-4fe9-ab7b-493e9f2030cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:36.855610 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12695e1-b7cc-4fe9-ab7b-493e9f2030cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:36.858298 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12695e1-b7cc-4fe9-ab7b-493e9f2030cc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:36.887426 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 373/770] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:36.888749 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12695e1-b7cc-4fe9-ab7b-493e9f2030cc None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:36.962114 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:36.984492 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c321b-1db3-4b75-bb99-26fa51108bf9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:37.055980 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb8919-4d9d-4118-9802-94c9a34f0ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:37.057165 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb8919-4d9d-4118-9802-94c9a34f0ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:37.057614 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb8919-4d9d-4118-9802-94c9a34f0ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:37.058082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb8919-4d9d-4118-9802-94c9a34f0ba9 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:37.060318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb8919-4d9d-4118-9802-94c9a34f0ba9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:37.060892 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb8919-4d9d-4118-9802-94c9a34f0ba9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:37.064233 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb8919-4d9d-4118-9802-94c9a34f0ba9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:37.078968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 398/771] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 19 10:52:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:37.080435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb8919-4d9d-4118-9802-94c9a34f0ba9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:37.118824 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12695e1-b7cc-4fe9-ab7b-493e9f2030cc None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:37.174635 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:37.183589 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561e321-f2a4-4a2f-9d53-e8aaa24a3399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:37.185229 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561e321-f2a4-4a2f-9d53-e8aaa24a3399 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:37.185646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561e321-f2a4-4a2f-9d53-e8aaa24a3399 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:37.186060 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561e321-f2a4-4a2f-9d53-e8aaa24a3399 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:37.187120 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561e321-f2a4-4a2f-9d53-e8aaa24a3399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:37.187556 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561e321-f2a4-4a2f-9d53-e8aaa24a3399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:37.189296 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561e321-f2a4-4a2f-9d53-e8aaa24a3399 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:37.208867 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 374/772] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:37.208867 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561e321-f2a4-4a2f-9d53-e8aaa24a3399 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:37.266014 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb8919-4d9d-4118-9802-94c9a34f0ba9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:37.308416 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd79fd9-0893-42a3-83f2-c4408156b2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:37.309769 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd79fd9-0893-42a3-83f2-c4408156b2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:37.310095 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd79fd9-0893-42a3-83f2-c4408156b2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:37.311001 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd79fd9-0893-42a3-83f2-c4408156b2d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:37.321067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd79fd9-0893-42a3-83f2-c4408156b2d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:37.322939 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd79fd9-0893-42a3-83f2-c4408156b2d0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:37.349593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-3dd79fd9-0893-42a3-83f2-c4408156b2d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:37.349593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:37.349593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:37.349593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:37.349593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:37.349593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:37.349593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:37.349593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:37.349593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:37.349593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:37.349593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:37.349593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:37.349593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:37.349593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:37.349593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:37.350637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:37.350637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:37.350637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:37.350637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:37.350637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:37.350637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:37.350637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:37.350637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:37.350637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:37.350637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:37.350637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:37.350637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:37.350637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:37.350637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:37.350637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:37.350637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:37.350637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:37.351875 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:37.351875 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:37.351875 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:37.351875 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:37.351875 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:37.351875 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:37.351875 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:37.351875 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:37.352324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 399/773] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:37.354446 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbcbab-6aa0-4f39-829d-77722e016715 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:37.354955 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbcbab-6aa0-4f39-829d-77722e016715 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:37.355257 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbcbab-6aa0-4f39-829d-77722e016715 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:37.358324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 400/774] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:37.359528 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbcbab-6aa0-4f39-829d-77722e016715 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:37.382680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561e321-f2a4-4a2f-9d53-e8aaa24a3399 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:37.386783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:37.434196 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be1265-dc34-4524-b6a2-9f773155d6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:37.436138 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be1265-dc34-4524-b6a2-9f773155d6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:37.436470 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be1265-dc34-4524-b6a2-9f773155d6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:37.436829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be1265-dc34-4524-b6a2-9f773155d6f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:37.437716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be1265-dc34-4524-b6a2-9f773155d6f8 None admin] RBAC: Adding query filter params (interface=public, service_id=15f11c9af7ba453bab5499d9860dfc22, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:37.438090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be1265-dc34-4524-b6a2-9f773155d6f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:37.439636 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be1265-dc34-4524-b6a2-9f773155d6f8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:37.452703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 375/775] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jul 19 10:52:37 2022] GET /identity/v3/endpoints?service_id=15f11c9af7ba453bab5499d9860dfc22&interface=public®ion_id=RegionOne => generated 194 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:37.461310 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57b647-bcf6-4223-98b9-018c1e6003a1 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:37.461892 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57b647-bcf6-4223-98b9-018c1e6003a1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:37.462332 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57b647-bcf6-4223-98b9-018c1e6003a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:37.488660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3d57b647-bcf6-4223-98b9-018c1e6003a1 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:37.490429 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3d57b647-bcf6-4223-98b9-018c1e6003a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:37.558175 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbcbab-6aa0-4f39-829d-77722e016715 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:37.564832 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:37.596204 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 376/776] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:52:37.597798 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57b647-bcf6-4223-98b9-018c1e6003a1 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:37.636163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd3f06-b26e-44b6-90a7-71a406cd2208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:37.637200 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd3f06-b26e-44b6-90a7-71a406cd2208 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:37.637603 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd3f06-b26e-44b6-90a7-71a406cd2208 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:37.638077 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd3f06-b26e-44b6-90a7-71a406cd2208 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:37.646688 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd3f06-b26e-44b6-90a7-71a406cd2208 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:37.648361 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd3f06-b26e-44b6-90a7-71a406cd2208 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:37.666155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-9ecd3f06-b26e-44b6-90a7-71a406cd2208 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:37.666155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:37.666155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:37.666155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:37.666155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:37.666155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:37.666155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:37.666155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:37.666155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:37.666155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:37.666155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:37.666155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:37.666155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:37.666155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:37.666155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:37.667923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:37.667923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:37.667923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:37.667923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:37.667923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:37.667923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:37.667923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:37.667923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:37.667923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:37.667923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:37.667923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:37.667923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:37.667923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:37.667923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:37.667923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:37.667923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:37.667923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:37.669815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:37.669815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:37.669815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:37.669815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:37.669815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:37.669815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:37.669815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:37.669815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:37.669815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 401/777] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:37.669815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd3f06-b26e-44b6-90a7-71a406cd2208 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:37.775928 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57b647-bcf6-4223-98b9-018c1e6003a1 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:37.809914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:37.819622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b457d86-6987-4b72-bc7f-e816d11c4822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:37.820494 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b457d86-6987-4b72-bc7f-e816d11c4822 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:37.820988 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b457d86-6987-4b72-bc7f-e816d11c4822 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:37.821442 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b457d86-6987-4b72-bc7f-e816d11c4822 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:37.822381 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b457d86-6987-4b72-bc7f-e816d11c4822 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:37.822808 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b457d86-6987-4b72-bc7f-e816d11c4822 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:37.824579 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b457d86-6987-4b72-bc7f-e816d11c4822 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:37.841993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 377/778] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:37.843295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b457d86-6987-4b72-bc7f-e816d11c4822 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:37.866735 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd3f06-b26e-44b6-90a7-71a406cd2208 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:37.909792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:37.933956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2522d-c428-42e7-bdc9-cdd16af30573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:37.935039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2522d-c428-42e7-bdc9-cdd16af30573 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:37.935517 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2522d-c428-42e7-bdc9-cdd16af30573 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:37.935969 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2522d-c428-42e7-bdc9-cdd16af30573 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:37.937199 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2522d-c428-42e7-bdc9-cdd16af30573 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:37.939528 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2522d-c428-42e7-bdc9-cdd16af30573 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:37.955384 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 402/779] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 19 10:52:37 2022] GET /identity/v3/services => generated 772 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:37.955384 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2522d-c428-42e7-bdc9-cdd16af30573 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:37.997593 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b457d86-6987-4b72-bc7f-e816d11c4822 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:38.039672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07a624-673b-4d0d-9823-17d905711f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:38.040676 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07a624-673b-4d0d-9823-17d905711f42 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:38.041062 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07a624-673b-4d0d-9823-17d905711f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:38.041439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07a624-673b-4d0d-9823-17d905711f42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:38.058333 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07a624-673b-4d0d-9823-17d905711f42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:38.066324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-3e07a624-673b-4d0d-9823-17d905711f42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:38.066324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:38.066324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:38.066324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:38.066324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:38.066324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:38.066324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:38.066324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:38.066324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:38.066324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:38.066324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:38.066324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:38.066324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:38.066324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:38.066324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:38.066324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:38.068510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:38.068510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:38.068510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:38.068510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:38.068510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:38.068510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:38.068510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:38.068510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:38.068510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:38.068510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:38.068510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:38.068510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:38.068510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:38.068510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:38.068510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:38.068510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:38.070934 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:38.070934 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:38.070934 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:38.070934 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:38.070934 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:38.070934 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:38.070934 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:38.070934 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:38.070934 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:38.070934 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:38.070934 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:38.070934 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:38.070934 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 378/780] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:52:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:38.070934 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07a624-673b-4d0d-9823-17d905711f42 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:38.168946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2522d-c428-42e7-bdc9-cdd16af30573 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:38.207481 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d3ad5-7b42-489f-b268-5891b79a2065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:38.208356 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d3ad5-7b42-489f-b268-5891b79a2065 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:38.208699 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d3ad5-7b42-489f-b268-5891b79a2065 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:38.209068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d3ad5-7b42-489f-b268-5891b79a2065 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:38.209933 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d3ad5-7b42-489f-b268-5891b79a2065 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:38.210304 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d3ad5-7b42-489f-b268-5891b79a2065 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:38.212171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d3ad5-7b42-489f-b268-5891b79a2065 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:38.220347 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:38.226569 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 403/781] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:38.227354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d3ad5-7b42-489f-b268-5891b79a2065 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:38.260170 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07a624-673b-4d0d-9823-17d905711f42 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:38.274446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:38.313545 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4399443-ab02-4191-941a-24257cd1a827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:38.314749 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4399443-ab02-4191-941a-24257cd1a827 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:38.315471 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4399443-ab02-4191-941a-24257cd1a827 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:38.315891 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4399443-ab02-4191-941a-24257cd1a827 None admin] PATH_INFO: `/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/3c50a821e9ef44cb9fccd49ee4af7dbf/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:38.319165 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4399443-ab02-4191-941a-24257cd1a827 None admin] RBAC: Authorizing `identity:create_grant(project_id=789e54670f7c40ffb67f20478aba00f2, user_id=3c50a821e9ef44cb9fccd49ee4af7dbf, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:38.321170 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4399443-ab02-4191-941a-24257cd1a827 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:38.340658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 379/782] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:52:38 2022] PUT /identity/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/3c50a821e9ef44cb9fccd49ee4af7dbf/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:52:38.341839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4399443-ab02-4191-941a-24257cd1a827 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:38.476493 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d3ad5-7b42-489f-b268-5891b79a2065 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:38.485504 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4399443-ab02-4191-941a-24257cd1a827 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:38.566366 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943febc8-6efa-4453-bdae-270296098f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:38.567556 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943febc8-6efa-4453-bdae-270296098f7d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:38.568065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943febc8-6efa-4453-bdae-270296098f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:38.568553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943febc8-6efa-4453-bdae-270296098f7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:38.570257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943febc8-6efa-4453-bdae-270296098f7d None admin] RBAC: Adding query filter params (role.id=669088b4ca4644f4bb586dfeaf427fb0, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=654631b067b94b269f93ea7b3977609d) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:38.571337 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943febc8-6efa-4453-bdae-270296098f7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:38.574192 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943febc8-6efa-4453-bdae-270296098f7d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:38.599063 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 380/783] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:38 2022] GET /identity/v3/role_assignments?user.id=654631b067b94b269f93ea7b3977609d&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=669088b4ca4644f4bb586dfeaf427fb0 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:38.615996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c99974-15e9-4b2c-a67f-db892155d7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:38.617200 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c99974-15e9-4b2c-a67f-db892155d7dd None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:38.617688 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c99974-15e9-4b2c-a67f-db892155d7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:38.618161 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c99974-15e9-4b2c-a67f-db892155d7dd None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:38.619594 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c99974-15e9-4b2c-a67f-db892155d7dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:38.620130 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c99974-15e9-4b2c-a67f-db892155d7dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:38.622841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c99974-15e9-4b2c-a67f-db892155d7dd None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:38.647399 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 404/784] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:38.657357 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943febc8-6efa-4453-bdae-270296098f7d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:38.731100 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:38.822445 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943febc8-6efa-4453-bdae-270296098f7d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:38.867507 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b6208-5f26-4d5a-b6d8-066b40fb5fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:38.868341 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b6208-5f26-4d5a-b6d8-066b40fb5fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:38.868612 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b6208-5f26-4d5a-b6d8-066b40fb5fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:38.868917 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b6208-5f26-4d5a-b6d8-066b40fb5fb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:38.881364 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b6208-5f26-4d5a-b6d8-066b40fb5fb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:38.883881 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b6208-5f26-4d5a-b6d8-066b40fb5fb1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:38.904500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-5c2b6208-5f26-4d5a-b6d8-066b40fb5fb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:38.904500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:38.904500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:38.904500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:38.904500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:38.904500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:38.904500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:38.904500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:38.904500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:38.904500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:38.904500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:38.904500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:38.904500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:38.904500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:38.904500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:38.906194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:38.906194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:38.906194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:38.906194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:38.906194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:38.906194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:38.906194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:38.906194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:38.906194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:38.906194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:38.906194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:38.906194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:38.906194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:38.906194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:38.906194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:38.906194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:38.906194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:38.907860 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:38.907860 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:38.907860 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:38.907860 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:38.907860 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 381/785] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:38.918397 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c99974-15e9-4b2c-a67f-db892155d7dd None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:39.109389 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:39.206029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c99974-15e9-4b2c-a67f-db892155d7dd None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:39.264550 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c095916-9d34-4ec7-8472-7ef387e1db0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:39.265598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c095916-9d34-4ec7-8472-7ef387e1db0b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:39.266065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c095916-9d34-4ec7-8472-7ef387e1db0b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:39.266517 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c095916-9d34-4ec7-8472-7ef387e1db0b None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:39.267874 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c095916-9d34-4ec7-8472-7ef387e1db0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:39.268348 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c095916-9d34-4ec7-8472-7ef387e1db0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:39.270865 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c095916-9d34-4ec7-8472-7ef387e1db0b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:39.294152 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 405/786] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:39.303343 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b6208-5f26-4d5a-b6d8-066b40fb5fb1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:39.459213 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:39.515843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b6208-5f26-4d5a-b6d8-066b40fb5fb1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:39.604667 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361ec02-ff2b-42d9-b0a7-ca487a8aadfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:39.606183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361ec02-ff2b-42d9-b0a7-ca487a8aadfc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:39.606685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361ec02-ff2b-42d9-b0a7-ca487a8aadfc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:39.607173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361ec02-ff2b-42d9-b0a7-ca487a8aadfc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:39.630761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361ec02-ff2b-42d9-b0a7-ca487a8aadfc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:39.633673 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361ec02-ff2b-42d9-b0a7-ca487a8aadfc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:39.673403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-6361ec02-ff2b-42d9-b0a7-ca487a8aadfc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:52:39.673403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:39.673403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:39.673403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:39.673403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:39.673403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:39.673403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:39.673403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:39.673403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:39.673403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:39.673403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:39.673403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:39.673403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:39.673403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:39.673403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:39.673403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:39.675216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:39.675216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:39.675216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:39.675216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:39.675216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:39.675216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:39.675216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:39.675216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:39.675216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:39.675216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:39.675216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:39.675216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:39.675216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:39.675216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:39.675216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:39.675216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:39.675216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:39.675216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:39.677096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:39.677096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:39.677096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:39.677096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:39.677096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:39.677096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:39.677096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:39.677096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:39.677096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:52:39.677096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:39.677096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 382/787] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:52:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:39.685922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c050c5-e230-4dc1-8161-f6a7ef516d9f None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:39.687368 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c050c5-e230-4dc1-8161-f6a7ef516d9f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:39.688102 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c050c5-e230-4dc1-8161-f6a7ef516d9f None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:39.696015 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 406/788] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:39 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:39.696973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361ec02-ff2b-42d9-b0a7-ca487a8aadfc None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:39.710641 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71e73a-a8af-44e5-a040-fd6fb5d47bcf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:39.711118 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71e73a-a8af-44e5-a040-fd6fb5d47bcf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:39.711598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71e73a-a8af-44e5-a040-fd6fb5d47bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:39.764755 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1a71e73a-a8af-44e5-a040-fd6fb5d47bcf None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:39.766981 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1a71e73a-a8af-44e5-a040-fd6fb5d47bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:39.957588 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 407/789] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:52:40.002894 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361ec02-ff2b-42d9-b0a7-ca487a8aadfc None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:40.030448 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71e73a-a8af-44e5-a040-fd6fb5d47bcf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:40.084759 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aecd70-397d-4c67-88ad-19c0912d51f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:40.084759 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aecd70-397d-4c67-88ad-19c0912d51f2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:40.084759 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aecd70-397d-4c67-88ad-19c0912d51f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:40.084759 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aecd70-397d-4c67-88ad-19c0912d51f2 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:40.085204 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aecd70-397d-4c67-88ad-19c0912d51f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:40.085204 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aecd70-397d-4c67-88ad-19c0912d51f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:40.087161 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aecd70-397d-4c67-88ad-19c0912d51f2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:40.114757 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:40.126352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 383/790] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jul 19 10:52:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:40.132586 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aecd70-397d-4c67-88ad-19c0912d51f2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:40.162200 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:40.236597 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71e73a-a8af-44e5-a040-fd6fb5d47bcf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:40.313905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7908806-4380-4ab1-99fe-ad63c1ea74b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:40.315322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7908806-4380-4ab1-99fe-ad63c1ea74b6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:40.315817 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7908806-4380-4ab1-99fe-ad63c1ea74b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:40.316308 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7908806-4380-4ab1-99fe-ad63c1ea74b6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:40.317580 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7908806-4380-4ab1-99fe-ad63c1ea74b6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:40.320212 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7908806-4380-4ab1-99fe-ad63c1ea74b6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:40.365291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d7908806-4380-4ab1-99fe-ad63c1ea74b6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 10:52:40.365291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:40.365291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:52:40.365291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:52:40.365291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:52:40.365291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:52:40.365291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:52:40.365291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:40.365291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 10:52:40.365291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:40.365291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:52:40.365291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:40.365291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:40.365291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:40.365291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:40.365291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:40.367182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:40.367182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:40.367182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:40.367182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:40.367182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:40.367182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:40.367182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:40.367182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:52:40.367182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:52:40.367182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:52:40.367182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:52:40.367182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:40.367182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:40.367182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:40.367182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:40.367182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:40.369432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:40.369432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:40.369432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:40.369432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:40.369432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:40.369432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:40.369432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:40.369432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:40.369432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:40.369432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:40.369432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:40.369432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:52:40.369432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:40.369432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 10:52:40.369432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:40.369432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 408/791] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Jul 19 10:52:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:40.379792 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7908806-4380-4ab1-99fe-ad63c1ea74b6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:40.391015 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aecd70-397d-4c67-88ad-19c0912d51f2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:40.516527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ad052-e7fb-46f6-9500-3336b4c342b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:40.517787 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ad052-e7fb-46f6-9500-3336b4c342b9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:40.518269 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ad052-e7fb-46f6-9500-3336b4c342b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:40.518810 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ad052-e7fb-46f6-9500-3336b4c342b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:40.551550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ad052-e7fb-46f6-9500-3336b4c342b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:40.554205 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ad052-e7fb-46f6-9500-3336b4c342b9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:40.616065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-262ad052-e7fb-46f6-9500-3336b4c342b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:40.616065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:40.616065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:40.616065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:40.616065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:40.616065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:40.616065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:40.616065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:40.616065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:40.616065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:40.616065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:40.616065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:40.616065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:40.616065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:40.616065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:40.618090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:40.618090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:40.618090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:40.618090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:40.618090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:40.618090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:40.618090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:40.618090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:40.618090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:40.618090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:40.618090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:40.618090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:40.618090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:40.618090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:40.618090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:40.618090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:40.618090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:40.620089 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:40.620089 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:40.620089 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:40.620089 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:40.620089 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 384/792] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 486 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:40.636898 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ad052-e7fb-46f6-9500-3336b4c342b9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:40.744255 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7908806-4380-4ab1-99fe-ad63c1ea74b6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:40.765334 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:40.772824 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:40.817351 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff3ace-1e69-450e-9572-00f78441bc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:40.818057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff3ace-1e69-450e-9572-00f78441bc51 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:40.818337 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff3ace-1e69-450e-9572-00f78441bc51 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:40.818607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff3ace-1e69-450e-9572-00f78441bc51 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:40.819340 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff3ace-1e69-450e-9572-00f78441bc51 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:40.819648 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff3ace-1e69-450e-9572-00f78441bc51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:40.821170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff3ace-1e69-450e-9572-00f78441bc51 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:40.833494 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 409/793] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jul 19 10:52:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:40.841850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff3ace-1e69-450e-9572-00f78441bc51 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:40.867439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ad052-e7fb-46f6-9500-3336b4c342b9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:40.935823 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574288e9-cd04-41c2-940f-91a028182d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:40.937552 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574288e9-cd04-41c2-940f-91a028182d05 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:40.938251 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574288e9-cd04-41c2-940f-91a028182d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:40.938958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574288e9-cd04-41c2-940f-91a028182d05 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:40.940648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574288e9-cd04-41c2-940f-91a028182d05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:40.941542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574288e9-cd04-41c2-940f-91a028182d05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:40.944318 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574288e9-cd04-41c2-940f-91a028182d05 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:40.976752 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 385/794] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:40.982637 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574288e9-cd04-41c2-940f-91a028182d05 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:41.004753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff3ace-1e69-450e-9572-00f78441bc51 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:41.043312 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe411dd-3b71-453a-9bdb-a501430c5fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:41.043312 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe411dd-3b71-453a-9bdb-a501430c5fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:41.043312 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe411dd-3b71-453a-9bdb-a501430c5fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:41.043312 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe411dd-3b71-453a-9bdb-a501430c5fa7 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:41.044041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe411dd-3b71-453a-9bdb-a501430c5fa7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:41.044041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe411dd-3b71-453a-9bdb-a501430c5fa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:41.044041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe411dd-3b71-453a-9bdb-a501430c5fa7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:41.048772 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 410/795] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jul 19 10:52:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:41.057888 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe411dd-3b71-453a-9bdb-a501430c5fa7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:41.209353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:41.327241 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574288e9-cd04-41c2-940f-91a028182d05 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:41.365738 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe411dd-3b71-453a-9bdb-a501430c5fa7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:41.370958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:41.439973 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed666b-78b5-4871-846e-32b786ea4f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:41.442729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed666b-78b5-4871-846e-32b786ea4f06 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:41.443226 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed666b-78b5-4871-846e-32b786ea4f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:41.443717 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed666b-78b5-4871-846e-32b786ea4f06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:41.445049 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed666b-78b5-4871-846e-32b786ea4f06 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:41.449920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455518af-4e6d-4726-9640-20421e1b776a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:41.451325 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455518af-4e6d-4726-9640-20421e1b776a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:41.453226 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed666b-78b5-4871-846e-32b786ea4f06 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:41.455874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455518af-4e6d-4726-9640-20421e1b776a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:41.456452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455518af-4e6d-4726-9640-20421e1b776a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:41.483153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455518af-4e6d-4726-9640-20421e1b776a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:41.490406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455518af-4e6d-4726-9640-20421e1b776a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:41.516399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-455518af-4e6d-4726-9640-20421e1b776a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:41.516399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:41.516399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:41.516399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:41.516399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:41.516399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:41.516399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:41.516399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:41.516399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:41.516399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:41.516399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:41.516399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:41.516399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:41.516399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:41.516399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:41.517405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:41.517405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:41.517405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:41.517405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:41.517405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:41.517405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:41.517405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:41.517405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:41.517405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:41.517405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:41.517405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:41.517405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:41.517405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:41.517405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:41.517405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:41.517405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:41.517405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:41.518266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:41.518266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:41.518266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:41.518266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:41.518266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:41.518266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:41.518266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:41.518266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:41.518689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 411/796] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 19 10:52:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:52:41.518762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 386/797] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 537 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:41.527864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455518af-4e6d-4726-9640-20421e1b776a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:41.529154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39de96-4d31-4fd6-917f-7a180dedb372 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:41.529749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39de96-4d31-4fd6-917f-7a180dedb372 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:41.530249 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39de96-4d31-4fd6-917f-7a180dedb372 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:41.533097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 412/798] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:41 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:41.539878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319c230-df86-4cfe-a258-aa85aedc8c55 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:41.540341 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319c230-df86-4cfe-a258-aa85aedc8c55 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:41.540845 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319c230-df86-4cfe-a258-aa85aedc8c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:41.599864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f319c230-df86-4cfe-a258-aa85aedc8c55 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:41.602706 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f319c230-df86-4cfe-a258-aa85aedc8c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:41.784380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455518af-4e6d-4726-9640-20421e1b776a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:41.824332 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 413/799] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:52:41.826033 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fc7d1-6489-4ab3-8aa0-dfe83c6589d2 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:41.826324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fc7d1-6489-4ab3-8aa0-dfe83c6589d2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:41.826650 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fc7d1-6489-4ab3-8aa0-dfe83c6589d2 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:41.833321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 414/800] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:41.838135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd9880-a0a6-468b-a96a-cdd3726bb5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:41.839296 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd9880-a0a6-468b-a96a-cdd3726bb5be None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:41.839760 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd9880-a0a6-468b-a96a-cdd3726bb5be None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:41.840219 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd9880-a0a6-468b-a96a-cdd3726bb5be None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:41.842885 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd9880-a0a6-468b-a96a-cdd3726bb5be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:41.842885 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd9880-a0a6-468b-a96a-cdd3726bb5be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:41.846620 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd9880-a0a6-468b-a96a-cdd3726bb5be None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:41.849664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f048451-4059-4821-9170-d097bd934895 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:41.850036 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f048451-4059-4821-9170-d097bd934895 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:41.850273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f048451-4059-4821-9170-d097bd934895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:41.876755 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 387/801] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:41.876755 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd9880-a0a6-468b-a96a-cdd3726bb5be None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:41.879356 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2f048451-4059-4821-9170-d097bd934895 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:41.881435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2f048451-4059-4821-9170-d097bd934895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:41.916166 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:41.943146 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:42.027879 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 415/802] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:52:42.029990 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f048451-4059-4821-9170-d097bd934895 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:42.075549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd9880-a0a6-468b-a96a-cdd3726bb5be None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:42.132217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2640f62-b5bd-416c-b643-50e2e637e4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:42.133766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2640f62-b5bd-416c-b643-50e2e637e4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:42.139268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2640f62-b5bd-416c-b643-50e2e637e4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:42.139829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2640f62-b5bd-416c-b643-50e2e637e4d1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:42.141035 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2640f62-b5bd-416c-b643-50e2e637e4d1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:42.143837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2640f62-b5bd-416c-b643-50e2e637e4d1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:42.172380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-f2640f62-b5bd-416c-b643-50e2e637e4d1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 10:52:42.172380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:42.172380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:52:42.172380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:52:42.172380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:52:42.172380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:52:42.172380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:52:42.172380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:42.172380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 10:52:42.172380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:42.172380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:52:42.172380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:42.172380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:42.172380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:42.172380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:42.172380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:42.172380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:42.174622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:42.174622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:42.174622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:42.174622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:42.174622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:42.174622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:42.174622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:52:42.174622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:52:42.174622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:52:42.174622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:52:42.174622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:42.174622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:42.174622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:42.174622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:42.174622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:42.174622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:42.176616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:42.176616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:42.176616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:42.176616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:42.176616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:42.176616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:42.176616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:42.176616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:42.176616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:42.176616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:42.176616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:52:42.176616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:42.176616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 10:52:42.176616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:42.176616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 388/803] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:41 2022] GET /identity/v3/services/network => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:42.179619 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac70c67-35dc-4ffb-84c7-9ae849d38554 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:42.179619 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac70c67-35dc-4ffb-84c7-9ae849d38554 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:42.179619 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac70c67-35dc-4ffb-84c7-9ae849d38554 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:42.184767 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 389/804] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:42.184767 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac70c67-35dc-4ffb-84c7-9ae849d38554 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:42.201941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f048451-4059-4821-9170-d097bd934895 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:42.245235 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a4b8b-ff5c-402f-b4c9-99fad5aed343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:42.246151 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a4b8b-ff5c-402f-b4c9-99fad5aed343 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:42.246424 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a4b8b-ff5c-402f-b4c9-99fad5aed343 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:42.246688 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a4b8b-ff5c-402f-b4c9-99fad5aed343 None admin] PATH_INFO: `/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/4fa6a9aa611640f893b5e717a094acf7/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:42.248844 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a4b8b-ff5c-402f-b4c9-99fad5aed343 None admin] RBAC: Authorizing `identity:create_grant(project_id=789e54670f7c40ffb67f20478aba00f2, user_id=4fa6a9aa611640f893b5e717a094acf7, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:42.250341 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a4b8b-ff5c-402f-b4c9-99fad5aed343 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:42.268765 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 416/805] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:52:42 2022] PUT /identity/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/4fa6a9aa611640f893b5e717a094acf7/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:52:42.274354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a4b8b-ff5c-402f-b4c9-99fad5aed343 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:42.309328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:42.390827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:42.404491 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac70c67-35dc-4ffb-84c7-9ae849d38554 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:42.471403 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a4b8b-ff5c-402f-b4c9-99fad5aed343 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:42.477792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdebec-2468-4805-8f30-b61cfe790eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:42.478632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdebec-2468-4805-8f30-b61cfe790eaa None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:42.479381 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdebec-2468-4805-8f30-b61cfe790eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:42.479552 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdebec-2468-4805-8f30-b61cfe790eaa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:42.503365 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbdebec-2468-4805-8f30-b61cfe790eaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:42.519747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-6cbdebec-2468-4805-8f30-b61cfe790eaa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:42.519747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:42.519747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:42.519747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:42.519747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:42.519747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:42.519747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:42.519747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:42.519747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:42.519747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:42.519747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:42.519747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:42.519747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:42.519747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:42.519747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:42.519747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:42.521051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:42.521051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:42.521051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:42.521051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:42.521051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:42.521051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:42.521051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:42.521051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:42.521051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:42.521051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:42.521051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:42.521051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:42.521051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:42.521051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:42.521051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:42.521051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:42.527438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:42.527438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:42.527438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:42.527438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:42.527438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:42.527438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:42.527438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:42.527438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:42.527438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:42.527438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:42.527438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:42.527438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:42.527438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 390/806] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:52:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:42.527438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4e0c9-3c90-4cef-bbb9-3e7f569617c2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:42.528735 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4e0c9-3c90-4cef-bbb9-3e7f569617c2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:42.528735 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4e0c9-3c90-4cef-bbb9-3e7f569617c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:42.541946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdc687-1f54-42ef-8efa-5339b181ffb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:42.543093 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdc687-1f54-42ef-8efa-5339b181ffb8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:42.543578 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdc687-1f54-42ef-8efa-5339b181ffb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:42.544040 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdc687-1f54-42ef-8efa-5339b181ffb8 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:42.545457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfdc687-1f54-42ef-8efa-5339b181ffb8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:42.546000 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfdc687-1f54-42ef-8efa-5339b181ffb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:42.548708 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfdc687-1f54-42ef-8efa-5339b181ffb8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:42.557549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-0fb4e0c9-3c90-4cef-bbb9-3e7f569617c2 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:42.558014 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 417/807] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 19 10:52:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:42.559349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdc687-1f54-42ef-8efa-5339b181ffb8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:42.560872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0fb4e0c9-3c90-4cef-bbb9-3e7f569617c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:42.715118 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:42.735826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 391/808] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:52:42.736062 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4e0c9-3c90-4cef-bbb9-3e7f569617c2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:42.779438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdc687-1f54-42ef-8efa-5339b181ffb8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:42.854384 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339aca17-9a21-4c16-9035-75cda3ce6a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:42.857686 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339aca17-9a21-4c16-9035-75cda3ce6a74 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:42.858748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339aca17-9a21-4c16-9035-75cda3ce6a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:42.859589 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339aca17-9a21-4c16-9035-75cda3ce6a74 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:42.861680 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339aca17-9a21-4c16-9035-75cda3ce6a74 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:42.862504 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339aca17-9a21-4c16-9035-75cda3ce6a74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:42.866750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339aca17-9a21-4c16-9035-75cda3ce6a74 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:42.898402 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 418/809] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 19 10:52:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:42.900345 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339aca17-9a21-4c16-9035-75cda3ce6a74 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:42.919546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:42.953232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4e0c9-3c90-4cef-bbb9-3e7f569617c2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:43.014499 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcad8c-e792-450f-b35b-b8623fe4e687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:43.015108 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcad8c-e792-450f-b35b-b8623fe4e687 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:43.015396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcad8c-e792-450f-b35b-b8623fe4e687 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:43.015677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcad8c-e792-450f-b35b-b8623fe4e687 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:43.016439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fcad8c-e792-450f-b35b-b8623fe4e687 None admin] RBAC: Adding query filter params (type=network) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:43.016783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fcad8c-e792-450f-b35b-b8623fe4e687 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:43.018296 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fcad8c-e792-450f-b35b-b8623fe4e687 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:43.032820 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 392/810] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 19 10:52:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:43.032820 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcad8c-e792-450f-b35b-b8623fe4e687 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:43.121148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339aca17-9a21-4c16-9035-75cda3ce6a74 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:43.162184 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b6d18-4955-4300-b360-46c91389a962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:43.163073 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b6d18-4955-4300-b360-46c91389a962 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:43.163347 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b6d18-4955-4300-b360-46c91389a962 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:43.163618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b6d18-4955-4300-b360-46c91389a962 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:43.173799 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:43.180970 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b6d18-4955-4300-b360-46c91389a962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:43.189470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-045b6d18-4955-4300-b360-46c91389a962 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:43.189470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:43.189470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:43.189470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:43.189470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:43.189470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:43.189470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:43.189470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:43.189470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:43.189470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:43.189470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:43.189470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:43.189470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:43.189470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:43.189470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:43.189470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:43.190498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:43.190498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:43.190498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:43.190498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:43.190498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:43.190498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:43.190498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:43.190498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:43.190498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:43.190498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:43.190498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:43.190498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:43.190498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:43.190498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:43.190498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:43.190498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:43.191323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:43.191323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:43.191323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:43.191323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:43.191323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:43.191323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:43.191323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:43.191323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:43.191323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:43.191323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:43.191323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:43.191323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:43.194225 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 419/811] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:52:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:43.195406 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b6d18-4955-4300-b360-46c91389a962 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:43.251898 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcad8c-e792-450f-b35b-b8623fe4e687 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:43.298243 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aece681-e005-435d-aa57-f54f3b06f0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:43.299430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aece681-e005-435d-aa57-f54f3b06f0aa None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:43.299929 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aece681-e005-435d-aa57-f54f3b06f0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:43.300398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aece681-e005-435d-aa57-f54f3b06f0aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:43.312750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aece681-e005-435d-aa57-f54f3b06f0aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:43.314593 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aece681-e005-435d-aa57-f54f3b06f0aa None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:43.334462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-0aece681-e005-435d-aa57-f54f3b06f0aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:43.334462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:43.334462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:43.334462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:43.334462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:43.334462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:43.334462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:43.334462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:43.334462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:43.334462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:43.334462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:43.334462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:43.334462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:43.334462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:43.334462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:43.335406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:43.335406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:43.335406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:43.335406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:43.335406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:43.335406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:43.335406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:43.335406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:43.335406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:43.335406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:43.335406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:43.335406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:43.335406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:43.335406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:43.335406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:43.335406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:43.335406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:43.336283 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:43.336283 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:43.336283 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:43.336283 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:43.338510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 393/812] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:43.339639 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aece681-e005-435d-aa57-f54f3b06f0aa None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:43.345585 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:43.369657 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b6d18-4955-4300-b360-46c91389a962 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:43.438378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e285b9-5c33-44b8-b9da-a6a995a2e7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:43.440755 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e285b9-5c33-44b8-b9da-a6a995a2e7e4 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:43.440755 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e285b9-5c33-44b8-b9da-a6a995a2e7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:43.440755 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e285b9-5c33-44b8-b9da-a6a995a2e7e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:43.442575 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e285b9-5c33-44b8-b9da-a6a995a2e7e4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:43.444493 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e285b9-5c33-44b8-b9da-a6a995a2e7e4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:43.489437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 420/813] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 19 10:52:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:52:43.491333 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e285b9-5c33-44b8-b9da-a6a995a2e7e4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:43.614682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aece681-e005-435d-aa57-f54f3b06f0aa None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:43.638735 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:43.711665 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e285b9-5c33-44b8-b9da-a6a995a2e7e4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:43.712049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6445dbe-ff78-41b2-a73e-093a3416cf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:43.712659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6445dbe-ff78-41b2-a73e-093a3416cf48 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:43.712978 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6445dbe-ff78-41b2-a73e-093a3416cf48 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:43.713252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6445dbe-ff78-41b2-a73e-093a3416cf48 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:43.714028 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6445dbe-ff78-41b2-a73e-093a3416cf48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:43.714331 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6445dbe-ff78-41b2-a73e-093a3416cf48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:43.715737 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6445dbe-ff78-41b2-a73e-093a3416cf48 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:43.736759 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 394/814] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:43.745189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6445dbe-ff78-41b2-a73e-093a3416cf48 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:43.759624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd36e98-c458-4986-882d-ce1ac84b18b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:43.760696 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36e98-c458-4986-882d-ce1ac84b18b0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:43.761238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36e98-c458-4986-882d-ce1ac84b18b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:43.761718 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36e98-c458-4986-882d-ce1ac84b18b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:43.762679 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd36e98-c458-4986-882d-ce1ac84b18b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:43.763187 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd36e98-c458-4986-882d-ce1ac84b18b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:43.764835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd36e98-c458-4986-882d-ce1ac84b18b0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:43.781285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 421/815] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:43.788645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd36e98-c458-4986-882d-ce1ac84b18b0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:43.874688 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:43.929507 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd36e98-c458-4986-882d-ce1ac84b18b0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:43.934741 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6445dbe-ff78-41b2-a73e-093a3416cf48 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:43.950576 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:43.985348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a50dc-ae54-4bd6-b4e1-158b03cfe972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:43.986239 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a50dc-ae54-4bd6-b4e1-158b03cfe972 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:43.986532 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a50dc-ae54-4bd6-b4e1-158b03cfe972 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:43.986807 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a50dc-ae54-4bd6-b4e1-158b03cfe972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:43.987518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ec1a1-66ea-4ce8-8fed-72d8a910ea39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:43.988784 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ec1a1-66ea-4ce8-8fed-72d8a910ea39 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:43.989606 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ec1a1-66ea-4ce8-8fed-72d8a910ea39 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:43.990113 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ec1a1-66ea-4ce8-8fed-72d8a910ea39 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:44.000202 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a50dc-ae54-4bd6-b4e1-158b03cfe972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:44.001765 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a50dc-ae54-4bd6-b4e1-158b03cfe972 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:44.002001 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ec1a1-66ea-4ce8-8fed-72d8a910ea39 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:44.003992 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ec1a1-66ea-4ce8-8fed-72d8a910ea39 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:44.022993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d94a50dc-ae54-4bd6-b4e1-158b03cfe972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:44.022993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:44.022993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:44.022993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:44.022993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:44.022993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:44.022993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:44.022993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:44.022993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:44.022993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:44.022993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:44.022993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:44.022993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:44.022993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:44.022993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:44.023963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:44.023963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:44.023963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:44.023963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:44.023963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:44.023963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:44.023963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:44.023963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:44.023963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:44.023963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:44.023963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:44.023963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:44.023963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:44.023963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:44.023963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:44.023963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:44.023963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:44.024885 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:44.024885 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:44.024885 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:44.024885 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:44.024885 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 395/816] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:44.025179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-ce1ec1a1-66ea-4ce8-8fed-72d8a910ea39 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:52:44.025179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:44.025179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:44.025179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:44.025179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:44.025179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:44.025179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:44.025179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:44.025179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:44.025179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:44.025179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:44.025179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:44.025179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:44.025179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:44.025179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:44.025179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:44.026006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:44.026006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:44.026006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:44.026006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:44.026006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:44.026006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:44.026006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:44.026006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:44.026006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:44.026006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:44.026006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:44.026006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:44.026006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:44.026006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:44.026006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:44.026006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:44.026006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:44.026006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:44.026960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:44.026960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:44.026960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:44.026960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:44.026960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:44.026960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:44.026960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:44.026960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:44.026960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:52:44.026960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:44.026960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 422/817] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jul 19 10:52:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:44.037952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a50dc-ae54-4bd6-b4e1-158b03cfe972 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:44.039556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ec1a1-66ea-4ce8-8fed-72d8a910ea39 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:44.180756 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ec1a1-66ea-4ce8-8fed-72d8a910ea39 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:44.189907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a50dc-ae54-4bd6-b4e1-158b03cfe972 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:44.210197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:44.229949 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e6cda-2c1f-4ab6-85cb-1ddb93fa4477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:44.230646 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e6cda-2c1f-4ab6-85cb-1ddb93fa4477 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:44.230926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e6cda-2c1f-4ab6-85cb-1ddb93fa4477 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:44.231200 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e6cda-2c1f-4ab6-85cb-1ddb93fa4477 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:44.231935 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e6cda-2c1f-4ab6-85cb-1ddb93fa4477 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:44.232367 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e6cda-2c1f-4ab6-85cb-1ddb93fa4477 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:44.233974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e6cda-2c1f-4ab6-85cb-1ddb93fa4477 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:44.247183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2fbdf-42b0-4e32-b962-08a0d7a8b0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:44.248286 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2fbdf-42b0-4e32-b962-08a0d7a8b0ff None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:44.248807 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2fbdf-42b0-4e32-b962-08a0d7a8b0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:44.249070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 423/818] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:44.249456 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2fbdf-42b0-4e32-b962-08a0d7a8b0ff None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:44.250324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2fbdf-42b0-4e32-b962-08a0d7a8b0ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:44.250638 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2fbdf-42b0-4e32-b962-08a0d7a8b0ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:44.252107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2fbdf-42b0-4e32-b962-08a0d7a8b0ff None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:44.258206 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e6cda-2c1f-4ab6-85cb-1ddb93fa4477 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:44.284943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 396/819] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jul 19 10:52:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:44.289458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2fbdf-42b0-4e32-b962-08a0d7a8b0ff None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:44.299834 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:44.386767 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e6cda-2c1f-4ab6-85cb-1ddb93fa4477 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:44.439117 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f2867-9c5e-4aa2-af4a-9b283cd28355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:44.443798 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f2867-9c5e-4aa2-af4a-9b283cd28355 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:44.444301 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f2867-9c5e-4aa2-af4a-9b283cd28355 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:44.444770 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f2867-9c5e-4aa2-af4a-9b283cd28355 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:44.455534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f2867-9c5e-4aa2-af4a-9b283cd28355 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:44.457328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f2867-9c5e-4aa2-af4a-9b283cd28355 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:44.476654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-146f2867-9c5e-4aa2-af4a-9b283cd28355 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:52:44.476654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:44.476654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:44.476654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:44.476654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:44.476654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:44.476654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:44.476654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:44.476654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:44.476654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:44.476654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:44.476654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:44.476654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:44.476654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:44.476654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:44.476654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:44.477861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:44.477861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:44.477861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:44.477861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:44.477861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:44.477861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:44.477861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:44.477861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:44.477861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:44.477861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:44.477861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:44.477861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:44.477861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:44.477861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:44.477861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:44.477861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:44.477861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:44.477861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:44.478884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:44.478884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:44.478884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:44.478884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:44.478884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:44.478884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:44.478884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:44.478884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:44.478884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:52:44.478884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:44.481962 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 424/820] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 19 10:52:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:44.492279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2fbdf-42b0-4e32-b962-08a0d7a8b0ff None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:44.492700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f2867-9c5e-4aa2-af4a-9b283cd28355 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:44.554758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02838a3-4de7-4a2d-9553-7511abcca23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:44.556107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02838a3-4de7-4a2d-9553-7511abcca23d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:44.556604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02838a3-4de7-4a2d-9553-7511abcca23d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:44.557088 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02838a3-4de7-4a2d-9553-7511abcca23d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:44.576518 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02838a3-4de7-4a2d-9553-7511abcca23d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:44.579281 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02838a3-4de7-4a2d-9553-7511abcca23d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:44.610945 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:44.612048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-c02838a3-4de7-4a2d-9553-7511abcca23d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:44.612048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:44.612048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:44.612048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:44.612048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:44.612048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:44.612048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:44.612048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:44.612048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:44.612048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:44.612048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:44.612048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:44.612048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:44.612048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:44.612048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:44.612970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:44.612970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:44.612970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:44.612970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:44.612970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:44.612970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:44.612970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:44.612970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:44.612970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:44.612970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:44.612970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:44.612970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:44.612970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:44.612970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:44.612970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:44.612970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:44.612970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:44.614041 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:44.614041 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:44.614041 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:44.614041 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:44.614883 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 397/821] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:44.617274 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfeee28-9ace-4182-a1d4-8abe0633e611 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:44.617697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfeee28-9ace-4182-a1d4-8abe0633e611 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:44.618169 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfeee28-9ace-4182-a1d4-8abe0633e611 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:44.624490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 398/822] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:44.624490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfeee28-9ace-4182-a1d4-8abe0633e611 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:44.642974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f2867-9c5e-4aa2-af4a-9b283cd28355 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:44.655191 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:44.705976 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2c5d5-a281-4d01-8546-645ab1d56915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:44.707557 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2c5d5-a281-4d01-8546-645ab1d56915 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:44.708042 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2c5d5-a281-4d01-8546-645ab1d56915 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:44.708531 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2c5d5-a281-4d01-8546-645ab1d56915 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:44.710192 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2c5d5-a281-4d01-8546-645ab1d56915 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:44.710733 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2c5d5-a281-4d01-8546-645ab1d56915 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:44.713498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2c5d5-a281-4d01-8546-645ab1d56915 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:44.740552 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 425/823] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 19 10:52:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:44.742096 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664daea-c6b9-458d-80ed-4ce89c3ee12a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:44.742484 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664daea-c6b9-458d-80ed-4ce89c3ee12a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:44.742851 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664daea-c6b9-458d-80ed-4ce89c3ee12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:44.761603 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3664daea-c6b9-458d-80ed-4ce89c3ee12a None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:44.762803 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3664daea-c6b9-458d-80ed-4ce89c3ee12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:44.773789 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfeee28-9ace-4182-a1d4-8abe0633e611 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:44.824844 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5e680-26c7-465c-914a-18a1de98f85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:44.825641 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5e680-26c7-465c-914a-18a1de98f85f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:44.825915 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5e680-26c7-465c-914a-18a1de98f85f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:44.826181 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5e680-26c7-465c-914a-18a1de98f85f None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:44.826908 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5e680-26c7-465c-914a-18a1de98f85f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:44.827203 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5e680-26c7-465c-914a-18a1de98f85f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:44.828761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5e680-26c7-465c-914a-18a1de98f85f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:44.845529 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 399/824] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:44.845529 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5e680-26c7-465c-914a-18a1de98f85f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:44.877677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 426/825] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:52:44.880101 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ba937-07a1-44fa-a61b-91c6491c3f83 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:44.880592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ba937-07a1-44fa-a61b-91c6491c3f83 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:44.881126 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ba937-07a1-44fa-a61b-91c6491c3f83 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:44.883707 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 427/826] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:44.885296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ba937-07a1-44fa-a61b-91c6491c3f83 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:44.964648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:44.986506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5e680-26c7-465c-914a-18a1de98f85f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:45.023152 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:45.024308 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715b03c-6a7f-4468-b2cc-714a37ec3a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:45.025319 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715b03c-6a7f-4468-b2cc-714a37ec3a2f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:45.025632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715b03c-6a7f-4468-b2cc-714a37ec3a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:45.025908 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715b03c-6a7f-4468-b2cc-714a37ec3a2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:45.051866 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ba937-07a1-44fa-a61b-91c6491c3f83 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:45.095735 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1130a6-0bfd-43aa-b9c6-b582813c6a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:45.096557 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1130a6-0bfd-43aa-b9c6-b582813c6a5b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:45.096871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1130a6-0bfd-43aa-b9c6-b582813c6a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:45.097146 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1130a6-0bfd-43aa-b9c6-b582813c6a5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:45.105645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1130a6-0bfd-43aa-b9c6-b582813c6a5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:45.107205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1130a6-0bfd-43aa-b9c6-b582813c6a5b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:45.122276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-8f1130a6-0bfd-43aa-b9c6-b582813c6a5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:45.122276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:45.122276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:45.122276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:45.122276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:45.122276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:45.122276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:45.122276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:45.122276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:45.122276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:45.122276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:45.122276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:45.122276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:45.122276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:45.122276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:45.131465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:45.131465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:45.131465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:45.131465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:45.131465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:45.131465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:45.131465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:45.131465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:45.131465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:45.131465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:45.131465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:45.131465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:45.131465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:45.131465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:45.131465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:45.131465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:45.131465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:45.133428 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:45.133428 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:45.133428 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:45.133428 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:45.133428 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:45.133428 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:45.133428 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:45.133428 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:45.134396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715b03c-6a7f-4468-b2cc-714a37ec3a2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:45.134556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 428/827] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:45.134699 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715b03c-6a7f-4468-b2cc-714a37ec3a2f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:45.134833 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801ce82-dc80-468f-a9fe-2e0a529b568b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:45.134833 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801ce82-dc80-468f-a9fe-2e0a529b568b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:45.134833 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801ce82-dc80-468f-a9fe-2e0a529b568b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:45.147876 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f801ce82-dc80-468f-a9fe-2e0a529b568b None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:45.149384 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f801ce82-dc80-468f-a9fe-2e0a529b568b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:45.250516 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:45.256415 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 429/828] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:52:45.257895 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801ce82-dc80-468f-a9fe-2e0a529b568b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:45.281361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 400/829] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:52:45.282703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715b03c-6a7f-4468-b2cc-714a37ec3a2f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:45.363768 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:45.408103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801ce82-dc80-468f-a9fe-2e0a529b568b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:45.414970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715b03c-6a7f-4468-b2cc-714a37ec3a2f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:45.461484 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d5df9-f331-4571-887d-5c3dcca9ac06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:45.462307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d5df9-f331-4571-887d-5c3dcca9ac06 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:45.462472 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3041045-2a06-4b34-9201-a44cbb6db44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:45.462642 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d5df9-f331-4571-887d-5c3dcca9ac06 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:45.462896 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d5df9-f331-4571-887d-5c3dcca9ac06 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:45.463360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3041045-2a06-4b34-9201-a44cbb6db44f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:45.463542 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d5df9-f331-4571-887d-5c3dcca9ac06 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:45.463804 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3041045-2a06-4b34-9201-a44cbb6db44f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:45.464165 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3041045-2a06-4b34-9201-a44cbb6db44f None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:45.465018 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d5df9-f331-4571-887d-5c3dcca9ac06 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:45.465186 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3041045-2a06-4b34-9201-a44cbb6db44f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:45.465574 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3041045-2a06-4b34-9201-a44cbb6db44f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:45.467247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3041045-2a06-4b34-9201-a44cbb6db44f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:45.478104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d67d5df9-f331-4571-887d-5c3dcca9ac06 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 10:52:45.478104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:45.478104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:52:45.478104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:52:45.478104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:52:45.478104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:52:45.478104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:52:45.478104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:45.478104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 10:52:45.478104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:45.478104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:52:45.478104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:45.478104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:45.478104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:45.478104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:45.478104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:45.478104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:45.480172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:45.480172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:45.480172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:45.480172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:45.480172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:45.480172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:45.480172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:52:45.480172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:52:45.480172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:52:45.480172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:52:45.480172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:45.480172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:45.480172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:45.480172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:45.480172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:45.480172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:45.482791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:45.482791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:45.482791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:45.482791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:45.482791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:45.482791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:45.482791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:45.482791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:45.482791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:45.482791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:45.482791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:52:45.482791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:45.482791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 10:52:45.482791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:45.482791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 430/830] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 19 10:52:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:45.484564 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d5df9-f331-4571-887d-5c3dcca9ac06 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:45.486648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 401/831] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:45.488329 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3041045-2a06-4b34-9201-a44cbb6db44f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:45.560570 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:45.613204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d5df9-f331-4571-887d-5c3dcca9ac06 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:45.634412 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3041045-2a06-4b34-9201-a44cbb6db44f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:45.654022 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11803a41-95b1-4460-a159-d265275a9bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:45.654972 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11803a41-95b1-4460-a159-d265275a9bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:45.655310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11803a41-95b1-4460-a159-d265275a9bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:45.655701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11803a41-95b1-4460-a159-d265275a9bc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:45.658080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:45.680860 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11803a41-95b1-4460-a159-d265275a9bc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:45.681891 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2123e-2f52-46ec-93ac-543de0e14f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:45.683151 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2123e-2f52-46ec-93ac-543de0e14f0f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:45.683340 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11803a41-95b1-4460-a159-d265275a9bc5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:45.683588 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2123e-2f52-46ec-93ac-543de0e14f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:45.684024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2123e-2f52-46ec-93ac-543de0e14f0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:45.699887 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2123e-2f52-46ec-93ac-543de0e14f0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:45.707612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-11803a41-95b1-4460-a159-d265275a9bc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:45.707612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:45.707612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:45.707612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:45.707612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:45.707612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:45.707612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:45.707612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:45.707612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:45.707612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:45.707612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:45.707612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:45.707612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:45.707612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:45.707612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:45.709466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:45.709466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:45.709466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:45.709466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:45.709466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:45.709466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:45.709466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:45.709466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:45.709466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:45.709466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:45.709466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:45.709466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:45.709466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:45.709466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:45.709466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:45.709466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:45.709466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:45.710805 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:45.710805 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:45.710805 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:45.710805 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:45.711227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e6a2123e-2f52-46ec-93ac-543de0e14f0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:45.711227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:45.711227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:45.711227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:45.711227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:45.711227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:45.711227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:45.711227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:45.711227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:45.711227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:45.711227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:45.711227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:45.711227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:45.711227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:45.711227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:45.711227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:45.714536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:45.714536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:45.714536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:45.714536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:45.714536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:45.714536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:45.714536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:45.714536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:45.714536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:45.714536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:45.714536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:45.714536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:45.714536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:45.714536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:45.714536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:45.714536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:45.716189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:45.716189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:45.716189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:45.716189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:45.716189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:45.716189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:45.716189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:45.716189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:45.716189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:45.716189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:45.716189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:45.716189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:45.716189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 402/832] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:52:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:45.716189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2123e-2f52-46ec-93ac-543de0e14f0f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:45.717879 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 431/833] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:45.717879 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11803a41-95b1-4460-a159-d265275a9bc5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:45.837462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2123e-2f52-46ec-93ac-543de0e14f0f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:45.839309 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:45.852620 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11803a41-95b1-4460-a159-d265275a9bc5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:45.878700 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e48aff-0b3f-4eba-99e4-a5bba23794b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:45.879673 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e48aff-0b3f-4eba-99e4-a5bba23794b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:45.879957 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e48aff-0b3f-4eba-99e4-a5bba23794b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:45.880229 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e48aff-0b3f-4eba-99e4-a5bba23794b4 None admin] PATH_INFO: `/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/654631b067b94b269f93ea7b3977609d/roles/669088b4ca4644f4bb586dfeaf427fb0` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:45.896593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820876e2-6ba9-4485-bd24-a40e7a759d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:45.896948 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e48aff-0b3f-4eba-99e4-a5bba23794b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=789e54670f7c40ffb67f20478aba00f2, user_id=654631b067b94b269f93ea7b3977609d, role_id=669088b4ca4644f4bb586dfeaf427fb0)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:45.897651 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820876e2-6ba9-4485-bd24-a40e7a759d25 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:45.898069 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820876e2-6ba9-4485-bd24-a40e7a759d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:45.898467 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e48aff-0b3f-4eba-99e4-a5bba23794b4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:45.898659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820876e2-6ba9-4485-bd24-a40e7a759d25 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:45.899603 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820876e2-6ba9-4485-bd24-a40e7a759d25 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:45.900110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820876e2-6ba9-4485-bd24-a40e7a759d25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:45.902761 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820876e2-6ba9-4485-bd24-a40e7a759d25 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:45.911608 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 432/834] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 19 10:52:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:45.913129 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820876e2-6ba9-4485-bd24-a40e7a759d25 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:45.914318 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 403/835] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:52:45 2022] PUT /identity/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/654631b067b94b269f93ea7b3977609d/roles/669088b4ca4644f4bb586dfeaf427fb0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:52:45.915276 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e48aff-0b3f-4eba-99e4-a5bba23794b4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:45.993542 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:46.039924 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e48aff-0b3f-4eba-99e4-a5bba23794b4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:46.063328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820876e2-6ba9-4485-bd24-a40e7a759d25 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:46.084222 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb35f5a-b637-4211-b666-7043a340aefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:46.084955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb35f5a-b637-4211-b666-7043a340aefd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:46.085239 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb35f5a-b637-4211-b666-7043a340aefd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:46.085508 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb35f5a-b637-4211-b666-7043a340aefd None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:46.086268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb35f5a-b637-4211-b666-7043a340aefd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:46.086568 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb35f5a-b637-4211-b666-7043a340aefd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:46.088019 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb35f5a-b637-4211-b666-7043a340aefd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:46.104458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 404/836] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:46.104458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb35f5a-b637-4211-b666-7043a340aefd None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:46.123489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:46.132128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50c527-1e3e-461e-8ac8-bb9a2613fc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:46.132880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50c527-1e3e-461e-8ac8-bb9a2613fc57 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:46.133162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50c527-1e3e-461e-8ac8-bb9a2613fc57 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:46.133433 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50c527-1e3e-461e-8ac8-bb9a2613fc57 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:46.134187 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50c527-1e3e-461e-8ac8-bb9a2613fc57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:46.134496 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50c527-1e3e-461e-8ac8-bb9a2613fc57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:46.135960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50c527-1e3e-461e-8ac8-bb9a2613fc57 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:46.156757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 433/837] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:46.159055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50c527-1e3e-461e-8ac8-bb9a2613fc57 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:46.287926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb35f5a-b637-4211-b666-7043a340aefd None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:46.309391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50c527-1e3e-461e-8ac8-bb9a2613fc57 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:46.322829 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:46.345848 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a7697-3e87-436a-8746-2c4c9cfa7eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:46.346419 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a7697-3e87-436a-8746-2c4c9cfa7eac None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:46.346691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a7697-3e87-436a-8746-2c4c9cfa7eac None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:46.347115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a7697-3e87-436a-8746-2c4c9cfa7eac None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:46.347692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a7697-3e87-436a-8746-2c4c9cfa7eac None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:46.348048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a7697-3e87-436a-8746-2c4c9cfa7eac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:46.349516 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a7697-3e87-436a-8746-2c4c9cfa7eac None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:46.364773 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 405/838] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 19 10:52:46 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:46.364773 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a7697-3e87-436a-8746-2c4c9cfa7eac None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:46.379188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc126ece-2237-48fc-80e7-cb17afb160db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:46.381804 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc126ece-2237-48fc-80e7-cb17afb160db None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:46.382401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc126ece-2237-48fc-80e7-cb17afb160db None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:46.382954 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc126ece-2237-48fc-80e7-cb17afb160db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:46.411604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc126ece-2237-48fc-80e7-cb17afb160db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:46.415106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc126ece-2237-48fc-80e7-cb17afb160db None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:46.454219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-fc126ece-2237-48fc-80e7-cb17afb160db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:46.454219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:46.454219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:46.454219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:46.454219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:46.454219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:46.454219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:46.454219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:46.454219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:46.454219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:46.454219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:46.454219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:46.454219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:46.454219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:46.454219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:46.455968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:46.455968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:46.455968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:46.455968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:46.455968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:46.455968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:46.455968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:46.455968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:46.455968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:46.455968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:46.455968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:46.455968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:46.455968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:46.455968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:46.455968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:46.455968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:46.455968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:46.458301 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:46.458301 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:46.458301 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:46.458301 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:46.461188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 434/839] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:46.462239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc126ece-2237-48fc-80e7-cb17afb160db None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:46.515183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:46.571767 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a7697-3e87-436a-8746-2c4c9cfa7eac None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:46.646213 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31d1e1-9586-4516-905c-f9004982c169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:46.649094 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31d1e1-9586-4516-905c-f9004982c169 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:46.649605 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31d1e1-9586-4516-905c-f9004982c169 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:46.650428 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31d1e1-9586-4516-905c-f9004982c169 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:46.653494 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc126ece-2237-48fc-80e7-cb17afb160db None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:46.665209 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31d1e1-9586-4516-905c-f9004982c169 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:46.667897 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31d1e1-9586-4516-905c-f9004982c169 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:46.702754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-6f31d1e1-9586-4516-905c-f9004982c169 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:46.702754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:46.702754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:46.702754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:46.702754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:46.702754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:46.702754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:46.702754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:46.702754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:46.702754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:46.702754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:46.702754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:46.702754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:46.702754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:46.702754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:46.704481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:46.704481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:46.704481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:46.704481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:46.704481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:46.704481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:46.704481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:46.704481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:46.704481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:46.704481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:46.704481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:46.704481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:46.704481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:46.704481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:46.704481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:46.704481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:46.704481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:46.706943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:46.706943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:46.706943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:46.706943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:46.706943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:46.706943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:46.706943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:46.706943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:46.706943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 406/840] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:46.712588 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31d1e1-9586-4516-905c-f9004982c169 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:46.722442 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7f4d2-8a29-4b28-80ad-d9bdc0fc0651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:46.723350 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7f4d2-8a29-4b28-80ad-d9bdc0fc0651 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:46.723698 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7f4d2-8a29-4b28-80ad-d9bdc0fc0651 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:46.724038 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7f4d2-8a29-4b28-80ad-d9bdc0fc0651 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:46.724922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f7f4d2-8a29-4b28-80ad-d9bdc0fc0651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:46.725302 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f7f4d2-8a29-4b28-80ad-d9bdc0fc0651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:46.727091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f7f4d2-8a29-4b28-80ad-d9bdc0fc0651 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:46.743013 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 435/841] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:46.751381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7f4d2-8a29-4b28-80ad-d9bdc0fc0651 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:46.805323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:46.929946 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31d1e1-9586-4516-905c-f9004982c169 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:46.985912 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7f4d2-8a29-4b28-80ad-d9bdc0fc0651 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:46.999313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa34b3e-cea3-46ad-9bfe-867e91961af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:47.000441 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa34b3e-cea3-46ad-9bfe-867e91961af5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:47.000977 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa34b3e-cea3-46ad-9bfe-867e91961af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:47.001463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa34b3e-cea3-46ad-9bfe-867e91961af5 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:47.003009 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa34b3e-cea3-46ad-9bfe-867e91961af5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:47.004527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa34b3e-cea3-46ad-9bfe-867e91961af5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:47.007332 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa34b3e-cea3-46ad-9bfe-867e91961af5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:47.025972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:47.033124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 407/842] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:47.039453 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa34b3e-cea3-46ad-9bfe-867e91961af5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:47.056129 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001bd38-8871-4afa-91e3-1360aa4aec47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:47.057600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001bd38-8871-4afa-91e3-1360aa4aec47 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:47.057967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001bd38-8871-4afa-91e3-1360aa4aec47 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:47.058334 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001bd38-8871-4afa-91e3-1360aa4aec47 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:47.068889 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001bd38-8871-4afa-91e3-1360aa4aec47 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:47.070502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001bd38-8871-4afa-91e3-1360aa4aec47 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:47.086465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-5001bd38-8871-4afa-91e3-1360aa4aec47 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:52:47.086465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:47.086465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:47.086465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:47.086465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:47.086465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:47.086465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:47.086465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:47.086465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:47.086465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:47.086465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:47.086465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:47.086465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:47.086465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:47.086465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:47.086465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:47.088624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:47.088624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:47.088624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:47.088624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:47.088624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:47.088624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:47.088624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:47.088624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:47.088624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:47.088624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:47.088624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:47.088624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:47.088624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:47.088624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:47.088624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:47.088624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:47.088624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:47.088624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:47.090842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:47.090842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:47.090842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:47.090842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:47.090842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:47.090842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:47.090842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:47.090842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:47.090842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:52:47.090842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:47.090842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 436/843] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:52:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:47.098538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001bd38-8871-4afa-91e3-1360aa4aec47 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:47.224891 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa34b3e-cea3-46ad-9bfe-867e91961af5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:47.276071 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:47.288105 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fab93-c3e7-42a9-ad30-6df4b41b08d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:47.288912 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fab93-c3e7-42a9-ad30-6df4b41b08d7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:47.289289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fab93-c3e7-42a9-ad30-6df4b41b08d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:47.289658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fab93-c3e7-42a9-ad30-6df4b41b08d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:47.290605 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fab93-c3e7-42a9-ad30-6df4b41b08d7 None admin] RBAC: Adding query filter params (role.id=3f9528e7a7914797a4635aa6b536b7ff, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=3c50a821e9ef44cb9fccd49ee4af7dbf) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:47.291012 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fab93-c3e7-42a9-ad30-6df4b41b08d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:47.292558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fab93-c3e7-42a9-ad30-6df4b41b08d7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:47.306354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 408/844] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:47 2022] GET /identity/v3/role_assignments?user.id=3c50a821e9ef44cb9fccd49ee4af7dbf&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=3f9528e7a7914797a4635aa6b536b7ff => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:47.327327 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001bd38-8871-4afa-91e3-1360aa4aec47 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:47.375856 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d774391-9f1c-45bf-a18f-f4999a3e184a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:47.376552 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d774391-9f1c-45bf-a18f-f4999a3e184a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:47.376864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d774391-9f1c-45bf-a18f-f4999a3e184a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:47.377134 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d774391-9f1c-45bf-a18f-f4999a3e184a None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:47.377987 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d774391-9f1c-45bf-a18f-f4999a3e184a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:47.378293 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d774391-9f1c-45bf-a18f-f4999a3e184a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:47.379926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d774391-9f1c-45bf-a18f-f4999a3e184a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:47.406197 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 437/845] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jul 19 10:52:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:47.415332 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fab93-c3e7-42a9-ad30-6df4b41b08d7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:47.547854 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:47.591698 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fab93-c3e7-42a9-ad30-6df4b41b08d7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:47.633354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e696f-0f14-4ffd-a8a3-099d0cd9a7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:47.634025 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e696f-0f14-4ffd-a8a3-099d0cd9a7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:47.634302 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e696f-0f14-4ffd-a8a3-099d0cd9a7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:47.634573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e696f-0f14-4ffd-a8a3-099d0cd9a7a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:47.721352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e696f-0f14-4ffd-a8a3-099d0cd9a7a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:47.722891 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e696f-0f14-4ffd-a8a3-099d0cd9a7a7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:47.793461 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:47.836021 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 409/846] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:47 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:52:47.844292 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d774391-9f1c-45bf-a18f-f4999a3e184a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:47.996120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d774391-9f1c-45bf-a18f-f4999a3e184a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:48.036214 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749cd4b-c2df-4d86-a396-0eebcf7b2f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:48.037090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749cd4b-c2df-4d86-a396-0eebcf7b2f30 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:48.037368 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749cd4b-c2df-4d86-a396-0eebcf7b2f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:48.037637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749cd4b-c2df-4d86-a396-0eebcf7b2f30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:48.047878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:48.061339 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749cd4b-c2df-4d86-a396-0eebcf7b2f30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:48.064241 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749cd4b-c2df-4d86-a396-0eebcf7b2f30 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:48.099408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-b749cd4b-c2df-4d86-a396-0eebcf7b2f30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:48.099408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:48.099408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:48.099408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:48.099408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:48.099408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:48.099408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:48.099408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:48.099408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:48.099408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:48.099408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:48.099408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:48.099408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:48.099408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:48.099408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:48.101120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:48.101120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:48.101120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:48.101120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:48.101120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:48.101120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:48.101120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:48.101120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:48.101120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:48.101120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:48.101120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:48.101120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:48.101120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:48.101120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:48.101120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:48.101120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:48.101120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:48.102757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:48.102757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:48.102757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:48.102757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:48.102757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 438/847] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:48.112241 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e696f-0f14-4ffd-a8a3-099d0cd9a7a7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:48.298521 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e696f-0f14-4ffd-a8a3-099d0cd9a7a7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:48.360809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b08685-7adc-4fda-aa1c-f729f5389906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:48.361924 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b08685-7adc-4fda-aa1c-f729f5389906 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:48.362383 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b08685-7adc-4fda-aa1c-f729f5389906 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:48.362934 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b08685-7adc-4fda-aa1c-f729f5389906 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:48.364413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b08685-7adc-4fda-aa1c-f729f5389906 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:48.364980 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b08685-7adc-4fda-aa1c-f729f5389906 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:48.367614 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b08685-7adc-4fda-aa1c-f729f5389906 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:48.390854 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 410/848] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:48.400113 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749cd4b-c2df-4d86-a396-0eebcf7b2f30 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:48.602358 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749cd4b-c2df-4d86-a396-0eebcf7b2f30 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:48.647625 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18593960-f31d-403c-b6c4-709237b8742e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:48.648369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18593960-f31d-403c-b6c4-709237b8742e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:48.648791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18593960-f31d-403c-b6c4-709237b8742e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:48.649067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18593960-f31d-403c-b6c4-709237b8742e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:48.660049 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18593960-f31d-403c-b6c4-709237b8742e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:48.661637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18593960-f31d-403c-b6c4-709237b8742e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:48.677318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-18593960-f31d-403c-b6c4-709237b8742e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:48.677318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:48.677318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:48.677318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:48.677318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:48.677318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:48.677318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:48.677318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:48.677318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:48.677318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:48.677318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:48.677318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:48.677318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:48.677318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:48.677318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:48.678355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:48.678355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:48.678355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:48.678355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:48.678355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:48.678355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:48.678355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:48.678355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:48.678355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:48.678355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:48.678355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:48.678355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:48.678355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:48.678355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:48.678355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:48.678355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:48.678355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:48.679281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:48.679281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:48.679281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:48.679281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:48.679281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:48.679281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:48.679281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:48.679281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:48.680278 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 439/849] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:48.688756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b08685-7adc-4fda-aa1c-f729f5389906 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:48.735051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:48.780941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d332a-6c45-41f5-9a17-be636f851557 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:48.781195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d332a-6c45-41f5-9a17-be636f851557 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:48.781479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d332a-6c45-41f5-9a17-be636f851557 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:48.783170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 440/850] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:52:48.788767 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b41fa-6d70-4945-a047-4c80223bf267 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:48.789071 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b41fa-6d70-4945-a047-4c80223bf267 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:48.789285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b41fa-6d70-4945-a047-4c80223bf267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:48.807213 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fc7b41fa-6d70-4945-a047-4c80223bf267 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:48.808450 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fc7b41fa-6d70-4945-a047-4c80223bf267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:48.872541 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:48.876465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b08685-7adc-4fda-aa1c-f729f5389906 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:48.911068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 441/851] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:52:48.913150 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ed3ad-b079-4403-8c76-9051aa17de66 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:48.913618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ed3ad-b079-4403-8c76-9051aa17de66 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:48.914065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ed3ad-b079-4403-8c76-9051aa17de66 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:48.920759 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 442/852] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:48.926836 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2281f7-cad1-4184-9831-57cb5e958dd3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:48.927327 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2281f7-cad1-4184-9831-57cb5e958dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:48.927815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2281f7-cad1-4184-9831-57cb5e958dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:48.930525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d95129-a309-4e1c-a190-1552f6132591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:48.932182 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d95129-a309-4e1c-a190-1552f6132591 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:48.933132 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d95129-a309-4e1c-a190-1552f6132591 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:48.933432 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d95129-a309-4e1c-a190-1552f6132591 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:48.934259 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d95129-a309-4e1c-a190-1552f6132591 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:48.934571 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d95129-a309-4e1c-a190-1552f6132591 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:48.936239 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d95129-a309-4e1c-a190-1552f6132591 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:48.956380 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9d2281f7-cad1-4184-9831-57cb5e958dd3 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:48.962344 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 411/853] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:48.962550 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9d2281f7-cad1-4184-9831-57cb5e958dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:48.962643 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d95129-a309-4e1c-a190-1552f6132591 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:49.072802 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 443/854] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:52:49.072802 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2281f7-cad1-4184-9831-57cb5e958dd3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:49.110788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:49.133167 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d95129-a309-4e1c-a190-1552f6132591 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:49.192313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0c201-822f-4423-8c7e-c775a5bd9898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:49.193486 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0c201-822f-4423-8c7e-c775a5bd9898 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:49.193982 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0c201-822f-4423-8c7e-c775a5bd9898 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:49.194473 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0c201-822f-4423-8c7e-c775a5bd9898 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:49.195762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0c201-822f-4423-8c7e-c775a5bd9898 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:49.198360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0c201-822f-4423-8c7e-c775a5bd9898 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:49.198856 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2281f7-cad1-4184-9831-57cb5e958dd3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:49.218452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:49.219045 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 412/855] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 19 10:52:48 2022] POST /identity/v3/services => generated 251 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:52:49.219893 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0c201-822f-4423-8c7e-c775a5bd9898 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:49.266740 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b51d9c-dd47-4238-b127-30f95d0a5f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:49.267424 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b51d9c-dd47-4238-b127-30f95d0a5f42 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:49.267702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b51d9c-dd47-4238-b127-30f95d0a5f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:49.267971 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b51d9c-dd47-4238-b127-30f95d0a5f42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:49.268866 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b51d9c-dd47-4238-b127-30f95d0a5f42 None admin] RBAC: Adding query filter params (role.id=3f9528e7a7914797a4635aa6b536b7ff, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=4fa6a9aa611640f893b5e717a094acf7) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:49.269177 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b51d9c-dd47-4238-b127-30f95d0a5f42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:49.271053 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b51d9c-dd47-4238-b127-30f95d0a5f42 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:49.284757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 444/856] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:49 2022] GET /identity/v3/role_assignments?user.id=4fa6a9aa611640f893b5e717a094acf7&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=3f9528e7a7914797a4635aa6b536b7ff => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:49.374129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0c201-822f-4423-8c7e-c775a5bd9898 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:49.416661 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d7747-eec9-4ee3-a6bb-05e112334e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:49.417552 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d7747-eec9-4ee3-a6bb-05e112334e91 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:49.417835 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d7747-eec9-4ee3-a6bb-05e112334e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:49.418105 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d7747-eec9-4ee3-a6bb-05e112334e91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:49.437871 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d7747-eec9-4ee3-a6bb-05e112334e91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:49.451692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-eb9d7747-eec9-4ee3-a6bb-05e112334e91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:49.451692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:49.451692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:49.451692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:49.451692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:49.451692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:49.451692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:49.451692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:49.451692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:49.451692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:49.451692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:49.451692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:49.451692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:49.451692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:49.451692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:49.451692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:49.452697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:49.452697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:49.452697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:49.452697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:49.452697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:49.452697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:49.452697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:49.452697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:49.452697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:49.452697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:49.452697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:49.452697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:49.452697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:49.452697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:49.452697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:49.452697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:49.453553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:49.453553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:49.453553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:49.453553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:49.453553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:49.453553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:49.453553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:49.453553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:49.453553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:49.453553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:49.453553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:52:49.453553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:49.453553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 413/857] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:52:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:49.461779 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b51d9c-dd47-4238-b127-30f95d0a5f42 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:49.585610 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b51d9c-dd47-4238-b127-30f95d0a5f42 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:49.626533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff378731-5a81-431b-a67f-51b637c7f1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:49.627278 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff378731-5a81-431b-a67f-51b637c7f1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:49.627558 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff378731-5a81-431b-a67f-51b637c7f1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:49.627824 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff378731-5a81-431b-a67f-51b637c7f1a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:49.628624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff378731-5a81-431b-a67f-51b637c7f1a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:49.629056 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff378731-5a81-431b-a67f-51b637c7f1a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:49.630429 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff378731-5a81-431b-a67f-51b637c7f1a1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:49.640537 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 445/858] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 19 10:52:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:49.649876 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d7747-eec9-4ee3-a6bb-05e112334e91 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:49.654711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:49.774048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d7747-eec9-4ee3-a6bb-05e112334e91 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:49.815887 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb52a5-4608-4449-96cc-78ce204b2d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:49.817239 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb52a5-4608-4449-96cc-78ce204b2d79 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:49.817723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb52a5-4608-4449-96cc-78ce204b2d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:49.818368 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb52a5-4608-4449-96cc-78ce204b2d79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:49.830928 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb52a5-4608-4449-96cc-78ce204b2d79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:49.832841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb52a5-4608-4449-96cc-78ce204b2d79 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:49.852413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-2adb52a5-4608-4449-96cc-78ce204b2d79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:49.852413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:49.852413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:49.852413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:49.852413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:49.852413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:49.852413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:49.852413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:49.852413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:49.852413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:49.852413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:49.852413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:49.852413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:49.852413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:49.852413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:49.853402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:49.853402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:49.853402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:49.853402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:49.853402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:49.853402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:49.853402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:49.853402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:49.853402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:49.853402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:49.853402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:49.853402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:49.853402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:49.853402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:49.853402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:49.853402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:49.853402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:49.854270 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:49.854270 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:49.854270 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:49.854270 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:49.856596 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 414/859] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:49.862610 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff378731-5a81-431b-a67f-51b637c7f1a1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:50.028107 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:50.124524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff378731-5a81-431b-a67f-51b637c7f1a1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:50.161306 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f17d3-d239-4e8c-9f58-38a213815e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:50.161985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f17d3-d239-4e8c-9f58-38a213815e25 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:50.162260 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f17d3-d239-4e8c-9f58-38a213815e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:50.162530 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f17d3-d239-4e8c-9f58-38a213815e25 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:50.163255 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f17d3-d239-4e8c-9f58-38a213815e25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:50.163554 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f17d3-d239-4e8c-9f58-38a213815e25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:50.164964 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f17d3-d239-4e8c-9f58-38a213815e25 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:50.178734 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 446/860] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:50.183593 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffa761-850a-4dfd-a583-6e16cc4c6049 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:50.184069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffa761-850a-4dfd-a583-6e16cc4c6049 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:50.184228 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f17d3-d239-4e8c-9f58-38a213815e25 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:50.184542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffa761-850a-4dfd-a583-6e16cc4c6049 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:50.192896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 415/861] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:50.196151 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12ce18-47e8-49b1-824e-c76195d047da None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:50.196629 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12ce18-47e8-49b1-824e-c76195d047da None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:50.197442 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12ce18-47e8-49b1-824e-c76195d047da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:50.223073 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1a12ce18-47e8-49b1-824e-c76195d047da None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:50.224984 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1a12ce18-47e8-49b1-824e-c76195d047da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:50.305802 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:50.320000 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:50.330883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f17d3-d239-4e8c-9f58-38a213815e25 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:50.337968 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 416/862] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:50 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:52:50.374522 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12ce18-47e8-49b1-824e-c76195d047da None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:50.381006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dc247-3a42-4ce7-957d-afcd07424bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:50.382898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dc247-3a42-4ce7-957d-afcd07424bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:50.383849 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dc247-3a42-4ce7-957d-afcd07424bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:50.384665 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dc247-3a42-4ce7-957d-afcd07424bf8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:50.401420 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975dc247-3a42-4ce7-957d-afcd07424bf8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:50.404930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975dc247-3a42-4ce7-957d-afcd07424bf8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:50.435316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-975dc247-3a42-4ce7-957d-afcd07424bf8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:52:50.435316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:50.435316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:50.435316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:50.435316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:50.435316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:50.435316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:50.435316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:50.435316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:50.435316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:50.435316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:50.435316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:50.435316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:50.435316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:50.435316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:50.435316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:50.437085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:50.437085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:50.437085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:50.437085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:50.437085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:50.437085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:50.437085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:50.437085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:50.437085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:50.437085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:50.437085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:50.437085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:50.437085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:50.437085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:50.437085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:50.437085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:50.437085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:50.437085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:50.438821 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:50.438821 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:50.438821 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:50.438821 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:50.438821 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:50.438821 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:50.438821 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:50.438821 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:50.438821 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:52:50.438821 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:50.443799 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 447/863] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jul 19 10:52:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:50.450313 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dc247-3a42-4ce7-957d-afcd07424bf8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:50.524201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12ce18-47e8-49b1-824e-c76195d047da None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:50.584910 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8446c65-c1de-4e1a-8507-535042d6697d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:50.585664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8446c65-c1de-4e1a-8507-535042d6697d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:50.585942 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8446c65-c1de-4e1a-8507-535042d6697d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:50.586213 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8446c65-c1de-4e1a-8507-535042d6697d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:50.586881 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8446c65-c1de-4e1a-8507-535042d6697d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:50.589198 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8446c65-c1de-4e1a-8507-535042d6697d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:50.606401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d8446c65-c1de-4e1a-8507-535042d6697d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 10:52:50.606401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:50.606401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:52:50.606401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:52:50.606401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:52:50.606401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:52:50.606401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:52:50.606401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:50.606401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 10:52:50.606401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:50.606401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:52:50.606401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:50.606401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:50.606401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:50.606401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:50.606401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:50.608228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:50.608228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:50.608228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:50.608228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:50.608228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:50.608228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:50.608228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:50.608228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:52:50.608228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:52:50.608228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:52:50.608228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:52:50.608228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:50.608228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:50.608228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:50.608228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:50.608228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:50.610498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:50.610498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:50.610498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:50.610498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:50.610498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:50.610498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:50.610498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:50.610498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:50.610498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:50.610498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:50.610498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:50.610498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:52:50.610498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:50.610498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 10:52:50.610498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:50.613809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 417/864] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Jul 19 10:52:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:50.615629 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8446c65-c1de-4e1a-8507-535042d6697d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:50.620292 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dc247-3a42-4ce7-957d-afcd07424bf8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:50.689585 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:50.690420 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b95da1-5fd8-46a7-96e5-7cdf4ce5fc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:50.692075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b95da1-5fd8-46a7-96e5-7cdf4ce5fc41 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:50.692486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b95da1-5fd8-46a7-96e5-7cdf4ce5fc41 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:50.692805 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b95da1-5fd8-46a7-96e5-7cdf4ce5fc41 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:50.693811 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b95da1-5fd8-46a7-96e5-7cdf4ce5fc41 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:50.694127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b95da1-5fd8-46a7-96e5-7cdf4ce5fc41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:50.696350 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b95da1-5fd8-46a7-96e5-7cdf4ce5fc41 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:50.725032 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 448/865] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jul 19 10:52:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:50.728935 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b95da1-5fd8-46a7-96e5-7cdf4ce5fc41 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:50.758080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:50.781863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8446c65-c1de-4e1a-8507-535042d6697d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:50.825100 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687616ec-bee2-483f-b133-44e46a50dcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:50.825782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687616ec-bee2-483f-b133-44e46a50dcde None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:50.826064 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687616ec-bee2-483f-b133-44e46a50dcde None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:50.826523 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687616ec-bee2-483f-b133-44e46a50dcde None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:50.827240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687616ec-bee2-483f-b133-44e46a50dcde None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:50.827543 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687616ec-bee2-483f-b133-44e46a50dcde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:50.829254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687616ec-bee2-483f-b133-44e46a50dcde None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:50.841031 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 418/866] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 19 10:52:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:50.846070 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687616ec-bee2-483f-b133-44e46a50dcde None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:50.934129 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b95da1-5fd8-46a7-96e5-7cdf4ce5fc41 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:50.974777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687616ec-bee2-483f-b133-44e46a50dcde None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:50.991044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:51.018891 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b53fa-ee7f-47eb-8ee3-b0c0adff52fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:51.019996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b53fa-ee7f-47eb-8ee3-b0c0adff52fb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:51.020506 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b53fa-ee7f-47eb-8ee3-b0c0adff52fb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:51.021028 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b53fa-ee7f-47eb-8ee3-b0c0adff52fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:51.022710 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914b1c2-4e71-4e3b-91ab-31a18bd8ffa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:51.023847 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914b1c2-4e71-4e3b-91ab-31a18bd8ffa0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:51.024347 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914b1c2-4e71-4e3b-91ab-31a18bd8ffa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:51.025250 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914b1c2-4e71-4e3b-91ab-31a18bd8ffa0 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:51.027946 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914b1c2-4e71-4e3b-91ab-31a18bd8ffa0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:51.028520 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914b1c2-4e71-4e3b-91ab-31a18bd8ffa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:51.031172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914b1c2-4e71-4e3b-91ab-31a18bd8ffa0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:51.044953 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 419/867] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 19 10:52:50 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:51.127239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b53fa-ee7f-47eb-8ee3-b0c0adff52fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:51.129643 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b53fa-ee7f-47eb-8ee3-b0c0adff52fb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:51.158111 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:51.316083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 449/868] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:50 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:52:51.322247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914b1c2-4e71-4e3b-91ab-31a18bd8ffa0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:51.433320 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914b1c2-4e71-4e3b-91ab-31a18bd8ffa0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:51.469920 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995719f-ab7a-4509-80a9-77d07d70bca9 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:51.471308 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995719f-ab7a-4509-80a9-77d07d70bca9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:51.471593 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90e4b8-6d3c-4bdd-ae83-848e196ca46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:51.472379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995719f-ab7a-4509-80a9-77d07d70bca9 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:51.472621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90e4b8-6d3c-4bdd-ae83-848e196ca46c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:51.472790 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90e4b8-6d3c-4bdd-ae83-848e196ca46c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:51.472995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90e4b8-6d3c-4bdd-ae83-848e196ca46c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:51.476356 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 450/869] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:52:51.481447 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf658bf-1598-4ee1-9642-4d80550c5388 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:51.481743 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf658bf-1598-4ee1-9642-4d80550c5388 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:51.481995 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf658bf-1598-4ee1-9642-4d80550c5388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:51.485576 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90e4b8-6d3c-4bdd-ae83-848e196ca46c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:51.488977 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90e4b8-6d3c-4bdd-ae83-848e196ca46c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:51.500755 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dbf658bf-1598-4ee1-9642-4d80550c5388 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:51.501562 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dbf658bf-1598-4ee1-9642-4d80550c5388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:51.515800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-ed90e4b8-6d3c-4bdd-ae83-848e196ca46c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:51.515800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:51.515800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:51.515800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:51.515800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:51.515800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:51.515800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:51.515800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:51.515800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:51.515800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:51.515800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:51.515800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:51.515800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:51.515800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:51.515800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:51.516792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:51.516792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:51.516792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:51.516792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:51.516792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:51.516792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:51.516792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:51.516792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:51.516792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:51.516792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:51.516792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:51.516792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:51.516792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:51.516792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:51.516792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:51.516792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:51.516792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:51.517664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:51.517664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:51.517664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:51.517664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:51.520067 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 420/870] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:51.526305 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90e4b8-6d3c-4bdd-ae83-848e196ca46c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:51.594124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 451/871] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:51 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:52:51.596525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:51.637231 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf658bf-1598-4ee1-9642-4d80550c5388 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:51.677684 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90e4b8-6d3c-4bdd-ae83-848e196ca46c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:51.709285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:51.738275 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f0b69-9866-4ce6-87ae-de1709e42757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:51.739446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f0b69-9866-4ce6-87ae-de1709e42757 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:51.739757 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f0b69-9866-4ce6-87ae-de1709e42757 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:51.740021 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f0b69-9866-4ce6-87ae-de1709e42757 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:51.740839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f0b69-9866-4ce6-87ae-de1709e42757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:51.741155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f0b69-9866-4ce6-87ae-de1709e42757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:51.742576 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f0b69-9866-4ce6-87ae-de1709e42757 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:51.756349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 421/872] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:51.762753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f0b69-9866-4ce6-87ae-de1709e42757 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:51.794512 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf658bf-1598-4ee1-9642-4d80550c5388 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:51.831032 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29044dd-6bad-42f8-b362-aa333bf42a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:51.832215 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29044dd-6bad-42f8-b362-aa333bf42a95 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:51.832659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29044dd-6bad-42f8-b362-aa333bf42a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:51.833088 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29044dd-6bad-42f8-b362-aa333bf42a95 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:51.833885 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29044dd-6bad-42f8-b362-aa333bf42a95 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:51.835440 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29044dd-6bad-42f8-b362-aa333bf42a95 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:51.848068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d29044dd-6bad-42f8-b362-aa333bf42a95 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 10:52:51.848068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:51.848068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:52:51.848068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:52:51.848068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:52:51.848068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:52:51.848068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:52:51.848068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:51.848068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 10:52:51.848068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:51.848068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:52:51.848068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:51.848068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:51.848068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:51.848068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:51.848068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:51.848068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:51.849242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:51.849242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:51.849242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:51.849242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:51.849242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:51.849242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:51.849242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:52:51.849242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:52:51.849242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:52:51.849242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:52:51.849242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:51.849242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:51.849242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:51.849242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:51.849242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:51.849242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:51.850063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:51.850063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:51.850063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:51.850063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:51.850063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:51.850063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:51.850063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:51.850063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:51.850063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:51.850063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:51.850063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:52:51.850063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:51.850063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 10:52:51.850063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:51.853281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 452/873] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 19 10:52:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:51.863438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29044dd-6bad-42f8-b362-aa333bf42a95 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:51.865934 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:51.880018 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f0b69-9866-4ce6-87ae-de1709e42757 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:51.928088 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890f677-b1c9-49f9-9929-0ab263e65a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:51.929509 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890f677-b1c9-49f9-9929-0ab263e65a09 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:51.930195 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890f677-b1c9-49f9-9929-0ab263e65a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:51.930699 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890f677-b1c9-49f9-9929-0ab263e65a09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:51.945175 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890f677-b1c9-49f9-9929-0ab263e65a09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:51.948435 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890f677-b1c9-49f9-9929-0ab263e65a09 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:51.979424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-2890f677-b1c9-49f9-9929-0ab263e65a09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:51.979424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:51.979424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:51.979424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:51.979424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:51.979424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:51.979424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:51.979424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:51.979424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:51.979424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:51.979424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:51.979424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:51.979424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:51.979424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:51.979424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:51.980524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:51.980524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:51.980524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:51.980524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:51.980524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:51.980524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:51.980524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:51.980524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:51.980524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:51.980524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:51.980524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:51.980524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:51.980524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:51.980524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:51.980524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:51.980524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:51.980524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:51.981642 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:51.981642 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:51.981642 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:51.981642 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:51.981642 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:51.981642 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:51.981642 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:51.981642 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:51.982308 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 422/874] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:51.989026 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890f677-b1c9-49f9-9929-0ab263e65a09 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:52.060892 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29044dd-6bad-42f8-b362-aa333bf42a95 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:52.074143 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:52.127092 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdd94a-e41e-4ebf-8e53-7bbe4c0c3e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:52.128153 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdd94a-e41e-4ebf-8e53-7bbe4c0c3e99 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:52.128599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdd94a-e41e-4ebf-8e53-7bbe4c0c3e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:52.129112 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdd94a-e41e-4ebf-8e53-7bbe4c0c3e99 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:52.130315 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdd94a-e41e-4ebf-8e53-7bbe4c0c3e99 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:52.130813 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdd94a-e41e-4ebf-8e53-7bbe4c0c3e99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:52.133204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdd94a-e41e-4ebf-8e53-7bbe4c0c3e99 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:52.140529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 453/875] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 19 10:52:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:52.142775 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74330950-c0af-4cc8-80e6-a888c4656383 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:52.143255 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74330950-c0af-4cc8-80e6-a888c4656383 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:52.143733 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74330950-c0af-4cc8-80e6-a888c4656383 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:52.148783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 454/876] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:52.159619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74330950-c0af-4cc8-80e6-a888c4656383 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:52.191904 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890f677-b1c9-49f9-9929-0ab263e65a09 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:52.238517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b0194-42d5-4fd0-90d4-76025fc74f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:52.239196 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b0194-42d5-4fd0-90d4-76025fc74f86 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:52.239529 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b0194-42d5-4fd0-90d4-76025fc74f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:52.239813 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b0194-42d5-4fd0-90d4-76025fc74f86 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:52.240610 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b0194-42d5-4fd0-90d4-76025fc74f86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:52.240948 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b0194-42d5-4fd0-90d4-76025fc74f86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:52.242413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b0194-42d5-4fd0-90d4-76025fc74f86 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:52.256756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 423/877] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:52.258064 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e142fae-58af-483f-8b98-857e8cf515a0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:52.258350 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e142fae-58af-483f-8b98-857e8cf515a0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:52.258618 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e142fae-58af-483f-8b98-857e8cf515a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:52.277349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4e142fae-58af-483f-8b98-857e8cf515a0 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:52.278554 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4e142fae-58af-483f-8b98-857e8cf515a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:52.281014 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:52.307024 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74330950-c0af-4cc8-80e6-a888c4656383 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:52.345094 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ab4b7-fe0d-44b1-9ad3-2fe2945d13a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:52.345768 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ab4b7-fe0d-44b1-9ad3-2fe2945d13a1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:52.346054 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ab4b7-fe0d-44b1-9ad3-2fe2945d13a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:52.346323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ab4b7-fe0d-44b1-9ad3-2fe2945d13a1 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:52.347042 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ab4b7-fe0d-44b1-9ad3-2fe2945d13a1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:52.347335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ab4b7-fe0d-44b1-9ad3-2fe2945d13a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:52.348805 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ab4b7-fe0d-44b1-9ad3-2fe2945d13a1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:52.354882 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 455/878] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 19 10:52:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:52.355725 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ab4b7-fe0d-44b1-9ad3-2fe2945d13a1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:52.375349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 424/879] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:52 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:52:52.376532 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e142fae-58af-483f-8b98-857e8cf515a0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:52.421137 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:52.526933 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e142fae-58af-483f-8b98-857e8cf515a0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:52.544761 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ab4b7-fe0d-44b1-9ad3-2fe2945d13a1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:52.584880 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368e594-10ce-407f-bf0c-63c646be1e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:52.586000 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368e594-10ce-407f-bf0c-63c646be1e29 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:52.586488 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368e594-10ce-407f-bf0c-63c646be1e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:52.587083 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368e594-10ce-407f-bf0c-63c646be1e29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:52.588530 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1368e594-10ce-407f-bf0c-63c646be1e29 None admin] RBAC: Adding query filter params (interface=public, service_id=aed135b90dc349739ead2b9d73385347, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:52.588953 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1368e594-10ce-407f-bf0c-63c646be1e29 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:52.591526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1368e594-10ce-407f-bf0c-63c646be1e29 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:52.606253 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 425/880] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jul 19 10:52:52 2022] GET /identity/v3/endpoints?service_id=aed135b90dc349739ead2b9d73385347&interface=public®ion_id=RegionOne => generated 194 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:52.606253 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368e594-10ce-407f-bf0c-63c646be1e29 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:52.608182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e66080-30b1-4c14-9559-8909c367ddf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:52.609248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e66080-30b1-4c14-9559-8909c367ddf4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:52.609535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e66080-30b1-4c14-9559-8909c367ddf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:52.610010 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e66080-30b1-4c14-9559-8909c367ddf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:52.611331 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:52.611582 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e66080-30b1-4c14-9559-8909c367ddf4 None admin] RBAC: Adding query filter params (role.id=669088b4ca4644f4bb586dfeaf427fb0, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=654631b067b94b269f93ea7b3977609d) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:52.612140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e66080-30b1-4c14-9559-8909c367ddf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:52.614866 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e66080-30b1-4c14-9559-8909c367ddf4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:52.632757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 456/881] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:52 2022] GET /identity/v3/role_assignments?user.id=654631b067b94b269f93ea7b3977609d&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=669088b4ca4644f4bb586dfeaf427fb0 => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:52.632757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e66080-30b1-4c14-9559-8909c367ddf4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:52.822217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:52.829927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e66080-30b1-4c14-9559-8909c367ddf4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:52.845072 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368e594-10ce-407f-bf0c-63c646be1e29 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:52.893031 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde041dd-4841-4539-99cc-192fbba6c4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:52.893992 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde041dd-4841-4539-99cc-192fbba6c4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:52.894273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde041dd-4841-4539-99cc-192fbba6c4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:52.894619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde041dd-4841-4539-99cc-192fbba6c4d6 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:52.895304 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde041dd-4841-4539-99cc-192fbba6c4d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:52.896764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde041dd-4841-4539-99cc-192fbba6c4d6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:52.903764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 457/882] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 19 10:52:52 2022] GET /identity/v3/services => generated 1011 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 10:52:52.924575 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ec04f-9434-4038-9841-af9337d375dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:52.926500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ec04f-9434-4038-9841-af9337d375dc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:52.927160 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ec04f-9434-4038-9841-af9337d375dc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:52.927742 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ec04f-9434-4038-9841-af9337d375dc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:52.929237 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ec04f-9434-4038-9841-af9337d375dc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:52.932317 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ec04f-9434-4038-9841-af9337d375dc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:52.957863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-5d0ec04f-9434-4038-9841-af9337d375dc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:52:52.957863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:52.957863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:52:52.957863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:52:52.957863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:52:52.957863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:52:52.957863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:52:52.957863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:52.957863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:52:52.957863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:52.957863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:52:52.957863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:52.957863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:52.957863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:52.957863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:52.957863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:52.957863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:52.959751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:52.959751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:52.959751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:52.959751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:52.959751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:52.959751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:52.959751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:52:52.959751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:52:52.959751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:52:52.959751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:52:52.959751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:52.959751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:52.959751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:52.959751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:52.959751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:52.959751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:52.961415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:52.961415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:52.961415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:52.961415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:52.961415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:52.961415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:52.961415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:52.961415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:52.961415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:52.961415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:52.961415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:52:52.961415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:52.961415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:52:52.961415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:52.962806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 426/883] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 19 10:52:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:52.970711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde041dd-4841-4539-99cc-192fbba6c4d6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:53.166322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde041dd-4841-4539-99cc-192fbba6c4d6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:53.227981 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a56270-6a91-4aed-999a-f05d98405499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:53.229122 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a56270-6a91-4aed-999a-f05d98405499 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:53.229554 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a56270-6a91-4aed-999a-f05d98405499 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:53.229973 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a56270-6a91-4aed-999a-f05d98405499 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:53.231150 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a56270-6a91-4aed-999a-f05d98405499 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:53.231616 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a56270-6a91-4aed-999a-f05d98405499 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:53.234150 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a56270-6a91-4aed-999a-f05d98405499 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:53.248919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 458/884] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jul 19 10:52:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:53.251958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ec04f-9434-4038-9841-af9337d375dc None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:53.377805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:53.385203 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201c175-2c83-4fc8-a087-6fb4b68b6f60 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:53.385626 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201c175-2c83-4fc8-a087-6fb4b68b6f60 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:53.385787 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201c175-2c83-4fc8-a087-6fb4b68b6f60 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:53.387498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 459/885] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:53.393523 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f05a9-4c8a-4810-a454-490211fc15a3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:53.393927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f05a9-4c8a-4810-a454-490211fc15a3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:53.394070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f05a9-4c8a-4810-a454-490211fc15a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:53.413731 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-919f05a9-4c8a-4810-a454-490211fc15a3 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:53.415102 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-919f05a9-4c8a-4810-a454-490211fc15a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:53.453825 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ec04f-9434-4038-9841-af9337d375dc None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:53.454766 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:53.522041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 460/886] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:52:53.523578 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001613f-fa90-431a-96a4-bc65de3f5722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:53.532171 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001613f-fa90-431a-96a4-bc65de3f5722 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:53.532171 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001613f-fa90-431a-96a4-bc65de3f5722 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:53.532171 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001613f-fa90-431a-96a4-bc65de3f5722 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:53.532171 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001613f-fa90-431a-96a4-bc65de3f5722 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:53.532171 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001613f-fa90-431a-96a4-bc65de3f5722 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:53.532171 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001613f-fa90-431a-96a4-bc65de3f5722 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:53.539906 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 427/887] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jul 19 10:52:53 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:53.545005 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f05a9-4c8a-4810-a454-490211fc15a3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:53.670108 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f05a9-4c8a-4810-a454-490211fc15a3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:53.710279 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7f672-9cd3-4d8b-8d6c-94e4d26178cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:53.711226 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7f672-9cd3-4d8b-8d6c-94e4d26178cb None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:53.711679 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7f672-9cd3-4d8b-8d6c-94e4d26178cb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:53.712102 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7f672-9cd3-4d8b-8d6c-94e4d26178cb None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:53.713059 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7f672-9cd3-4d8b-8d6c-94e4d26178cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:53.714649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7f672-9cd3-4d8b-8d6c-94e4d26178cb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:53.731763 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 461/888] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 19 10:52:53 2022] POST /identity/v3/services => generated 269 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 10:52:55.144754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248c937-aacd-40f9-8131-12b4b5e9029b None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:55.145592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248c937-aacd-40f9-8131-12b4b5e9029b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:55.145592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248c937-aacd-40f9-8131-12b4b5e9029b None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:55.147104 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 428/889] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:55.153073 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926efe9-bde3-4fcd-97eb-e972b7f74bf5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:55.153602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926efe9-bde3-4fcd-97eb-e972b7f74bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:55.153602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926efe9-bde3-4fcd-97eb-e972b7f74bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:55.171617 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0926efe9-bde3-4fcd-97eb-e972b7f74bf5 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:55.172874 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0926efe9-bde3-4fcd-97eb-e972b7f74bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:55.185415 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:55.248728 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088815a7-c02a-4af1-a10c-856453da426f None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:55.249062 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088815a7-c02a-4af1-a10c-856453da426f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:55.249310 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088815a7-c02a-4af1-a10c-856453da426f None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:55.250967 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 429/890] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:55.256707 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 462/891] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:52:55.256949 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68feffc6-ae71-46bf-8732-4d41621fc2aa None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:55.257233 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68feffc6-ae71-46bf-8732-4d41621fc2aa None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:55.257514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68feffc6-ae71-46bf-8732-4d41621fc2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:55.275899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-68feffc6-ae71-46bf-8732-4d41621fc2aa None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:55.277161 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-68feffc6-ae71-46bf-8732-4d41621fc2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:55.283816 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926efe9-bde3-4fcd-97eb-e972b7f74bf5 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:55.352608 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 430/892] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:52:55.375999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68feffc6-ae71-46bf-8732-4d41621fc2aa None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:55.400285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926efe9-bde3-4fcd-97eb-e972b7f74bf5 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:55.443027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349160d-3683-4356-802e-108af9c061cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:55.444010 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349160d-3683-4356-802e-108af9c061cd None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:55.444299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349160d-3683-4356-802e-108af9c061cd None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:55.444948 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:55.448314 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349160d-3683-4356-802e-108af9c061cd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:55.472831 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349160d-3683-4356-802e-108af9c061cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:55.483299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d349160d-3683-4356-802e-108af9c061cd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:52:55.483299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:55.483299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:55.483299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:55.483299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:55.483299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:55.483299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:55.483299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:55.483299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:55.483299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:55.483299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:55.483299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:55.483299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:55.483299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:55.483299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:55.483299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:55.484636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:55.484636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:55.484636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:55.484636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:55.484636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:55.484636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:55.484636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:55.484636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:55.484636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:55.484636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:55.484636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:55.484636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:55.484636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:55.484636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:55.484636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:55.484636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:55.486169 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:55.486169 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:55.486169 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:55.486169 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:55.486169 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:55.486169 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:55.486169 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:55.486169 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:55.486169 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:55.486169 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:55.486169 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:52:55.486169 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:55.492025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 463/893] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jul 19 10:52:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:55.492734 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349160d-3683-4356-802e-108af9c061cd None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:55.496369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:55.532285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68feffc6-ae71-46bf-8732-4d41621fc2aa None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:55.583392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720740a-9ea5-441b-9179-f3a11405796c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:55.584464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720740a-9ea5-441b-9179-f3a11405796c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:55.584972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720740a-9ea5-441b-9179-f3a11405796c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:55.585625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720740a-9ea5-441b-9179-f3a11405796c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:55.587197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720740a-9ea5-441b-9179-f3a11405796c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:55.589155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720740a-9ea5-441b-9179-f3a11405796c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:55.611396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-1720740a-9ea5-441b-9179-f3a11405796c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 10:52:55.611396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:55.611396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:52:55.611396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:52:55.611396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:52:55.611396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:52:55.611396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:52:55.611396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:55.611396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 10:52:55.611396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:55.611396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:52:55.611396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:55.611396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:55.611396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:55.611396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:55.611396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:55.611396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:55.612460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:55.612460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:55.612460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:55.612460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:55.612460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:55.612460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:55.612460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:52:55.612460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:52:55.612460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:52:55.612460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:52:55.612460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:55.612460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:55.612460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:55.612460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:55.612460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:55.612460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:55.613374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:55.613374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:55.613374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:55.613374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:55.613374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:55.613374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:55.613374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:55.613374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:55.613374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:55.613374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:55.613374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:52:55.613374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:55.613374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 10:52:55.613374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:55.614144 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 431/894] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 19 10:52:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:55.621811 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720740a-9ea5-441b-9179-f3a11405796c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:55.631861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349160d-3683-4356-802e-108af9c061cd None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:55.673307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57919e-c757-4ee2-9b31-c5e84dd0d6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:55.673933 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57919e-c757-4ee2-9b31-c5e84dd0d6fe None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:55.674213 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57919e-c757-4ee2-9b31-c5e84dd0d6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:55.674487 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57919e-c757-4ee2-9b31-c5e84dd0d6fe None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:55.675254 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57919e-c757-4ee2-9b31-c5e84dd0d6fe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:55.675604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57919e-c757-4ee2-9b31-c5e84dd0d6fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:55.677034 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57919e-c757-4ee2-9b31-c5e84dd0d6fe None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:55.686971 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 464/895] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jul 19 10:52:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:55.695958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57919e-c757-4ee2-9b31-c5e84dd0d6fe None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:55.780100 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:55.780687 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720740a-9ea5-441b-9179-f3a11405796c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:55.819349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:55.831449 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57919e-c757-4ee2-9b31-c5e84dd0d6fe None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:55.833144 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4656d84-1cf7-439a-9e49-463660d06cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:55.834167 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4656d84-1cf7-439a-9e49-463660d06cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:55.834663 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4656d84-1cf7-439a-9e49-463660d06cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:55.835155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4656d84-1cf7-439a-9e49-463660d06cd3 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:55.836090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4656d84-1cf7-439a-9e49-463660d06cd3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:55.836606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4656d84-1cf7-439a-9e49-463660d06cd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:55.838262 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4656d84-1cf7-439a-9e49-463660d06cd3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:55.852011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 432/896] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 19 10:52:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:55.853179 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4656d84-1cf7-439a-9e49-463660d06cd3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:55.874011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b022a5f-ea2a-414c-aa20-72f328715132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:55.875225 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b022a5f-ea2a-414c-aa20-72f328715132 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:55.875789 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b022a5f-ea2a-414c-aa20-72f328715132 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:55.876263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b022a5f-ea2a-414c-aa20-72f328715132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:55.889702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b022a5f-ea2a-414c-aa20-72f328715132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:55.891142 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b022a5f-ea2a-414c-aa20-72f328715132 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:55.909378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-6b022a5f-ea2a-414c-aa20-72f328715132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:55.909378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:55.909378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:55.909378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:55.909378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:55.909378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:55.909378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:55.909378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:55.909378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:55.909378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:55.909378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:55.909378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:55.909378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:55.909378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:55.909378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:55.910510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:55.910510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:55.910510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:55.910510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:55.910510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:55.910510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:55.910510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:55.910510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:55.910510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:55.910510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:55.910510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:55.910510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:55.910510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:55.910510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:55.910510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:55.910510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:55.910510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:55.911397 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:55.911397 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:55.911397 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:55.911397 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:55.911397 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 465/897] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:55.912123 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b3ca1-674e-4810-99a4-a7cd08e64c93 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:55.912123 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b3ca1-674e-4810-99a4-a7cd08e64c93 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:55.912372 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b3ca1-674e-4810-99a4-a7cd08e64c93 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:55.913839 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 466/898] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:55.918099 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b3ca1-674e-4810-99a4-a7cd08e64c93 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:55.979521 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4656d84-1cf7-439a-9e49-463660d06cd3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:56.025201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6093b43-3943-42ec-8617-2b264f57beb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:56.025890 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6093b43-3943-42ec-8617-2b264f57beb9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:56.026173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6093b43-3943-42ec-8617-2b264f57beb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:56.026545 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6093b43-3943-42ec-8617-2b264f57beb9 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:56.027160 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6093b43-3943-42ec-8617-2b264f57beb9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:56.027910 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6093b43-3943-42ec-8617-2b264f57beb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:56.030006 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6093b43-3943-42ec-8617-2b264f57beb9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:56.035997 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 433/899] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 19 10:52:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:56.037394 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a515d-8ef0-4fd6-a19d-57913fd23a85 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:56.043563 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a515d-8ef0-4fd6-a19d-57913fd23a85 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:56.043563 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a515d-8ef0-4fd6-a19d-57913fd23a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:56.043820 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b3ca1-674e-4810-99a4-a7cd08e64c93 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:56.058587 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:56.062671 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d21a515d-8ef0-4fd6-a19d-57913fd23a85 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:56.063882 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d21a515d-8ef0-4fd6-a19d-57913fd23a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:56.078744 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e96a8-b559-4a9b-8e58-3178d04ec320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:56.079410 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e96a8-b559-4a9b-8e58-3178d04ec320 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:56.079688 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e96a8-b559-4a9b-8e58-3178d04ec320 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:56.079956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e96a8-b559-4a9b-8e58-3178d04ec320 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:56.080671 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e96a8-b559-4a9b-8e58-3178d04ec320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:56.081006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e96a8-b559-4a9b-8e58-3178d04ec320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:56.082542 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e96a8-b559-4a9b-8e58-3178d04ec320 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:56.095033 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 467/900] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:56.096849 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc4a17-1a71-4274-9cb3-4e9efef890c6 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:56.097307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc4a17-1a71-4274-9cb3-4e9efef890c6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:56.097773 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc4a17-1a71-4274-9cb3-4e9efef890c6 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:56.099242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 468/901] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:56.100402 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc4a17-1a71-4274-9cb3-4e9efef890c6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:56.125264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:56.148306 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 434/902] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:52:56.149187 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a515d-8ef0-4fd6-a19d-57913fd23a85 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:56.218499 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc4a17-1a71-4274-9cb3-4e9efef890c6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:56.257244 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff51f6b-ee58-473a-a7f5-e67eb644d977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:56.257802 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff51f6b-ee58-473a-a7f5-e67eb644d977 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:56.258084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff51f6b-ee58-473a-a7f5-e67eb644d977 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:56.258353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff51f6b-ee58-473a-a7f5-e67eb644d977 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:56.259090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff51f6b-ee58-473a-a7f5-e67eb644d977 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:56.260476 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff51f6b-ee58-473a-a7f5-e67eb644d977 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:56.272673 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a515d-8ef0-4fd6-a19d-57913fd23a85 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:56.281011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 469/903] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 19 10:52:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:52:56.284960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb887850-992b-41b1-92e2-44f0ffbed306 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:56.284960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb887850-992b-41b1-92e2-44f0ffbed306 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:56.284960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb887850-992b-41b1-92e2-44f0ffbed306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:56.319457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-cb887850-992b-41b1-92e2-44f0ffbed306 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:56.321016 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cb887850-992b-41b1-92e2-44f0ffbed306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:56.330482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ac050-a691-4872-a259-d7e78d881fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:56.330482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ac050-a691-4872-a259-d7e78d881fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:56.330873 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ac050-a691-4872-a259-d7e78d881fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:56.331108 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ac050-a691-4872-a259-d7e78d881fb4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:56.341046 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ac050-a691-4872-a259-d7e78d881fb4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:56.345489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ac050-a691-4872-a259-d7e78d881fb4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:56.360941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-5c6ac050-a691-4872-a259-d7e78d881fb4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:52:56.360941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:56.360941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:56.360941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:56.360941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:56.360941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:56.360941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:56.360941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:56.360941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:56.360941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:56.360941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:56.360941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:56.360941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:52:56.360941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:52:56.360941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:52:56.360941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:52:56.362716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:56.362716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:56.362716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:52:56.362716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:56.362716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:52:56.362716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:52:56.362716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:56.362716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:56.362716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:56.362716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:56.362716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:56.362716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:56.362716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:56.362716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:56.362716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:56.362716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:56.362716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:56.362716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:56.364531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:56.364531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:56.364531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:52:56.364531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:52:56.364531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:52:56.364531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:52:56.364531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:52:56.364531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:52:56.364531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:52:56.364531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:56.364531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 435/904] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jul 19 10:52:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:56.364531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ac050-a691-4872-a259-d7e78d881fb4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:56.376827 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:56.414665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:56.436979 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 470/905] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:52:56.438282 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb887850-992b-41b1-92e2-44f0ffbed306 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:56.520028 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ac050-a691-4872-a259-d7e78d881fb4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:56.572452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb887850-992b-41b1-92e2-44f0ffbed306 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:56.592416 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a472c6c-d658-45cb-9dfd-5316cb4d1b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:56.593860 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a472c6c-d658-45cb-9dfd-5316cb4d1b2b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:56.594369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a472c6c-d658-45cb-9dfd-5316cb4d1b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:56.594856 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a472c6c-d658-45cb-9dfd-5316cb4d1b2b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:56.596070 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a472c6c-d658-45cb-9dfd-5316cb4d1b2b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:56.598801 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a472c6c-d658-45cb-9dfd-5316cb4d1b2b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:56.623361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-4a472c6c-d658-45cb-9dfd-5316cb4d1b2b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 10:52:56.623361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:56.623361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:52:56.623361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:52:56.623361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:52:56.623361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:52:56.623361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:52:56.623361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:56.623361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 10:52:56.623361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:56.623361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:52:56.623361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:56.623361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:56.623361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:56.623361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:56.623361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:56.624348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:56.624348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:56.624348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:56.624348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:56.624348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:56.624348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:56.624348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:56.624348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:52:56.624348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:52:56.624348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:52:56.624348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:52:56.624348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:56.624348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:56.624348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:56.624348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:56.624348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:56.625249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:56.625249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:56.625249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:56.625249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:56.625249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:56.625249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:56.625249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:56.625249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:56.625249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:56.625249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:56.625249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:56.625249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:52:56.625249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:52:56.625249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 10:52:56.625249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:56.626625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 436/906] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Jul 19 10:52:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:56.627524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a472c6c-d658-45cb-9dfd-5316cb4d1b2b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:56.640136 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c12a50-2ad0-4616-bdf2-5c7862fbaf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:56.640924 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c12a50-2ad0-4616-bdf2-5c7862fbaf00 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:56.641203 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c12a50-2ad0-4616-bdf2-5c7862fbaf00 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:56.641458 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c12a50-2ad0-4616-bdf2-5c7862fbaf00 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:56.642310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c12a50-2ad0-4616-bdf2-5c7862fbaf00 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:56.642611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c12a50-2ad0-4616-bdf2-5c7862fbaf00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:56.644828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c12a50-2ad0-4616-bdf2-5c7862fbaf00 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:56.676320 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 471/907] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jul 19 10:52:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:56.676320 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c12a50-2ad0-4616-bdf2-5c7862fbaf00 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:56.714645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:56.819227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a472c6c-d658-45cb-9dfd-5316cb4d1b2b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:56.822210 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:56.853156 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c12a50-2ad0-4616-bdf2-5c7862fbaf00 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:56.884112 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb1890-5749-4b54-ae2e-61cb2a27ba43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:56.885216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb1890-5749-4b54-ae2e-61cb2a27ba43 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:56.885666 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb1890-5749-4b54-ae2e-61cb2a27ba43 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:56.886094 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb1890-5749-4b54-ae2e-61cb2a27ba43 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:56.887315 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb1890-5749-4b54-ae2e-61cb2a27ba43 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:56.889648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb1890-5749-4b54-ae2e-61cb2a27ba43 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:56.920756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 437/908] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 19 10:52:56 2022] POST /identity/v3/services => generated 241 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:52:56.920756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb1890-5749-4b54-ae2e-61cb2a27ba43 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:56.937572 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422d520-630b-45ed-8b13-58d9e3d721a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:56.938546 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422d520-630b-45ed-8b13-58d9e3d721a4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:56.939034 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422d520-630b-45ed-8b13-58d9e3d721a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:56.939574 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422d520-630b-45ed-8b13-58d9e3d721a4 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:56.940927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422d520-630b-45ed-8b13-58d9e3d721a4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:56.941484 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422d520-630b-45ed-8b13-58d9e3d721a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:56.943688 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422d520-630b-45ed-8b13-58d9e3d721a4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:56.960991 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 472/909] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 19 10:52:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:56.968262 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422d520-630b-45ed-8b13-58d9e3d721a4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:57.143314 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb1890-5749-4b54-ae2e-61cb2a27ba43 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:57.146086 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:57.173691 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422d520-630b-45ed-8b13-58d9e3d721a4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:57.205907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dc8e6-5912-438d-8d73-acbd84ccdffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:57.207208 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dc8e6-5912-438d-8d73-acbd84ccdffe None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:57.207777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dc8e6-5912-438d-8d73-acbd84ccdffe None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:57.208344 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dc8e6-5912-438d-8d73-acbd84ccdffe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:57.218633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ded990-6e2e-4c3f-89dc-ad919a2695a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:57.219423 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ded990-6e2e-4c3f-89dc-ad919a2695a4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:57.219744 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ded990-6e2e-4c3f-89dc-ad919a2695a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:57.220086 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ded990-6e2e-4c3f-89dc-ad919a2695a4 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:57.220925 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ded990-6e2e-4c3f-89dc-ad919a2695a4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:57.221301 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ded990-6e2e-4c3f-89dc-ad919a2695a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:57.222886 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ded990-6e2e-4c3f-89dc-ad919a2695a4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:57.230782 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 473/910] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 19 10:52:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:57.239489 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ded990-6e2e-4c3f-89dc-ad919a2695a4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:57.278859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:57.334380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095dc8e6-5912-438d-8d73-acbd84ccdffe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:57.342281 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095dc8e6-5912-438d-8d73-acbd84ccdffe None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:57.432206 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ded990-6e2e-4c3f-89dc-ad919a2695a4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:57.452288 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 438/911] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:56 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:52:57.457596 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dc8e6-5912-438d-8d73-acbd84ccdffe None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:57.505090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b670ef-053f-4bb7-90b2-eb899c831e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:57.506682 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b670ef-053f-4bb7-90b2-eb899c831e9e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:57.507510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b670ef-053f-4bb7-90b2-eb899c831e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:57.508193 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b670ef-053f-4bb7-90b2-eb899c831e9e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:57.510135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b670ef-053f-4bb7-90b2-eb899c831e9e None admin] RBAC: Adding query filter params (interface=public, service_id=8449cc33e60b427dbb69706c43a3b254, region_id=RegionOne) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:57.511047 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b670ef-053f-4bb7-90b2-eb899c831e9e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:57.514304 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b670ef-053f-4bb7-90b2-eb899c831e9e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:57.526867 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:57.537068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 474/912] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jul 19 10:52:57 2022] GET /identity/v3/endpoints?service_id=8449cc33e60b427dbb69706c43a3b254&interface=public®ion_id=RegionOne => generated 194 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:57.540625 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b670ef-053f-4bb7-90b2-eb899c831e9e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:57.560631 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:57.578043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dc8e6-5912-438d-8d73-acbd84ccdffe None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:57.622744 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e59e7-a4b3-470c-8eaf-2467b3e6363c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:57.623847 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e59e7-a4b3-470c-8eaf-2467b3e6363c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:57.624277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e59e7-a4b3-470c-8eaf-2467b3e6363c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:57.624979 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e59e7-a4b3-470c-8eaf-2467b3e6363c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:57.638992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e59e7-a4b3-470c-8eaf-2467b3e6363c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:57.641117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e59e7-a4b3-470c-8eaf-2467b3e6363c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:57.664427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-117e59e7-a4b3-470c-8eaf-2467b3e6363c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:57.664427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:57.664427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:57.664427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:57.664427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:57.664427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:57.664427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:57.664427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:57.664427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:57.664427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:57.664427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:57.664427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:57.664427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:57.664427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:57.664427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:57.665658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:57.665658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:57.665658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:57.665658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:57.665658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:57.665658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:57.665658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:57.665658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:57.665658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:57.665658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:57.665658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:57.665658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:57.665658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:57.665658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:57.665658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:57.665658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:57.665658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:57.666693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:57.666693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:57.666693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:57.666693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:57.668995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 439/913] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:57.677718 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e59e7-a4b3-470c-8eaf-2467b3e6363c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:57.718260 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b670ef-053f-4bb7-90b2-eb899c831e9e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:57.757929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc5bc3-324b-47ee-97bc-8acded442ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:57.758913 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc5bc3-324b-47ee-97bc-8acded442ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:57.759405 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc5bc3-324b-47ee-97bc-8acded442ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:57.759849 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc5bc3-324b-47ee-97bc-8acded442ec9 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:57.760898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc5bc3-324b-47ee-97bc-8acded442ec9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:57.762480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc5bc3-324b-47ee-97bc-8acded442ec9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:57.769672 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 475/914] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 19 10:52:57 2022] GET /identity/v3/services => generated 1497 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 10:52:57.838119 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e59e7-a4b3-470c-8eaf-2467b3e6363c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:57.855166 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:57.880145 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95379ff9-5ee8-4ade-bb16-c053c407ea25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:57.881219 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95379ff9-5ee8-4ade-bb16-c053c407ea25 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:57.881677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95379ff9-5ee8-4ade-bb16-c053c407ea25 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:57.882127 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95379ff9-5ee8-4ade-bb16-c053c407ea25 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:57.883053 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95379ff9-5ee8-4ade-bb16-c053c407ea25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:57.883567 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95379ff9-5ee8-4ade-bb16-c053c407ea25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:57.885216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95379ff9-5ee8-4ade-bb16-c053c407ea25 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:57.916899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 440/915] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:57.922102 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc5bc3-324b-47ee-97bc-8acded442ec9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:58.047532 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:58.081415 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc5bc3-324b-47ee-97bc-8acded442ec9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:58.117784 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10375296-4d50-4665-b80e-286f475418ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:58.118592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10375296-4d50-4665-b80e-286f475418ae None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:58.118866 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10375296-4d50-4665-b80e-286f475418ae None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:58.119133 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10375296-4d50-4665-b80e-286f475418ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:58.126490 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10375296-4d50-4665-b80e-286f475418ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:58.127926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10375296-4d50-4665-b80e-286f475418ae None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:58.142997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-10375296-4d50-4665-b80e-286f475418ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:58.142997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:58.142997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:58.142997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:58.142997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:58.142997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:58.142997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:58.142997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:58.142997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:58.142997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:58.142997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:58.142997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:58.142997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:58.142997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:58.142997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:58.144055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:58.144055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:58.144055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:58.144055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:58.144055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:58.144055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:58.144055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:58.144055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:58.144055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:58.144055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:58.144055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:58.144055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:58.144055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:58.144055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:58.144055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:58.144055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:58.144055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:58.145438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:58.145438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:58.145438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:58.145438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:58.145438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:58.145438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:58.145438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:58.145438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:58.145438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 476/916] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:58.151365 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95379ff9-5ee8-4ade-bb16-c053c407ea25 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:58.259214 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95379ff9-5ee8-4ade-bb16-c053c407ea25 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:58.295633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc6989-087a-4306-9245-860435e1aa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:58.296645 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc6989-087a-4306-9245-860435e1aa90 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:58.297132 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc6989-087a-4306-9245-860435e1aa90 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:58.297648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc6989-087a-4306-9245-860435e1aa90 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:58.298617 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc6989-087a-4306-9245-860435e1aa90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:58.299094 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc6989-087a-4306-9245-860435e1aa90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:58.300900 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc6989-087a-4306-9245-860435e1aa90 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:58.314199 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 441/917] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:52:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:58.320744 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10375296-4d50-4665-b80e-286f475418ae None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:58.436032 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10375296-4d50-4665-b80e-286f475418ae None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:58.468335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:58.473437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d2c87-8bb4-4d96-bbd2-5e9d419c43fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:58.474294 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d2c87-8bb4-4d96-bbd2-5e9d419c43fa None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:58.474633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d2c87-8bb4-4d96-bbd2-5e9d419c43fa None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:58.475340 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d2c87-8bb4-4d96-bbd2-5e9d419c43fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:58.476360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d2c87-8bb4-4d96-bbd2-5e9d419c43fa None admin] RBAC: Adding query filter params (role.id=2b15d93fb65247dd8f0cc3f8a905fb38, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=654631b067b94b269f93ea7b3977609d) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:58.476673 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d2c87-8bb4-4d96-bbd2-5e9d419c43fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:58.478158 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d2c87-8bb4-4d96-bbd2-5e9d419c43fa None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:58.484612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 477/918] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:58 2022] GET /identity/v3/role_assignments?user.id=654631b067b94b269f93ea7b3977609d&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=2b15d93fb65247dd8f0cc3f8a905fb38 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:59.183919 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fc8b0-1a58-4ed2-b872-c6714633c79c None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:59.184631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fc8b0-1a58-4ed2-b872-c6714633c79c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:59.185249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fc8b0-1a58-4ed2-b872-c6714633c79c None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:59.188231 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 442/919] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:52:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:59.197147 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7027bdc-e4cb-4a74-9f99-736507a05f22 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:59.197587 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7027bdc-e4cb-4a74-9f99-736507a05f22 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:59.198045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7027bdc-e4cb-4a74-9f99-736507a05f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:59.228824 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e7027bdc-e4cb-4a74-9f99-736507a05f22 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:59.230784 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e7027bdc-e4cb-4a74-9f99-736507a05f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:59.346528 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 478/920] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:52:59.384930 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fc8b0-1a58-4ed2-b872-c6714633c79c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:59.456945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:59.531524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fc8b0-1a58-4ed2-b872-c6714633c79c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:59.568171 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab531b82-8202-4ea5-9750-0ec3270e1279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:59.569245 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab531b82-8202-4ea5-9750-0ec3270e1279 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:59.569723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab531b82-8202-4ea5-9750-0ec3270e1279 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:59.570214 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab531b82-8202-4ea5-9750-0ec3270e1279 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:59.571115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab531b82-8202-4ea5-9750-0ec3270e1279 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:59.572819 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab531b82-8202-4ea5-9750-0ec3270e1279 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:59.574585 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: WARNING keystone.server.flask.common [None req-ab531b82-8202-4ea5-9750-0ec3270e1279 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 19 10:52:59.595799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.sql.core [None req-ab531b82-8202-4ea5-9750-0ec3270e1279 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 19 10:52:59.595799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 19 10:52:59.595799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [parameters: {'id': 'ff7b41b4829d41b6be25a904c89dfc20', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 19 10:52:59.595799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80498) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 10:52:59.614799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-ab531b82-8202-4ea5-9750-0ec3270e1279 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ff7b41b4829d41b6be25a904c89dfc20.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ff7b41b4829d41b6be25a904c89dfc20. Jul 19 10:52:59.614799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:59.614799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 10:52:59.614799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 10:52:59.614799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 10:52:59.614799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 10:52:59.614799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 10:52:59.614799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 10:52:59.614799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 10:52:59.614799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application conn.query(q) Jul 19 10:52:59.614799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 10:52:59.614799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 10:52:59.614799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 10:52:59.615703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application result.read() Jul 19 10:52:59.615703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 10:52:59.615703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 10:52:59.615703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 10:52:59.615703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 10:52:59.615703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 10:52:59.615703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 10:52:59.615703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 10:52:59.615703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 10:52:59.615703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 19 10:52:59.615703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:59.615703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 10:52:59.615703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:59.615703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:59.615703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 10:52:59.615703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 10:52:59.615703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 19 10:52:59.615703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 19 10:52:59.616659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 10:52:59.616659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application next(self.gen) Jul 19 10:52:59.616659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 10:52:59.616659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application yield resource Jul 19 10:52:59.616659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 10:52:59.616659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application next(self.gen) Jul 19 10:52:59.616659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 10:52:59.616659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 10:52:59.616659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 10:52:59.616659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 10:52:59.616659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 10:52:59.616659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise self.value Jul 19 10:52:59.616659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 10:52:59.616659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 10:52:59.616659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 10:52:59.616659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application session.commit() Jul 19 10:52:59.616659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 10:52:59.617565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 10:52:59.617565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 10:52:59.617565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 10:52:59.617565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 10:52:59.617565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self.session.flush() Jul 19 10:52:59.617565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 10:52:59.617565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 10:52:59.617565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 10:52:59.617565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 10:52:59.617565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 10:52:59.617565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application compat.raise_( Jul 19 10:52:59.617565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 10:52:59.617565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception Jul 19 10:52:59.617565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 10:52:59.617565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 10:52:59.617565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 10:52:59.617565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 10:52:59.619256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 10:52:59.619256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 10:52:59.619256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 10:52:59.619256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 10:52:59.619256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 19 10:52:59.619256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 19 10:52:59.619256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 10:52:59.619256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 10:52:59.619256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 10:52:59.619256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 10:52:59.619256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 10:52:59.619256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 10:52:59.619256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 10:52:59.619256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 10:52:59.619256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 10:52:59.621230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 10:52:59.621230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 10:52:59.621230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception Jul 19 10:52:59.621230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 10:52:59.621230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 10:52:59.621230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 10:52:59.621230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 10:52:59.621230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 10:52:59.621230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 10:52:59.621230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 10:52:59.621230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application conn.query(q) Jul 19 10:52:59.621230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 10:52:59.621230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 10:52:59.621230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 10:52:59.621230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application result.read() Jul 19 10:52:59.621230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 10:52:59.621230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 10:52:59.623389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 10:52:59.623389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 10:52:59.623389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 10:52:59.623389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 10:52:59.623389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 10:52:59.623389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 10:52:59.623389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 19 10:52:59.623389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 19 10:52:59.623389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [parameters: {'id': 'ff7b41b4829d41b6be25a904c89dfc20', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 19 10:52:59.623389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 10:52:59.623389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:59.623389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:52:59.623389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:59.623389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:59.623389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 19 10:52:59.625285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 19 10:52:59.625285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 10:52:59.625285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 10:52:59.625285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 19 10:52:59.625285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:59.625285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:52:59.625285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:59.625285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:59.625285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:59.625285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:59.625285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:59.625285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:59.625285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:59.625285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:59.625285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:59.625285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:59.625285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:59.627440 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:59.627440 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 19 10:52:59.627440 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 19 10:52:59.627440 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:59.627440 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:59.627440 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 19 10:52:59.627440 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 19 10:52:59.627440 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ff7b41b4829d41b6be25a904c89dfc20. Jul 19 10:52:59.627440 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:52:59.630732 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 443/921] 10.222.0.18 () {60 vars in 1140 bytes} [Tue Jul 19 10:52:59 2022] POST /identity/v3/projects => generated 262 bytes in 247 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:59.638544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7027bdc-e4cb-4a74-9f99-736507a05f22 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:59.809273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7027bdc-e4cb-4a74-9f99-736507a05f22 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:59.853128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:59.862584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329fbb1d-5245-423c-a4f9-a34d3a2a8e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:59.863554 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fbb1d-5245-423c-a4f9-a34d3a2a8e8e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:59.863838 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fbb1d-5245-423c-a4f9-a34d3a2a8e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:59.864113 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fbb1d-5245-423c-a4f9-a34d3a2a8e8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:59.875567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329fbb1d-5245-423c-a4f9-a34d3a2a8e8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:59.878313 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329fbb1d-5245-423c-a4f9-a34d3a2a8e8e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:59.903529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-329fbb1d-5245-423c-a4f9-a34d3a2a8e8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:59.903529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:59.903529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:59.903529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:59.903529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:59.903529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:59.903529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:59.903529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:59.903529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:59.903529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:59.903529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:59.903529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:59.903529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:52:59.903529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:52:59.903529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:52:59.904467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:52:59.904467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:59.904467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:59.904467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:59.904467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:59.904467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:59.904467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:59.904467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:59.904467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:59.904467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:59.904467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:59.904467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:59.904467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:59.904467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:59.904467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:59.904467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:59.904467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:59.905363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:52:59.905363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:52:59.905363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:52:59.905363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:52:59.905363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:52:59.905363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:52:59.905363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:52:59.905363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:52:59.908740 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 479/922] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:59.912053 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab531b82-8202-4ea5-9750-0ec3270e1279 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:00.021820 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:00.035589 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab531b82-8202-4ea5-9750-0ec3270e1279 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:00.054412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f947d6-304e-4dc1-904c-24bdcdd7eab6 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:00.054731 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f947d6-304e-4dc1-904c-24bdcdd7eab6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:00.054961 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f947d6-304e-4dc1-904c-24bdcdd7eab6 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:00.056684 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 480/923] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:00.063267 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b3ed5-5fd1-42ea-9e8a-5cf43cd26d35 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:00.063569 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b3ed5-5fd1-42ea-9e8a-5cf43cd26d35 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:00.063841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b3ed5-5fd1-42ea-9e8a-5cf43cd26d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:00.075274 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e4350-d704-4954-b78f-f821d71e8ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:00.075973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e4350-d704-4954-b78f-f821d71e8ebf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:00.076257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e4350-d704-4954-b78f-f821d71e8ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:00.076533 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e4350-d704-4954-b78f-f821d71e8ebf None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:00.077373 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e4350-d704-4954-b78f-f821d71e8ebf None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:00.077688 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e4350-d704-4954-b78f-f821d71e8ebf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:00.079385 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e4350-d704-4954-b78f-f821d71e8ebf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:00.093313 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-665b3ed5-5fd1-42ea-9e8a-5cf43cd26d35 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:00.095537 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-665b3ed5-5fd1-42ea-9e8a-5cf43cd26d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:00.104242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 444/924] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 19 10:52:59 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:00.116852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578babfc-aa48-4f59-bae1-8e794ae72cad None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:00.117315 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578babfc-aa48-4f59-bae1-8e794ae72cad None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:00.117500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578babfc-aa48-4f59-bae1-8e794ae72cad None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:00.119387 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 445/925] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:53:00.125556 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cb582-d276-45ba-b256-f8f6d11ffd0b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:00.125827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cb582-d276-45ba-b256-f8f6d11ffd0b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:00.126121 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cb582-d276-45ba-b256-f8f6d11ffd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:00.146807 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9d1cb582-d276-45ba-b256-f8f6d11ffd0b None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:00.148697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9d1cb582-d276-45ba-b256-f8f6d11ffd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:00.230486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 481/926] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:00.241083 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 446/927] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:00.253757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b3ed5-5fd1-42ea-9e8a-5cf43cd26d35 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:00.258409 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1cb582-d276-45ba-b256-f8f6d11ffd0b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:00.376206 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:00.403597 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1cb582-d276-45ba-b256-f8f6d11ffd0b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:00.420392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b3ed5-5fd1-42ea-9e8a-5cf43cd26d35 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:00.457974 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bb5ec-3c35-4ea6-8df6-8dd80c39f51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:00.458871 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bb5ec-3c35-4ea6-8df6-8dd80c39f51e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:00.459117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bb5ec-3c35-4ea6-8df6-8dd80c39f51e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:00.459375 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bb5ec-3c35-4ea6-8df6-8dd80c39f51e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:00.460037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97bb5ec-3c35-4ea6-8df6-8dd80c39f51e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:00.462058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97bb5ec-3c35-4ea6-8df6-8dd80c39f51e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:00.469253 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:00.477740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e97bb5ec-3c35-4ea6-8df6-8dd80c39f51e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 10:53:00.477740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:00.477740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:00.477740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:00.477740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:00.477740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:00.477740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:00.477740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:00.477740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 10:53:00.477740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:00.477740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:00.477740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:00.477740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:00.477740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:00.477740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:00.477740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:00.479943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:00.479943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:00.479943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:00.479943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:00.479943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:00.479943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:00.479943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:00.479943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:00.479943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:00.479943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:00.479943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:00.479943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:00.479943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:00.479943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:00.479943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:00.479943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:00.483113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:00.483113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:00.483113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:00.483113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:00.483113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:00.483113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:00.483113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:00.483113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:00.483113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:00.483113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:00.483113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:00.483113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:00.483113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:00.483113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 10:53:00.483113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:00.483113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 447/928] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Jul 19 10:53:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:00.488345 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bb5ec-3c35-4ea6-8df6-8dd80c39f51e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:00.505137 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e13aae-1c94-402f-8bbc-446c993eba63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:00.506541 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e13aae-1c94-402f-8bbc-446c993eba63 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:00.506993 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e13aae-1c94-402f-8bbc-446c993eba63 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:00.507375 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e13aae-1c94-402f-8bbc-446c993eba63 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:00.508309 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e13aae-1c94-402f-8bbc-446c993eba63 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:00.510911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e13aae-1c94-402f-8bbc-446c993eba63 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:00.534739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-19e13aae-1c94-402f-8bbc-446c993eba63 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:53:00.534739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:00.534739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:00.534739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:00.534739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:00.534739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:00.534739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:00.534739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:00.534739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:53:00.534739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:00.534739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:00.534739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:00.534739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:00.534739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:00.534739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:00.534739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:00.534739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:00.538124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:00.538124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:00.538124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:00.538124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:00.538124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:00.538124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:00.538124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:00.538124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:00.538124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:00.538124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:00.538124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:00.538124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:00.538124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:00.538124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:00.538124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:00.538124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:00.540128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:00.540128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:00.540128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:00.540128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:00.540128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:00.540128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:00.540128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:00.540128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:00.540128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:00.540128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:00.540128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:00.540128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:00.540128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:53:00.540128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:00.540128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 482/929] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 19 10:53:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:00.550632 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e13aae-1c94-402f-8bbc-446c993eba63 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:00.661602 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bb5ec-3c35-4ea6-8df6-8dd80c39f51e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:00.705408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e13aae-1c94-402f-8bbc-446c993eba63 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:00.728024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f2dae-d2b5-4307-a543-a96227b354f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:00.729761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f2dae-d2b5-4307-a543-a96227b354f0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:00.730553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f2dae-d2b5-4307-a543-a96227b354f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:00.731333 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f2dae-d2b5-4307-a543-a96227b354f0 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:00.733077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f2dae-d2b5-4307-a543-a96227b354f0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:00.734037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f2dae-d2b5-4307-a543-a96227b354f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:00.736996 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f2dae-d2b5-4307-a543-a96227b354f0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:00.749694 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 448/930] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 19 10:53:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:00.758220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f2dae-d2b5-4307-a543-a96227b354f0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:00.763859 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86a7c3-7c19-488a-abea-8e229fb39ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:00.765072 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86a7c3-7c19-488a-abea-8e229fb39ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:00.766528 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86a7c3-7c19-488a-abea-8e229fb39ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:00.767576 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86a7c3-7c19-488a-abea-8e229fb39ba9 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:00.769704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86a7c3-7c19-488a-abea-8e229fb39ba9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:00.770741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86a7c3-7c19-488a-abea-8e229fb39ba9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:00.772901 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86a7c3-7c19-488a-abea-8e229fb39ba9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:00.773450 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:00.793074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 483/931] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jul 19 10:53:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:00.794702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86a7c3-7c19-488a-abea-8e229fb39ba9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:00.890550 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:00.901118 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f2dae-d2b5-4307-a543-a96227b354f0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:00.962177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3bb83-9572-4432-9ded-9155210e03f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:00.963197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3bb83-9572-4432-9ded-9155210e03f9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:00.963621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3bb83-9572-4432-9ded-9155210e03f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:00.964033 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3bb83-9572-4432-9ded-9155210e03f9 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:00.965233 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3bb83-9572-4432-9ded-9155210e03f9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:00.965748 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3bb83-9572-4432-9ded-9155210e03f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:00.967466 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3bb83-9572-4432-9ded-9155210e03f9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:00.974708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 449/932] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 19 10:53:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:00.976637 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04efb0-5a23-404c-b5e4-6e2a462ed47c None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:00.977094 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04efb0-5a23-404c-b5e4-6e2a462ed47c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:00.977501 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04efb0-5a23-404c-b5e4-6e2a462ed47c None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:00.979199 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 450/933] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:00.984087 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04efb0-5a23-404c-b5e4-6e2a462ed47c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:00.991943 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86a7c3-7c19-488a-abea-8e229fb39ba9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:01.051270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b55aee-13db-48da-86a3-af2bc5b28c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:01.052393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b55aee-13db-48da-86a3-af2bc5b28c12 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:01.052943 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b55aee-13db-48da-86a3-af2bc5b28c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:01.053428 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b55aee-13db-48da-86a3-af2bc5b28c12 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:01.054649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b55aee-13db-48da-86a3-af2bc5b28c12 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:01.055149 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b55aee-13db-48da-86a3-af2bc5b28c12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:01.057368 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b55aee-13db-48da-86a3-af2bc5b28c12 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:01.072951 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 484/934] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jul 19 10:53:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:01.075653 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6bc4e-0560-4113-abe7-49785947cb22 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:01.076107 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6bc4e-0560-4113-abe7-49785947cb22 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:01.076390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6bc4e-0560-4113-abe7-49785947cb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:01.099301 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3ce6bc4e-0560-4113-abe7-49785947cb22 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:01.101031 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3ce6bc4e-0560-4113-abe7-49785947cb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:01.118783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:01.180333 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04efb0-5a23-404c-b5e4-6e2a462ed47c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:01.220861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 485/935] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:01.220861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6bc4e-0560-4113-abe7-49785947cb22 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:01.258177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd779c4a-d50f-434d-856c-830fc6273b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:01.260000 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd779c4a-d50f-434d-856c-830fc6273b8c None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:01.260390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd779c4a-d50f-434d-856c-830fc6273b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:01.260951 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd779c4a-d50f-434d-856c-830fc6273b8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:01.262344 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd779c4a-d50f-434d-856c-830fc6273b8c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:01.264821 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd779c4a-d50f-434d-856c-830fc6273b8c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:01.279462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:01.299138 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 451/936] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 19 10:53:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 10:53:01.300432 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd779c4a-d50f-434d-856c-830fc6273b8c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:01.418593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6bc4e-0560-4113-abe7-49785947cb22 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:01.506813 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a516383-0503-4a85-9436-4c227ddbf995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:01.508015 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a516383-0503-4a85-9436-4c227ddbf995 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:01.508597 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a516383-0503-4a85-9436-4c227ddbf995 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:01.509237 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a516383-0503-4a85-9436-4c227ddbf995 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:01.510753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a516383-0503-4a85-9436-4c227ddbf995 None admin] RBAC: Adding query filter params (interface=public, service_id=011dca0b839a483f8a3bf7e9d34c1608, region_id=RegionOne) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:01.511404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a516383-0503-4a85-9436-4c227ddbf995 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:01.514022 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a516383-0503-4a85-9436-4c227ddbf995 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:01.522773 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 486/937] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jul 19 10:53:01 2022] GET /identity/v3/endpoints?service_id=011dca0b839a483f8a3bf7e9d34c1608&interface=public®ion_id=RegionOne => generated 194 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:01.531389 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a516383-0503-4a85-9436-4c227ddbf995 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:01.532688 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd779c4a-d50f-434d-856c-830fc6273b8c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:01.589372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:01.610570 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59705567-ffb4-49fd-9cfe-a930f6370ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:01.611556 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59705567-ffb4-49fd-9cfe-a930f6370ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:01.612043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59705567-ffb4-49fd-9cfe-a930f6370ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:01.612511 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59705567-ffb4-49fd-9cfe-a930f6370ce9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:01.646021 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59705567-ffb4-49fd-9cfe-a930f6370ce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:01.661866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-59705567-ffb4-49fd-9cfe-a930f6370ce9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:53:01.661866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:01.661866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:01.661866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:01.661866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:01.661866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:01.661866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:01.661866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:01.661866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:01.661866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:01.661866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:01.661866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:01.661866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:01.661866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:01.661866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:01.661866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:01.663549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:01.663549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:01.663549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:01.663549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:01.663549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:01.663549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:01.663549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:01.663549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:01.663549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:01.663549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:01.663549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:01.663549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:01.663549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:01.663549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:01.663549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:01.663549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:01.665114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:01.665114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:01.665114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:01.665114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:01.665114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:01.665114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:01.665114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:01.665114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:01.665114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:01.665114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:01.665114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:53:01.665114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:01.668895 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 452/938] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jul 19 10:53:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:01.674071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59705567-ffb4-49fd-9cfe-a930f6370ce9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:01.718548 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:01.727195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a516383-0503-4a85-9436-4c227ddbf995 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:01.797961 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4166da-afa6-44ff-af76-a16aed45474a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:01.799587 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4166da-afa6-44ff-af76-a16aed45474a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:01.802430 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4166da-afa6-44ff-af76-a16aed45474a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:01.803243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4166da-afa6-44ff-af76-a16aed45474a None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:01.804928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4166da-afa6-44ff-af76-a16aed45474a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:01.807806 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4166da-afa6-44ff-af76-a16aed45474a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:01.821356 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 487/939] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 19 10:53:01 2022] GET /identity/v3/services => generated 1497 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 10:53:01.887462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59705567-ffb4-49fd-9cfe-a930f6370ce9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:01.951437 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcdd36-b2f4-44b4-9fcb-509ceb9bd188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:01.952475 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcdd36-b2f4-44b4-9fcb-509ceb9bd188 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:01.952951 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcdd36-b2f4-44b4-9fcb-509ceb9bd188 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:01.953372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcdd36-b2f4-44b4-9fcb-509ceb9bd188 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:01.954667 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcdd36-b2f4-44b4-9fcb-509ceb9bd188 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:01.955157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcdd36-b2f4-44b4-9fcb-509ceb9bd188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:01.957741 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcdd36-b2f4-44b4-9fcb-509ceb9bd188 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:01.973682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 453/940] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jul 19 10:53:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:01.981525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4166da-afa6-44ff-af76-a16aed45474a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:02.174127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4166da-afa6-44ff-af76-a16aed45474a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:02.235270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e86104-f904-4c8b-9b8b-17123aec563b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:02.237027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e86104-f904-4c8b-9b8b-17123aec563b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:02.237860 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e86104-f904-4c8b-9b8b-17123aec563b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:02.238586 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e86104-f904-4c8b-9b8b-17123aec563b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:02.257027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e86104-f904-4c8b-9b8b-17123aec563b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:02.260008 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e86104-f904-4c8b-9b8b-17123aec563b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:02.292932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-56e86104-f904-4c8b-9b8b-17123aec563b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:02.292932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:02.292932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:02.292932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:02.292932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:02.292932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:02.292932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:02.292932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:02.292932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:02.292932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:02.292932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:02.292932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:02.292932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:02.292932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:02.292932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:02.294602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:02.294602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:02.294602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:02.294602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:02.294602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:02.294602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:02.294602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:02.294602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:02.294602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:02.294602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:02.294602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:02.294602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:02.294602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:02.294602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:02.294602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:02.294602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:02.294602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:02.296323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:02.296323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:02.296323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:02.296323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:02.300167 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 488/941] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:02.309047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcdd36-b2f4-44b4-9fcb-509ceb9bd188 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:02.399902 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:02.502495 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcdd36-b2f4-44b4-9fcb-509ceb9bd188 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:02.567815 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c005e1-2ddb-4467-9e40-ec5162b79256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:02.568979 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c005e1-2ddb-4467-9e40-ec5162b79256 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:02.569472 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c005e1-2ddb-4467-9e40-ec5162b79256 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:02.569882 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c005e1-2ddb-4467-9e40-ec5162b79256 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:02.571310 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c005e1-2ddb-4467-9e40-ec5162b79256 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:02.571815 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c005e1-2ddb-4467-9e40-ec5162b79256 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:02.574306 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c005e1-2ddb-4467-9e40-ec5162b79256 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:02.588326 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde7d27-0e85-49ac-b5ba-f7e325c37407 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:02.589011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde7d27-0e85-49ac-b5ba-f7e325c37407 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:02.589269 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde7d27-0e85-49ac-b5ba-f7e325c37407 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:02.591843 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 489/942] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:02.597553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b2ff3-8d37-46ee-a640-849ba698593a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:02.598125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b2ff3-8d37-46ee-a640-849ba698593a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:02.598591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b2ff3-8d37-46ee-a640-849ba698593a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:02.605524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 454/943] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:02.614481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c005e1-2ddb-4467-9e40-ec5162b79256 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:02.618898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-475b2ff3-8d37-46ee-a640-849ba698593a None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:02.620363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-475b2ff3-8d37-46ee-a640-849ba698593a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:02.631588 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:02.732868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 490/944] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:02.746880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b2ff3-8d37-46ee-a640-849ba698593a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:02.773369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c005e1-2ddb-4467-9e40-ec5162b79256 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:02.799955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:02.845501 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf3bce-f6f4-4b61-b5a7-e858053b8fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:02.847250 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf3bce-f6f4-4b61-b5a7-e858053b8fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:02.847805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf3bce-f6f4-4b61-b5a7-e858053b8fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:02.848384 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf3bce-f6f4-4b61-b5a7-e858053b8fb5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:02.862501 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b2ff3-8d37-46ee-a640-849ba698593a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:02.863584 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf3bce-f6f4-4b61-b5a7-e858053b8fb5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:02.866688 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf3bce-f6f4-4b61-b5a7-e858053b8fb5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:02.898177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-9faf3bce-f6f4-4b61-b5a7-e858053b8fb5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:53:02.898177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:02.898177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:02.898177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:02.898177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:02.898177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:02.898177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:02.898177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:02.898177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:02.898177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:02.898177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:02.898177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:02.898177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:02.898177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:02.898177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:02.898177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:02.900254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:02.900254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:02.900254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:02.900254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:02.900254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:02.900254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:02.900254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:02.900254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:02.900254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:02.900254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:02.900254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:02.900254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:02.900254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:02.900254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:02.900254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:02.900254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:02.900254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:02.900254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:02.902450 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:02.902450 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:02.902450 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:02.902450 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:02.902450 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:02.902450 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:02.902450 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:02.902450 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:02.902450 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:53:02.902450 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:02.903900 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f7fc9-4600-47d4-85b9-77496e5352fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:02.903900 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f7fc9-4600-47d4-85b9-77496e5352fc None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:02.903900 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f7fc9-4600-47d4-85b9-77496e5352fc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:02.903900 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f7fc9-4600-47d4-85b9-77496e5352fc None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:02.904502 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 455/945] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jul 19 10:53:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:02.904643 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f7fc9-4600-47d4-85b9-77496e5352fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:02.905730 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f7fc9-4600-47d4-85b9-77496e5352fc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:02.907053 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: WARNING keystone.server.flask.common [None req-033f7fc9-4600-47d4-85b9-77496e5352fc None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 19 10:53:02.916922 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf3bce-f6f4-4b61-b5a7-e858053b8fb5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:02.921082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.sql.core [None req-033f7fc9-4600-47d4-85b9-77496e5352fc None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 19 10:53:02.921082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 19 10:53:02.921082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [parameters: {'user_id': '68d16acfe72f4fc9a741615ed14f5da7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 19 10:53:02.921082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80497) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 10:53:02.939281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-033f7fc9-4600-47d4-85b9-77496e5352fc None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 19 10:53:02.939281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:02.939281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 10:53:02.939281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 10:53:02.939281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 10:53:02.939281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 10:53:02.939281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 10:53:02.939281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 10:53:02.939281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 10:53:02.939281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application conn.query(q) Jul 19 10:53:02.939281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 10:53:02.939281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 10:53:02.939281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 10:53:02.939281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application result.read() Jul 19 10:53:02.939281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 10:53:02.940996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 10:53:02.940996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 10:53:02.940996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 10:53:02.940996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 10:53:02.940996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 10:53:02.940996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 10:53:02.940996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 10:53:02.940996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 19 10:53:02.940996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:02.940996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 10:53:02.940996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:02.940996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:02.940996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 10:53:02.940996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 10:53:02.940996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 19 10:53:02.940996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 19 10:53:02.940996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 10:53:02.940996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application next(self.gen) Jul 19 10:53:02.943456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 10:53:02.943456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application yield resource Jul 19 10:53:02.943456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 10:53:02.943456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application next(self.gen) Jul 19 10:53:02.943456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 10:53:02.943456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 10:53:02.943456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 10:53:02.943456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 10:53:02.943456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 10:53:02.943456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise self.value Jul 19 10:53:02.943456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 10:53:02.943456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 10:53:02.943456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 10:53:02.943456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application session.commit() Jul 19 10:53:02.943456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 10:53:02.943456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 10:53:02.943456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 10:53:02.945238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 10:53:02.945238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 10:53:02.945238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.session.flush() Jul 19 10:53:02.945238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 10:53:02.945238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 10:53:02.945238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 10:53:02.945238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 10:53:02.945238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 10:53:02.945238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application compat.raise_( Jul 19 10:53:02.945238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 10:53:02.945238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception Jul 19 10:53:02.945238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 10:53:02.945238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 10:53:02.945238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 10:53:02.945238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 10:53:02.945238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 10:53:02.945238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 10:53:02.947749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 10:53:02.947749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 10:53:02.947749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 19 10:53:02.947749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 19 10:53:02.947749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 10:53:02.947749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 10:53:02.947749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 10:53:02.947749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 10:53:02.947749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 10:53:02.947749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 10:53:02.947749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 10:53:02.947749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 10:53:02.947749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 10:53:02.947749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 10:53:02.947749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 10:53:02.947749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception Jul 19 10:53:02.950462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 10:53:02.950462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 10:53:02.950462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 10:53:02.950462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 10:53:02.950462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 10:53:02.950462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 10:53:02.950462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 10:53:02.950462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application conn.query(q) Jul 19 10:53:02.950462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 10:53:02.950462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 10:53:02.950462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 10:53:02.950462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application result.read() Jul 19 10:53:02.950462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 10:53:02.950462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 10:53:02.950462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 10:53:02.950462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 10:53:02.954188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 10:53:02.954188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 10:53:02.954188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 10:53:02.954188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 10:53:02.954188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 19 10:53:02.954188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 19 10:53:02.954188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [parameters: {'user_id': '68d16acfe72f4fc9a741615ed14f5da7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 19 10:53:02.954188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 10:53:02.954188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:02.954188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:02.954188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:02.954188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:02.954188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:02.954188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:02.954188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:02.958050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:02.958050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:02.958050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:02.958050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:02.958050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:02.958050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:02.958050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:02.958050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 19 10:53:02.958050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 19 10:53:02.958050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:02.958050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:02.958050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:02.958050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:02.958050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:02.958050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:02.958050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 19 10:53:02.958050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 19 10:53:02.960039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 19 10:53:02.960039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 19 10:53:02.960039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 10:53:02.960039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 10:53:02.960039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 19 10:53:02.960039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:02.960039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 491/946] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jul 19 10:53:02 2022] POST /identity/v3/users => generated 160 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:02.960039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f7fc9-4600-47d4-85b9-77496e5352fc None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:02.975300 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:03.152121 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf3bce-f6f4-4b61-b5a7-e858053b8fb5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:03.187458 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f7fc9-4600-47d4-85b9-77496e5352fc None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:03.219721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e40693-1100-4124-a7e2-2e1a957f8d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:03.220954 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e40693-1100-4124-a7e2-2e1a957f8d5a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:03.221483 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e40693-1100-4124-a7e2-2e1a957f8d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:03.222055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e40693-1100-4124-a7e2-2e1a957f8d5a None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:03.223973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e40693-1100-4124-a7e2-2e1a957f8d5a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:03.224246 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e40693-1100-4124-a7e2-2e1a957f8d5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:03.227240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e40693-1100-4124-a7e2-2e1a957f8d5a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:03.266582 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258be128-7bf0-4c24-8131-9c433a013f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:03.268238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258be128-7bf0-4c24-8131-9c433a013f5d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:03.268815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258be128-7bf0-4c24-8131-9c433a013f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:03.269342 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258be128-7bf0-4c24-8131-9c433a013f5d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:03.277174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 456/947] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jul 19 10:53:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:03.279749 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e40693-1100-4124-a7e2-2e1a957f8d5a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:03.290800 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258be128-7bf0-4c24-8131-9c433a013f5d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:03.294536 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258be128-7bf0-4c24-8131-9c433a013f5d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:03.323700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-258be128-7bf0-4c24-8131-9c433a013f5d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 10:53:03.323700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:03.323700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:03.323700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:03.323700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:03.323700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:03.323700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:03.323700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:03.323700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:03.323700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:03.323700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:03.323700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:03.323700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:03.323700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:03.323700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:03.323700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:03.325607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:03.325607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:03.325607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:03.325607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:03.325607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:03.325607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:03.325607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:03.325607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:03.325607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:03.325607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:03.325607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:03.325607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:03.325607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:03.325607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:03.325607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:03.325607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:03.325607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:03.325607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:03.327307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:03.327307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:03.327307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:03.327307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:03.327307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:03.327307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:03.327307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:03.327307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:03.327307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 10:53:03.327307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:03.331867 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 492/948] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:53:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:03.332820 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:03.338288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258be128-7bf0-4c24-8131-9c433a013f5d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:03.464754 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:03.495104 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e40693-1100-4124-a7e2-2e1a957f8d5a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:03.534779 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258be128-7bf0-4c24-8131-9c433a013f5d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:03.563046 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6436ea-d7ad-4e6c-8a6f-9a32f9f17571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:03.564393 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6436ea-d7ad-4e6c-8a6f-9a32f9f17571 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:03.564888 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6436ea-d7ad-4e6c-8a6f-9a32f9f17571 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:03.565357 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6436ea-d7ad-4e6c-8a6f-9a32f9f17571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:03.587348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6436ea-d7ad-4e6c-8a6f-9a32f9f17571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:03.590936 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6436ea-d7ad-4e6c-8a6f-9a32f9f17571 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:03.602883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d8e38-e78a-4bd2-83a1-0c4a37514e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:03.605074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d8e38-e78a-4bd2-83a1-0c4a37514e42 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:03.605887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d8e38-e78a-4bd2-83a1-0c4a37514e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:03.606640 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d8e38-e78a-4bd2-83a1-0c4a37514e42 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:03.608474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d8e38-e78a-4bd2-83a1-0c4a37514e42 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:03.609364 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d8e38-e78a-4bd2-83a1-0c4a37514e42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:03.612360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d8e38-e78a-4bd2-83a1-0c4a37514e42 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:03.623460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-dc6436ea-d7ad-4e6c-8a6f-9a32f9f17571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:03.623460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:03.623460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:03.623460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:03.623460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:03.623460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:03.623460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:03.623460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:03.623460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:03.623460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:03.623460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:03.623460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:03.623460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:03.623460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:03.623460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:03.625354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:03.625354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:03.625354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:03.625354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:03.625354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:03.625354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:03.625354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:03.625354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:03.625354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:03.625354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:03.625354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:03.625354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:03.625354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:03.625354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:03.625354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:03.625354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:03.625354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:03.627892 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:03.627892 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:03.627892 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:03.627892 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:03.629173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 457/949] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:03.635501 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6436ea-d7ad-4e6c-8a6f-9a32f9f17571 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:03.698746 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 493/950] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 19 10:53:03 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:03.798344 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:03.839459 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6436ea-d7ad-4e6c-8a6f-9a32f9f17571 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:03.906154 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1d490-1a8a-4abf-ae8a-41b2a3604aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:03.907174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1d490-1a8a-4abf-ae8a-41b2a3604aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:03.907619 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1d490-1a8a-4abf-ae8a-41b2a3604aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:03.908061 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1d490-1a8a-4abf-ae8a-41b2a3604aa0 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:03.909483 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1d490-1a8a-4abf-ae8a-41b2a3604aa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:03.910003 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1d490-1a8a-4abf-ae8a-41b2a3604aa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:03.912560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1d490-1a8a-4abf-ae8a-41b2a3604aa0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:03.935054 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 458/951] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:03.943650 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d8e38-e78a-4bd2-83a1-0c4a37514e42 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:04.135841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d8e38-e78a-4bd2-83a1-0c4a37514e42 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:04.183259 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:04.204825 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5fed7-c400-443a-a859-1ecd05d8d36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:04.206320 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5fed7-c400-443a-a859-1ecd05d8d36e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:04.206822 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5fed7-c400-443a-a859-1ecd05d8d36e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:04.207314 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5fed7-c400-443a-a859-1ecd05d8d36e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:04.221045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5fed7-c400-443a-a859-1ecd05d8d36e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:04.223928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5fed7-c400-443a-a859-1ecd05d8d36e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:04.251956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-2aa5fed7-c400-443a-a859-1ecd05d8d36e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:04.251956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:04.251956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:04.251956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:04.251956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:04.251956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:04.251956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:04.251956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:04.251956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:04.251956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:04.251956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:04.251956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:04.251956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:04.251956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:04.251956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:04.254207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:04.254207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:04.254207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:04.254207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:04.254207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:04.254207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:04.254207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:04.254207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:04.254207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:04.254207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:04.254207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:04.254207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:04.254207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:04.254207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:04.254207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:04.254207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:04.254207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:04.256041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:04.256041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:04.256041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:04.256041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:04.256041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:04.256041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:04.256041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:04.256041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:04.258415 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 494/952] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:04.264602 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1d490-1a8a-4abf-ae8a-41b2a3604aa0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:04.455828 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1d490-1a8a-4abf-ae8a-41b2a3604aa0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:04.521031 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce96b0-9b2b-40a3-8f6f-22db15856d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:04.522127 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce96b0-9b2b-40a3-8f6f-22db15856d40 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:04.522827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce96b0-9b2b-40a3-8f6f-22db15856d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:04.523298 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce96b0-9b2b-40a3-8f6f-22db15856d40 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:04.524864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce96b0-9b2b-40a3-8f6f-22db15856d40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:04.525418 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce96b0-9b2b-40a3-8f6f-22db15856d40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:04.527852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce96b0-9b2b-40a3-8f6f-22db15856d40 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:04.540632 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b283c55-2b54-4901-8607-82ed4a5991f6 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:04.541081 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b283c55-2b54-4901-8607-82ed4a5991f6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:04.541235 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b283c55-2b54-4901-8607-82ed4a5991f6 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:04.542873 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 495/953] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:53:04.548298 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f16b6-7901-4728-830f-da75c8a24629 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:04.548694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f16b6-7901-4728-830f-da75c8a24629 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:04.548913 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f16b6-7901-4728-830f-da75c8a24629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:04.551631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:04.564766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 459/954] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:04.567697 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-169f16b6-7901-4728-830f-da75c8a24629 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:04.567898 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce96b0-9b2b-40a3-8f6f-22db15856d40 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:04.569381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-169f16b6-7901-4728-830f-da75c8a24629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:04.681785 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 496/955] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:04.683470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef058811-ff80-4c36-90c7-27d635758482 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:04.683915 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef058811-ff80-4c36-90c7-27d635758482 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:04.684353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef058811-ff80-4c36-90c7-27d635758482 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:04.686745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 497/956] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:04.696315 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849eec9-1395-4007-b6df-87c83bdd8d5f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:04.696657 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce96b0-9b2b-40a3-8f6f-22db15856d40 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:04.697915 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849eec9-1395-4007-b6df-87c83bdd8d5f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:04.698829 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849eec9-1395-4007-b6df-87c83bdd8d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:04.727874 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2849eec9-1395-4007-b6df-87c83bdd8d5f None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:04.729472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2849eec9-1395-4007-b6df-87c83bdd8d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:04.737472 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463a1f8-ec32-4ab0-9772-8529f986eb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:04.738409 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463a1f8-ec32-4ab0-9772-8529f986eb2d None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:04.738688 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463a1f8-ec32-4ab0-9772-8529f986eb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:04.738958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463a1f8-ec32-4ab0-9772-8529f986eb2d None admin] PATH_INFO: `/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/654631b067b94b269f93ea7b3977609d/roles/2b15d93fb65247dd8f0cc3f8a905fb38` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:04.741343 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463a1f8-ec32-4ab0-9772-8529f986eb2d None admin] RBAC: Authorizing `identity:create_grant(project_id=789e54670f7c40ffb67f20478aba00f2, user_id=654631b067b94b269f93ea7b3977609d, role_id=2b15d93fb65247dd8f0cc3f8a905fb38)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:04.742801 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463a1f8-ec32-4ab0-9772-8529f986eb2d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:04.762595 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 460/957] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:53:04 2022] PUT /identity/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/654631b067b94b269f93ea7b3977609d/roles/2b15d93fb65247dd8f0cc3f8a905fb38 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 10:53:04.763963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463a1f8-ec32-4ab0-9772-8529f986eb2d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:04.854071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:04.857996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 498/958] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:04.883642 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849eec9-1395-4007-b6df-87c83bdd8d5f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:04.922957 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463a1f8-ec32-4ab0-9772-8529f986eb2d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:04.960615 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:04.987738 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b88a8-29aa-4a6c-a07b-5287deee603f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:04.988570 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b88a8-29aa-4a6c-a07b-5287deee603f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:04.988910 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b88a8-29aa-4a6c-a07b-5287deee603f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:04.989191 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b88a8-29aa-4a6c-a07b-5287deee603f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:04.989862 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b88a8-29aa-4a6c-a07b-5287deee603f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:04.991268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b88a8-29aa-4a6c-a07b-5287deee603f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:05.003831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-f48b88a8-29aa-4a6c-a07b-5287deee603f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 10:53:05.003831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:05.003831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:05.003831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:05.003831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:05.003831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:05.003831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:05.003831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:05.003831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 10:53:05.003831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:05.003831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:05.003831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:05.003831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:05.003831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:05.003831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:05.003831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:05.003831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:05.005043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:05.005043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:05.005043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:05.005043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:05.005043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:05.005043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:05.005043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:05.005043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:05.005043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:05.005043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:05.005043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:05.005043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:05.005043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:05.005043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:05.005043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:05.005043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:05.009711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:05.009711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:05.009711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:05.009711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:05.009711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:05.009711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:05.009711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:05.009711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:05.009711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:05.009711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:05.009711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:05.009711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:05.009711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 10:53:05.009711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:05.009711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 461/959] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:05.014446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b88a8-29aa-4a6c-a07b-5287deee603f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:05.056232 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849eec9-1395-4007-b6df-87c83bdd8d5f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:05.110396 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b3949-2e81-45d3-8261-3f7a5387f906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:05.111472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b3949-2e81-45d3-8261-3f7a5387f906 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:05.111752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b3949-2e81-45d3-8261-3f7a5387f906 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:05.112134 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b3949-2e81-45d3-8261-3f7a5387f906 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:05.113131 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b3949-2e81-45d3-8261-3f7a5387f906 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:05.115032 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b3949-2e81-45d3-8261-3f7a5387f906 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:05.129079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-7f9b3949-2e81-45d3-8261-3f7a5387f906 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:53:05.129079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:05.129079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:05.129079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:05.129079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:05.129079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:05.129079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:05.129079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:05.129079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:53:05.129079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:05.129079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:05.129079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:05.129079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:05.129079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:05.129079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:05.129079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:05.129079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:05.130217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:05.130217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:05.130217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:05.130217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:05.130217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:05.130217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:05.130217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:05.130217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:05.130217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:05.130217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:05.130217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:05.130217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:05.130217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:05.130217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:05.130217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:05.130217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:05.131051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:05.131051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:05.131051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:05.131051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:05.131051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:05.131051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:05.131051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:05.131051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:05.131051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:05.131051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:05.131051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:05.131051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:05.131051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:53:05.131051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:05.131051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 499/960] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 19 10:53:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:05.137607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b3949-2e81-45d3-8261-3f7a5387f906 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:05.172124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b88a8-29aa-4a6c-a07b-5287deee603f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:05.202633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:05.217288 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fbe43-7f51-48da-9139-c0f7f78b76ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:05.217876 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fbe43-7f51-48da-9139-c0f7f78b76ee None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:05.218156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fbe43-7f51-48da-9139-c0f7f78b76ee None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:05.218433 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fbe43-7f51-48da-9139-c0f7f78b76ee None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:05.219146 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fbe43-7f51-48da-9139-c0f7f78b76ee None admin] RBAC: Adding query filter params (name=compute) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:05.219521 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fbe43-7f51-48da-9139-c0f7f78b76ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:05.220968 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fbe43-7f51-48da-9139-c0f7f78b76ee None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:05.228776 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 462/961] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 19 10:53:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:05.235025 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fbe43-7f51-48da-9139-c0f7f78b76ee None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:05.267446 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b3949-2e81-45d3-8261-3f7a5387f906 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:05.278184 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:05.309051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6c9f2-4ea6-4b8d-8236-598984ccf877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:05.309733 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6c9f2-4ea6-4b8d-8236-598984ccf877 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:05.310015 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6c9f2-4ea6-4b8d-8236-598984ccf877 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:05.310289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6c9f2-4ea6-4b8d-8236-598984ccf877 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:05.311005 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6c9f2-4ea6-4b8d-8236-598984ccf877 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:05.311429 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6c9f2-4ea6-4b8d-8236-598984ccf877 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:05.312972 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6c9f2-4ea6-4b8d-8236-598984ccf877 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:05.319471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 500/962] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jul 19 10:53:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:05.325073 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6c9f2-4ea6-4b8d-8236-598984ccf877 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:05.381347 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fbe43-7f51-48da-9139-c0f7f78b76ee None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:05.423635 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbbe3b-8cd1-484d-b686-1dee77c8a039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:05.424982 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbbe3b-8cd1-484d-b686-1dee77c8a039 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:05.426324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbbe3b-8cd1-484d-b686-1dee77c8a039 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:05.426952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbbe3b-8cd1-484d-b686-1dee77c8a039 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:05.429026 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbbe3b-8cd1-484d-b686-1dee77c8a039 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:05.430133 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbbe3b-8cd1-484d-b686-1dee77c8a039 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:05.433278 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbbe3b-8cd1-484d-b686-1dee77c8a039 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:05.439998 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 463/963] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 19 10:53:05 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:05.459236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6c9f2-4ea6-4b8d-8236-598984ccf877 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:05.524009 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188298c0-ac38-4fc1-98af-021dc202dc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:05.525141 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188298c0-ac38-4fc1-98af-021dc202dc14 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:05.525620 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188298c0-ac38-4fc1-98af-021dc202dc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:05.525918 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188298c0-ac38-4fc1-98af-021dc202dc14 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:05.527219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188298c0-ac38-4fc1-98af-021dc202dc14 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:05.527765 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188298c0-ac38-4fc1-98af-021dc202dc14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:05.530249 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188298c0-ac38-4fc1-98af-021dc202dc14 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:05.544358 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 501/964] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jul 19 10:53:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:05.546374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbbe3b-8cd1-484d-b686-1dee77c8a039 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:05.621208 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:05.704911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbbe3b-8cd1-484d-b686-1dee77c8a039 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:05.740982 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020406d6-45bf-4f33-803a-3b7fdf228fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:05.741650 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020406d6-45bf-4f33-803a-3b7fdf228fd3 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:05.741936 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020406d6-45bf-4f33-803a-3b7fdf228fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:05.742214 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020406d6-45bf-4f33-803a-3b7fdf228fd3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:05.742971 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020406d6-45bf-4f33-803a-3b7fdf228fd3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:05.744355 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020406d6-45bf-4f33-803a-3b7fdf228fd3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:05.773088 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 464/965] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 19 10:53:05 2022] POST /identity/v3/endpoints => generated 349 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:53:06.873465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de57b42-fd47-4659-9533-9fc5de30463e None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:06.874246 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de57b42-fd47-4659-9533-9fc5de30463e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:06.874383 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de57b42-fd47-4659-9533-9fc5de30463e None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:06.877298 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 502/966] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:06.883316 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69d0a2-e4b5-4aeb-bdde-aee3bafe1e24 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:06.884106 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69d0a2-e4b5-4aeb-bdde-aee3bafe1e24 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:06.884106 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69d0a2-e4b5-4aeb-bdde-aee3bafe1e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:06.905619 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4d69d0a2-e4b5-4aeb-bdde-aee3bafe1e24 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:06.905619 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4d69d0a2-e4b5-4aeb-bdde-aee3bafe1e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:07.012086 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 465/967] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:07.046671 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de57b42-fd47-4659-9533-9fc5de30463e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:07.108164 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:07.204538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de57b42-fd47-4659-9533-9fc5de30463e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:07.251509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb7338-15bb-4506-8dc1-b5c5ac99867e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:07.252332 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb7338-15bb-4506-8dc1-b5c5ac99867e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:07.252605 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb7338-15bb-4506-8dc1-b5c5ac99867e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:07.252945 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb7338-15bb-4506-8dc1-b5c5ac99867e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:07.264939 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb7338-15bb-4506-8dc1-b5c5ac99867e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:07.273110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-7bbb7338-15bb-4506-8dc1-b5c5ac99867e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:53:07.273110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:07.273110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:07.273110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:07.273110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:07.273110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:07.273110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:07.273110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:07.273110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:07.273110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:07.273110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:07.273110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:07.273110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:07.273110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:07.273110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:07.273110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:07.274074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:07.274074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:07.274074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:07.274074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:07.274074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:07.274074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:07.274074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:07.274074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:07.274074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:07.274074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:07.274074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:07.274074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:07.274074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:07.274074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:07.274074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:07.274074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:07.275258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:07.275258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:07.275258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:07.275258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:07.275258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:07.275258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:07.275258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:07.275258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:07.275258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:07.275258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:07.275258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:53:07.275258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:07.279498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 503/968] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jul 19 10:53:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:07.280415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69d0a2-e4b5-4aeb-bdde-aee3bafe1e24 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:07.317846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:07.420685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69d0a2-e4b5-4aeb-bdde-aee3bafe1e24 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:07.488494 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a3b62-2199-42a4-9941-5b3ad4c40091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:07.489580 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a3b62-2199-42a4-9941-5b3ad4c40091 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:07.490071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a3b62-2199-42a4-9941-5b3ad4c40091 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:07.490554 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a3b62-2199-42a4-9941-5b3ad4c40091 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:07.491965 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a3b62-2199-42a4-9941-5b3ad4c40091 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:07.492512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a3b62-2199-42a4-9941-5b3ad4c40091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:07.494646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a3b62-2199-42a4-9941-5b3ad4c40091 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:07.516182 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 466/969] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jul 19 10:53:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:07.525236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb7338-15bb-4506-8dc1-b5c5ac99867e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:07.551366 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec026c-debc-4387-96dd-c877e10d885c None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:07.551699 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec026c-debc-4387-96dd-c877e10d885c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:07.551946 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec026c-debc-4387-96dd-c877e10d885c None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:07.553388 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 467/970] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:53:07.559208 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcc193-c7cb-403c-b1fb-5e4462dac8de None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:07.559499 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcc193-c7cb-403c-b1fb-5e4462dac8de None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:07.559829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcc193-c7cb-403c-b1fb-5e4462dac8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:07.580825 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c1bcc193-c7cb-403c-b1fb-5e4462dac8de None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:07.582088 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c1bcc193-c7cb-403c-b1fb-5e4462dac8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:07.671225 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:07.676155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 468/971] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:07.684964 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb7338-15bb-4506-8dc1-b5c5ac99867e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:07.705217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcc193-c7cb-403c-b1fb-5e4462dac8de None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:07.732340 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a069f0-804f-4656-b171-3e5aff0b2186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:07.733188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a069f0-804f-4656-b171-3e5aff0b2186 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:07.733463 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a069f0-804f-4656-b171-3e5aff0b2186 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:07.733738 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a069f0-804f-4656-b171-3e5aff0b2186 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:07.736424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:07.747212 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a069f0-804f-4656-b171-3e5aff0b2186 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:07.748581 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a069f0-804f-4656-b171-3e5aff0b2186 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:07.770209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-a1a069f0-804f-4656-b171-3e5aff0b2186 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:07.770209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:07.770209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:07.770209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:07.770209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:07.770209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:07.770209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:07.770209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:07.770209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:07.770209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:07.770209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:07.770209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:07.770209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:07.770209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:07.770209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:07.772076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:07.772076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:07.772076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:07.772076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:07.772076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:07.772076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:07.772076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:07.772076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:07.772076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:07.772076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:07.772076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:07.772076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:07.772076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:07.772076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:07.772076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:07.772076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:07.772076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:07.774069 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:07.774069 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:07.774069 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:07.774069 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:07.774069 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 504/972] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:07.777354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a069f0-804f-4656-b171-3e5aff0b2186 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:07.836876 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcc193-c7cb-403c-b1fb-5e4462dac8de None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:07.888131 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72ce89-f6e8-49d1-82c2-7bac0110c063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:07.889116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72ce89-f6e8-49d1-82c2-7bac0110c063 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:07.889116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72ce89-f6e8-49d1-82c2-7bac0110c063 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:07.889363 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72ce89-f6e8-49d1-82c2-7bac0110c063 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:07.890088 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72ce89-f6e8-49d1-82c2-7bac0110c063 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:07.891480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72ce89-f6e8-49d1-82c2-7bac0110c063 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:07.907731 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 469/973] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 19 10:53:07 2022] POST /identity/v3/services => generated 242 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:53:07.909143 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c9644-3f13-461d-990c-9f65ec2093fe None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:07.909430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c9644-3f13-461d-990c-9f65ec2093fe None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:07.909788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c9644-3f13-461d-990c-9f65ec2093fe None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:07.911095 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 470/974] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:07.915520 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a069f0-804f-4656-b171-3e5aff0b2186 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:07.918800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50c765-d087-4db3-b7b9-4d9a072030e6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:07.919081 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50c765-d087-4db3-b7b9-4d9a072030e6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:07.919352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50c765-d087-4db3-b7b9-4d9a072030e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:07.937512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-dd50c765-d087-4db3-b7b9-4d9a072030e6 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:07.938811 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dd50c765-d087-4db3-b7b9-4d9a072030e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:07.968283 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79954e-0098-4297-827c-3f2db2579634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:07.969004 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79954e-0098-4297-827c-3f2db2579634 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:07.969286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79954e-0098-4297-827c-3f2db2579634 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:07.969555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79954e-0098-4297-827c-3f2db2579634 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:07.970284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79954e-0098-4297-827c-3f2db2579634 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:07.970723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79954e-0098-4297-827c-3f2db2579634 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:07.972282 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79954e-0098-4297-827c-3f2db2579634 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:07.992523 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 505/975] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:07.993469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79954e-0098-4297-827c-3f2db2579634 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:07.998626 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:08.033002 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 471/976] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:08.060577 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50c765-d087-4db3-b7b9-4d9a072030e6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:08.084871 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:08.139394 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79954e-0098-4297-827c-3f2db2579634 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:08.185746 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb483bb-d423-41e4-95d6-96b21b485d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:08.187327 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb483bb-d423-41e4-95d6-96b21b485d4e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:08.187327 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb483bb-d423-41e4-95d6-96b21b485d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:08.187327 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb483bb-d423-41e4-95d6-96b21b485d4e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:08.197745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb483bb-d423-41e4-95d6-96b21b485d4e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:08.200142 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb483bb-d423-41e4-95d6-96b21b485d4e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:08.218992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50c765-d087-4db3-b7b9-4d9a072030e6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:08.228928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-abb483bb-d423-41e4-95d6-96b21b485d4e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:53:08.228928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:08.228928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:08.228928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:08.228928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:08.228928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:08.228928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:08.228928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:08.228928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:08.228928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:08.228928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:08.228928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:08.228928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:08.228928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:08.228928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:08.228928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:08.229940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:08.229940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:08.229940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:08.229940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:08.229940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:08.229940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:08.229940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:08.229940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:08.229940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:08.229940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:08.229940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:08.229940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:08.229940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:08.229940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:08.229940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:08.229940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:08.229940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:08.229940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:08.230967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:08.230967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:08.230967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:08.230967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:08.230967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:08.230967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:08.230967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:08.230967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:08.230967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:53:08.230967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:08.232623 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 506/977] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jul 19 10:53:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:08.237057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb483bb-d423-41e4-95d6-96b21b485d4e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:08.274422 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fc986-33dc-4a5a-b946-4f350123da84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:08.275529 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fc986-33dc-4a5a-b946-4f350123da84 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:08.276032 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fc986-33dc-4a5a-b946-4f350123da84 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:08.276534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fc986-33dc-4a5a-b946-4f350123da84 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:08.277910 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fc986-33dc-4a5a-b946-4f350123da84 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:08.280396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fc986-33dc-4a5a-b946-4f350123da84 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:08.297506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-783fc986-33dc-4a5a-b946-4f350123da84 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:53:08.297506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:08.297506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:08.297506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:08.297506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:08.297506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:08.297506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:08.297506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:08.297506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:53:08.297506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:08.297506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:08.297506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:08.297506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:08.297506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:08.297506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:08.297506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:08.297506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:08.298722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:08.298722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:08.298722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:08.298722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:08.298722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:08.298722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:08.298722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:08.298722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:08.298722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:08.298722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:08.298722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:08.298722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:08.298722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:08.298722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:08.298722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:08.298722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:08.300257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:08.300257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:08.300257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:08.300257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:08.300257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:08.300257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:08.300257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:08.300257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:08.300257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:08.300257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:08.300257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:08.300257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:08.300257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:53:08.300257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:08.300257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 472/978] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 19 10:53:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:08.305074 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fc986-33dc-4a5a-b946-4f350123da84 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:08.318633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:08.368173 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb483bb-d423-41e4-95d6-96b21b485d4e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:08.404015 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:08.414484 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b6ff9-3010-4937-b1c2-1ea34181c857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:08.415196 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b6ff9-3010-4937-b1c2-1ea34181c857 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:08.415451 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b6ff9-3010-4937-b1c2-1ea34181c857 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:08.415730 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b6ff9-3010-4937-b1c2-1ea34181c857 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:08.416593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b6ff9-3010-4937-b1c2-1ea34181c857 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:08.416939 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b6ff9-3010-4937-b1c2-1ea34181c857 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:08.418430 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b6ff9-3010-4937-b1c2-1ea34181c857 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:08.432043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fc986-33dc-4a5a-b946-4f350123da84 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:08.449911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 507/979] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jul 19 10:53:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:08.458231 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b6ff9-3010-4937-b1c2-1ea34181c857 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:08.484769 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a356eb-3232-484d-8a55-2f4808ec7ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:08.485876 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a356eb-3232-484d-8a55-2f4808ec7ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:08.486257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a356eb-3232-484d-8a55-2f4808ec7ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:08.486545 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a356eb-3232-484d-8a55-2f4808ec7ed4 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:08.487427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a356eb-3232-484d-8a55-2f4808ec7ed4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:08.487920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a356eb-3232-484d-8a55-2f4808ec7ed4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:08.489716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a356eb-3232-484d-8a55-2f4808ec7ed4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:08.497015 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 473/980] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jul 19 10:53:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:08.504011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a356eb-3232-484d-8a55-2f4808ec7ed4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:08.618532 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b6ff9-3010-4937-b1c2-1ea34181c857 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:08.659728 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a356eb-3232-484d-8a55-2f4808ec7ed4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:08.660984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:08.675998 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16786ee-e8bd-43ff-94f8-e3b02ce28091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:08.676671 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16786ee-e8bd-43ff-94f8-e3b02ce28091 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:08.677001 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16786ee-e8bd-43ff-94f8-e3b02ce28091 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:08.677243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16786ee-e8bd-43ff-94f8-e3b02ce28091 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:08.701421 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6889fd8-302a-476e-a57c-5521c1203b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:08.702106 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6889fd8-302a-476e-a57c-5521c1203b14 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:08.702499 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6889fd8-302a-476e-a57c-5521c1203b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:08.702820 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6889fd8-302a-476e-a57c-5521c1203b14 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:08.703446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6889fd8-302a-476e-a57c-5521c1203b14 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:08.703752 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6889fd8-302a-476e-a57c-5521c1203b14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:08.705498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6889fd8-302a-476e-a57c-5521c1203b14 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:08.711506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 474/981] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jul 19 10:53:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:08.718200 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6889fd8-302a-476e-a57c-5521c1203b14 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:08.730988 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:08.777162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16786ee-e8bd-43ff-94f8-e3b02ce28091 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:08.778651 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16786ee-e8bd-43ff-94f8-e3b02ce28091 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:08.841289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6889fd8-302a-476e-a57c-5521c1203b14 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:08.885204 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e822cd5-326d-4808-bf4d-f61a5d5e7a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:08.886594 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e822cd5-326d-4808-bf4d-f61a5d5e7a33 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:08.887320 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e822cd5-326d-4808-bf4d-f61a5d5e7a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:08.888027 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e822cd5-326d-4808-bf4d-f61a5d5e7a33 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:08.889765 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e822cd5-326d-4808-bf4d-f61a5d5e7a33 None admin] RBAC: Adding query filter params (interface=admin, service_id=011dca0b839a483f8a3bf7e9d34c1608, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:08.891378 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e822cd5-326d-4808-bf4d-f61a5d5e7a33 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:08.893915 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e822cd5-326d-4808-bf4d-f61a5d5e7a33 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:08.906779 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 475/982] 10.222.0.18 () {56 vars in 1249 bytes} [Tue Jul 19 10:53:08 2022] GET /identity/v3/endpoints?service_id=011dca0b839a483f8a3bf7e9d34c1608&interface=admin®ion_id=RegionOne => generated 193 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:08.910820 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e822cd5-326d-4808-bf4d-f61a5d5e7a33 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:08.923009 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 508/983] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:08 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:53:08.929508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16786ee-e8bd-43ff-94f8-e3b02ce28091 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:08.959399 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:09.011759 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:09.052372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e822cd5-326d-4808-bf4d-f61a5d5e7a33 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:09.060440 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16786ee-e8bd-43ff-94f8-e3b02ce28091 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:09.100133 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9cee9-16f1-4b75-9f85-37c44662ad5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:09.101444 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9cee9-16f1-4b75-9f85-37c44662ad5f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:09.101944 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9cee9-16f1-4b75-9f85-37c44662ad5f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:09.102419 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9cee9-16f1-4b75-9f85-37c44662ad5f None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:09.103685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9cee9-16f1-4b75-9f85-37c44662ad5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:09.106283 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9cee9-16f1-4b75-9f85-37c44662ad5f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:09.116888 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1135e48-3a30-4f0a-a4bf-649c70e304e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:09.118641 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1135e48-3a30-4f0a-a4bf-649c70e304e8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:09.119360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 476/984] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 19 10:53:08 2022] GET /identity/v3/services => generated 1727 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 10:53:09.119614 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1135e48-3a30-4f0a-a4bf-649c70e304e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:09.120118 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1135e48-3a30-4f0a-a4bf-649c70e304e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:09.146196 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1135e48-3a30-4f0a-a4bf-649c70e304e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:09.148967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1135e48-3a30-4f0a-a4bf-649c70e304e8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:09.185497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-c1135e48-3a30-4f0a-a4bf-649c70e304e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:09.185497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:09.185497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:09.185497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:09.185497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:09.185497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:09.185497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:09.185497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:09.185497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:09.185497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:09.185497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:09.185497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:09.185497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:09.185497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:09.185497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:09.187276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:09.187276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:09.187276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:09.187276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:09.187276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:09.187276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:09.187276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:09.187276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:09.187276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:09.187276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:09.187276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:09.187276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:09.187276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:09.187276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:09.187276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:09.187276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:09.187276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:09.189070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:09.189070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:09.189070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:09.189070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:09.189070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 509/985] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:09.194418 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9cee9-16f1-4b75-9f85-37c44662ad5f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:09.369556 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9cee9-16f1-4b75-9f85-37c44662ad5f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:09.431657 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293a905-16a4-498e-aeed-cf752d4591ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:09.433923 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293a905-16a4-498e-aeed-cf752d4591ff None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:09.434164 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293a905-16a4-498e-aeed-cf752d4591ff None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:09.434524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293a905-16a4-498e-aeed-cf752d4591ff None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:09.435966 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293a905-16a4-498e-aeed-cf752d4591ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:09.436526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293a905-16a4-498e-aeed-cf752d4591ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:09.441788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293a905-16a4-498e-aeed-cf752d4591ff None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:09.444099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:09.464278 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 477/986] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:09.473089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1135e48-3a30-4f0a-a4bf-649c70e304e8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:09.622022 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:09.674551 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1135e48-3a30-4f0a-a4bf-649c70e304e8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:09.741994 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1446c9-035f-44a8-8c45-28f792847c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:09.743356 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1446c9-035f-44a8-8c45-28f792847c38 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:09.743824 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1446c9-035f-44a8-8c45-28f792847c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:09.744296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1446c9-035f-44a8-8c45-28f792847c38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:09.757468 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1446c9-035f-44a8-8c45-28f792847c38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:09.760117 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1446c9-035f-44a8-8c45-28f792847c38 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:09.787043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-7f1446c9-035f-44a8-8c45-28f792847c38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:09.787043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:09.787043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:09.787043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:09.787043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:09.787043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:09.787043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:09.787043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:09.787043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:09.787043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:09.787043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:09.787043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:09.787043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:09.787043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:09.787043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:09.789274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:09.789274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:09.789274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:09.789274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:09.789274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:09.789274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:09.789274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:09.789274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:09.789274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:09.789274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:09.789274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:09.789274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:09.789274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:09.789274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:09.789274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:09.789274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:09.789274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:09.791063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:09.791063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:09.791063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:09.791063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:09.791063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:09.791063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:09.791063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:09.791063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:09.796499 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 510/987] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:09.798732 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293a905-16a4-498e-aeed-cf752d4591ff None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:09.998313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293a905-16a4-498e-aeed-cf752d4591ff None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:10.063817 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10a09f-830f-4f16-b08c-01ff3aa7b228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:10.064997 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10a09f-830f-4f16-b08c-01ff3aa7b228 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:10.065575 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10a09f-830f-4f16-b08c-01ff3aa7b228 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:10.066057 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10a09f-830f-4f16-b08c-01ff3aa7b228 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:10.067538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10a09f-830f-4f16-b08c-01ff3aa7b228 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:10.068090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10a09f-830f-4f16-b08c-01ff3aa7b228 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:10.070848 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10a09f-830f-4f16-b08c-01ff3aa7b228 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:10.096783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 478/988] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:10.104597 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1446c9-035f-44a8-8c45-28f792847c38 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:10.291128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1446c9-035f-44a8-8c45-28f792847c38 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:10.354827 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c77666-4bb6-4153-b28a-7a5cc97e2d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:10.355938 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c77666-4bb6-4153-b28a-7a5cc97e2d20 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:10.356426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c77666-4bb6-4153-b28a-7a5cc97e2d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:10.356924 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c77666-4bb6-4153-b28a-7a5cc97e2d20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:10.358447 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c77666-4bb6-4153-b28a-7a5cc97e2d20 None admin] RBAC: Adding query filter params (role.id=2b15d93fb65247dd8f0cc3f8a905fb38, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=654631b067b94b269f93ea7b3977609d) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:10.358984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c77666-4bb6-4153-b28a-7a5cc97e2d20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:10.361663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c77666-4bb6-4153-b28a-7a5cc97e2d20 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:10.365409 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:10.375646 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 511/989] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:10 2022] GET /identity/v3/role_assignments?user.id=654631b067b94b269f93ea7b3977609d&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=2b15d93fb65247dd8f0cc3f8a905fb38 => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:10.524914 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91c481-aa29-459e-bc50-4273851f40f4 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:10.525427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91c481-aa29-459e-bc50-4273851f40f4 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:10.525920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91c481-aa29-459e-bc50-4273851f40f4 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:10.528543 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 479/990] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:10.534714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f666c8-9182-49db-8fd4-a593a825df88 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:10.534980 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f666c8-9182-49db-8fd4-a593a825df88 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:10.535323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f666c8-9182-49db-8fd4-a593a825df88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:10.554089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-86f666c8-9182-49db-8fd4-a593a825df88 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:10.555220 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-86f666c8-9182-49db-8fd4-a593a825df88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:10.645853 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 512/991] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:10 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:10.669526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91c481-aa29-459e-bc50-4273851f40f4 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:10.784698 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:10.838466 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91c481-aa29-459e-bc50-4273851f40f4 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:10.888511 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e98f8-2547-4525-b1e9-f5213f7dba38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:10.889459 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e98f8-2547-4525-b1e9-f5213f7dba38 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:10.889744 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e98f8-2547-4525-b1e9-f5213f7dba38 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:10.890029 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e98f8-2547-4525-b1e9-f5213f7dba38 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:10.890712 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e98f8-2547-4525-b1e9-f5213f7dba38 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:10.892168 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e98f8-2547-4525-b1e9-f5213f7dba38 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:10.905831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-4c7e98f8-2547-4525-b1e9-f5213f7dba38 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 10:53:10.905831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:10.905831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:10.905831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:10.905831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:10.905831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:10.905831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:10.905831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:10.905831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 10:53:10.905831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:10.905831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:10.905831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:10.905831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:10.905831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:10.905831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:10.905831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:10.905831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:10.907877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:10.907877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:10.907877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:10.907877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:10.907877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:10.907877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:10.907877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:10.907877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:10.907877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:10.907877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:10.907877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:10.907877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:10.907877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:10.907877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:10.907877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:10.907877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:10.910899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:10.910899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:10.910899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:10.910899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:10.910899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:10.910899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:10.910899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:10.910899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:10.910899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:10.910899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:10.910899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:10.910899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:10.910899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 10:53:10.910899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:10.910899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 480/992] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:10.917117 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f666c8-9182-49db-8fd4-a593a825df88 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:11.106796 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f666c8-9182-49db-8fd4-a593a825df88 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:11.154937 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:11.170769 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62203ef0-61c2-47b0-afd4-a0e9e2af41f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:11.171913 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62203ef0-61c2-47b0-afd4-a0e9e2af41f8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:11.172413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62203ef0-61c2-47b0-afd4-a0e9e2af41f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:11.172940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62203ef0-61c2-47b0-afd4-a0e9e2af41f8 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:11.174264 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62203ef0-61c2-47b0-afd4-a0e9e2af41f8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:11.174883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62203ef0-61c2-47b0-afd4-a0e9e2af41f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:11.177450 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62203ef0-61c2-47b0-afd4-a0e9e2af41f8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:11.192832 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 513/993] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 19 10:53:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:11.197046 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e98f8-2547-4525-b1e9-f5213f7dba38 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:11.385519 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e98f8-2547-4525-b1e9-f5213f7dba38 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:11.433591 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:11.438255 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87a400-0106-4859-9231-2f08d8eeace3 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:11.438606 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87a400-0106-4859-9231-2f08d8eeace3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:11.439220 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87a400-0106-4859-9231-2f08d8eeace3 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:11.445788 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 514/994] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:11.455391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc956365-7c15-4e27-82e0-c247350dfca9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:11.455895 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc956365-7c15-4e27-82e0-c247350dfca9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:11.456393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc956365-7c15-4e27-82e0-c247350dfca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:11.457189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788940a-8c7c-413a-8ea2-5e3d160f210e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:11.457873 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788940a-8c7c-413a-8ea2-5e3d160f210e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:11.458152 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788940a-8c7c-413a-8ea2-5e3d160f210e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:11.458436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788940a-8c7c-413a-8ea2-5e3d160f210e None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:11.459124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788940a-8c7c-413a-8ea2-5e3d160f210e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:11.459425 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788940a-8c7c-413a-8ea2-5e3d160f210e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:11.460858 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788940a-8c7c-413a-8ea2-5e3d160f210e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:11.467185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 481/995] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 19 10:53:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:11.473069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788940a-8c7c-413a-8ea2-5e3d160f210e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:11.486231 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bc956365-7c15-4e27-82e0-c247350dfca9 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:11.488303 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bc956365-7c15-4e27-82e0-c247350dfca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:11.609630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 515/996] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:11.632201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788940a-8c7c-413a-8ea2-5e3d160f210e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:11.633175 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc956365-7c15-4e27-82e0-c247350dfca9 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:11.700205 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42137d-bdf8-4a6b-8f46-377002a0236a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:11.701293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42137d-bdf8-4a6b-8f46-377002a0236a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:11.701744 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42137d-bdf8-4a6b-8f46-377002a0236a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:11.702694 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42137d-bdf8-4a6b-8f46-377002a0236a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:11.704110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42137d-bdf8-4a6b-8f46-377002a0236a None admin] RBAC: Adding query filter params (interface=public, service_id=751206d5f72e47afa19c66f09976f47f, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:11.705063 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42137d-bdf8-4a6b-8f46-377002a0236a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:11.707555 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42137d-bdf8-4a6b-8f46-377002a0236a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:11.723361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 482/997] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jul 19 10:53:11 2022] GET /identity/v3/endpoints?service_id=751206d5f72e47afa19c66f09976f47f&interface=public®ion_id=RegionOne => generated 194 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:11.725147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42137d-bdf8-4a6b-8f46-377002a0236a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:11.801368 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:11.812396 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc956365-7c15-4e27-82e0-c247350dfca9 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:11.846029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:11.863159 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b13f7-bc45-4baa-8fd0-12bdf298bc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:11.864347 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b13f7-bc45-4baa-8fd0-12bdf298bc70 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:11.864817 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b13f7-bc45-4baa-8fd0-12bdf298bc70 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:11.865224 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b13f7-bc45-4baa-8fd0-12bdf298bc70 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:11.866347 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b13f7-bc45-4baa-8fd0-12bdf298bc70 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:11.867983 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b13f7-bc45-4baa-8fd0-12bdf298bc70 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:11.881318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-829b13f7-bc45-4baa-8fd0-12bdf298bc70 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:53:11.881318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:11.881318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:11.881318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:11.881318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:11.881318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:11.881318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:11.881318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:11.881318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:53:11.881318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:11.881318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:11.881318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:11.881318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:11.881318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:11.881318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:11.881318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:11.881318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:11.882485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:11.882485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:11.882485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:11.882485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:11.882485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:11.882485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:11.882485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:11.882485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:11.882485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:11.882485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:11.882485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:11.882485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:11.882485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:11.882485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:11.882485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:11.882485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:11.889023 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:11.889023 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:11.889023 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:11.889023 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:11.889023 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:11.889023 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:11.889023 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:11.889023 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:11.889023 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:11.889023 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:11.889023 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:11.889023 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:11.889023 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:53:11.889023 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:11.889023 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 516/998] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 19 10:53:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:11.889798 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b13f7-bc45-4baa-8fd0-12bdf298bc70 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:11.901133 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42137d-bdf8-4a6b-8f46-377002a0236a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:11.945775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93cf72-8d59-468f-a6b0-533f55984e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:11.946452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93cf72-8d59-468f-a6b0-533f55984e02 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:11.946727 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93cf72-8d59-468f-a6b0-533f55984e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:11.947005 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93cf72-8d59-468f-a6b0-533f55984e02 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:11.947684 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e93cf72-8d59-468f-a6b0-533f55984e02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:11.949095 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e93cf72-8d59-468f-a6b0-533f55984e02 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:11.956904 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 483/999] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 19 10:53:11 2022] GET /identity/v3/services => generated 1727 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 10:53:12.020974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b13f7-bc45-4baa-8fd0-12bdf298bc70 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:12.062880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b0e4c-3017-483b-bed9-036ee46144e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:12.064451 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b0e4c-3017-483b-bed9-036ee46144e6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:12.065281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b0e4c-3017-483b-bed9-036ee46144e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:12.066012 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b0e4c-3017-483b-bed9-036ee46144e6 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:12.067577 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b0e4c-3017-483b-bed9-036ee46144e6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:12.068385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b0e4c-3017-483b-bed9-036ee46144e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:12.070698 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b0e4c-3017-483b-bed9-036ee46144e6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:12.084959 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 517/1000] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jul 19 10:53:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:12.089810 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93cf72-8d59-468f-a6b0-533f55984e02 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:12.222560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93cf72-8d59-468f-a6b0-533f55984e02 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:12.239214 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:12.268870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b63b3-9869-482e-a44f-59e787af0fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:12.269603 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b63b3-9869-482e-a44f-59e787af0fcc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:12.269866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b63b3-9869-482e-a44f-59e787af0fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:12.270164 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b63b3-9869-482e-a44f-59e787af0fcc None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:12.270862 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b63b3-9869-482e-a44f-59e787af0fcc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:12.271193 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b63b3-9869-482e-a44f-59e787af0fcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:12.272572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b63b3-9869-482e-a44f-59e787af0fcc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:12.278925 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 484/1001] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jul 19 10:53:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:12.284834 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b0e4c-3017-483b-bed9-036ee46144e6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:12.341416 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:12.400424 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b0e4c-3017-483b-bed9-036ee46144e6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:12.462767 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d156c8-41d2-4eec-b541-55de71b51ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:12.463650 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d156c8-41d2-4eec-b541-55de71b51ab9 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:12.464000 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d156c8-41d2-4eec-b541-55de71b51ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:12.464316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d156c8-41d2-4eec-b541-55de71b51ab9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:12.465327 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d156c8-41d2-4eec-b541-55de71b51ab9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:12.466729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d156c8-41d2-4eec-b541-55de71b51ab9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:12.486936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 518/1002] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 19 10:53:12 2022] POST /identity/v3/endpoints => generated 325 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:53:12.701719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29760cac-e187-4cbf-a60c-b65519a0bae5 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:12.702076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29760cac-e187-4cbf-a60c-b65519a0bae5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:12.702291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29760cac-e187-4cbf-a60c-b65519a0bae5 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:12.703880 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 485/1003] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:12.709472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df4344-4ec6-4062-af2c-bebc0b1376e3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:12.709764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df4344-4ec6-4062-af2c-bebc0b1376e3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:12.710045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df4344-4ec6-4062-af2c-bebc0b1376e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:12.728260 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-93df4344-4ec6-4062-af2c-bebc0b1376e3 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:12.729513 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-93df4344-4ec6-4062-af2c-bebc0b1376e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:12.819271 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 519/1004] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:12 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:12.843729 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29760cac-e187-4cbf-a60c-b65519a0bae5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:13.000511 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29760cac-e187-4cbf-a60c-b65519a0bae5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:13.041968 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7cbb7-8c07-4eb4-a553-3df8acc1454e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:13.042776 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7cbb7-8c07-4eb4-a553-3df8acc1454e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:13.043056 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7cbb7-8c07-4eb4-a553-3df8acc1454e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:13.043332 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7cbb7-8c07-4eb4-a553-3df8acc1454e None admin] PATH_INFO: `/v3/services/image` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:13.043984 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7cbb7-8c07-4eb4-a553-3df8acc1454e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:13.045413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7cbb7-8c07-4eb4-a553-3df8acc1454e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:13.057696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-afc7cbb7-8c07-4eb4-a553-3df8acc1454e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 10:53:13.057696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:13.057696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:13.057696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:13.057696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:13.057696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:13.057696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:13.057696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:13.057696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 10:53:13.057696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:13.057696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:13.057696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:13.057696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:13.057696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:13.057696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:13.057696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:13.057696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:13.058918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:13.058918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:13.058918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:13.058918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:13.058918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:13.058918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:13.058918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:13.058918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:13.058918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:13.058918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:13.058918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:13.058918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:13.058918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:13.058918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:13.058918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:13.058918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:13.060301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:13.060301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:13.060301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:13.060301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:13.060301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:13.060301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:13.060301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:13.060301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:13.060301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:13.060301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:13.060301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:13.060301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:13.060301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 10:53:13.060301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:13.069207 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 486/1005] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Jul 19 10:53:12 2022] GET /identity/v3/services/image => generated 86 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:13.069528 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df4344-4ec6-4062-af2c-bebc0b1376e3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:13.107569 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:13.186446 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df4344-4ec6-4062-af2c-bebc0b1376e3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:13.226572 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3d8af-7bb0-4cf8-9cb0-a1462e473ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:13.227258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3d8af-7bb0-4cf8-9cb0-a1462e473ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:13.227558 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3d8af-7bb0-4cf8-9cb0-a1462e473ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:13.227808 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3d8af-7bb0-4cf8-9cb0-a1462e473ee1 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:13.228522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3d8af-7bb0-4cf8-9cb0-a1462e473ee1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:13.230600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3d8af-7bb0-4cf8-9cb0-a1462e473ee1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:13.230600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3d8af-7bb0-4cf8-9cb0-a1462e473ee1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:13.236423 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 520/1006] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:13.242822 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7cbb7-8c07-4eb4-a553-3df8acc1454e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:13.289692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:13.359888 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7cbb7-8c07-4eb4-a553-3df8acc1454e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:13.405823 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbbfd7-0a33-40b1-8d24-b835e0b1c129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:13.406499 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbbfd7-0a33-40b1-8d24-b835e0b1c129 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:13.406770 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbbfd7-0a33-40b1-8d24-b835e0b1c129 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:13.407049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbbfd7-0a33-40b1-8d24-b835e0b1c129 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:13.407763 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbbfd7-0a33-40b1-8d24-b835e0b1c129 None admin] RBAC: Adding query filter params (type=image) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:13.408067 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbbfd7-0a33-40b1-8d24-b835e0b1c129 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:13.409512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbbfd7-0a33-40b1-8d24-b835e0b1c129 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:13.419836 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 487/1007] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:13 2022] GET /identity/v3/services?type=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:14.248469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78f5de-a2ef-4c1b-bd8c-e90f90b39d24 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:14.249036 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78f5de-a2ef-4c1b-bd8c-e90f90b39d24 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:14.249143 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78f5de-a2ef-4c1b-bd8c-e90f90b39d24 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:14.250873 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 521/1008] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:14.257256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000fd97-968d-40f9-9afa-8118db0044e9 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:14.257724 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000fd97-968d-40f9-9afa-8118db0044e9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:14.257724 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000fd97-968d-40f9-9afa-8118db0044e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:14.280521 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a000fd97-968d-40f9-9afa-8118db0044e9 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:14.281783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a000fd97-968d-40f9-9afa-8118db0044e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:14.363635 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 488/1009] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:14 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:14.386635 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78f5de-a2ef-4c1b-bd8c-e90f90b39d24 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:14.518012 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:14.524101 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78f5de-a2ef-4c1b-bd8c-e90f90b39d24 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:14.564404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb737b68-0f44-4fb5-8a96-5410f1dabfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:14.565291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb737b68-0f44-4fb5-8a96-5410f1dabfcb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:14.565545 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb737b68-0f44-4fb5-8a96-5410f1dabfcb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:14.565838 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb737b68-0f44-4fb5-8a96-5410f1dabfcb None admin] PATH_INFO: `/v3/services/compute` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:14.566501 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb737b68-0f44-4fb5-8a96-5410f1dabfcb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:14.567905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb737b68-0f44-4fb5-8a96-5410f1dabfcb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:14.583135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-bb737b68-0f44-4fb5-8a96-5410f1dabfcb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 10:53:14.583135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:14.583135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:14.583135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:14.583135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:14.583135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:14.583135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:14.583135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:14.583135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 10:53:14.583135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:14.583135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:14.583135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:14.583135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:14.583135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:14.583135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:14.583135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:14.583135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:14.584270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:14.584270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:14.584270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:14.584270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:14.584270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:14.584270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:14.584270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:14.584270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:14.584270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:14.584270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:14.584270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:14.584270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:14.584270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:14.584270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:14.584270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:14.584270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:14.585263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:14.585263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:14.585263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:14.585263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:14.585263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:14.585263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:14.585263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:14.585263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:14.585263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:14.585263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:14.585263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:14.585263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:14.585263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 10:53:14.585263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:14.590670 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 522/1010] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:14.592208 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000fd97-968d-40f9-9afa-8118db0044e9 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:14.629165 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:14.665852 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56b0f2-2c55-4d5d-bbb5-295923e7ef02 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:14.666205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56b0f2-2c55-4d5d-bbb5-295923e7ef02 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:14.666403 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56b0f2-2c55-4d5d-bbb5-295923e7ef02 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:14.668047 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 523/1011] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:53:14.673539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74375a32-aedb-4097-a88c-83dc918b8f4f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:14.673915 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74375a32-aedb-4097-a88c-83dc918b8f4f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:14.674094 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74375a32-aedb-4097-a88c-83dc918b8f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:14.691785 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-74375a32-aedb-4097-a88c-83dc918b8f4f None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:14.693028 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-74375a32-aedb-4097-a88c-83dc918b8f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:14.704530 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000fd97-968d-40f9-9afa-8118db0044e9 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:14.748271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a146637-b7ed-47bd-8104-58c01c2f00dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:14.749193 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a146637-b7ed-47bd-8104-58c01c2f00dc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:14.749478 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a146637-b7ed-47bd-8104-58c01c2f00dc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:14.749849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a146637-b7ed-47bd-8104-58c01c2f00dc None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:14.750567 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a146637-b7ed-47bd-8104-58c01c2f00dc None admin] RBAC: Adding query filter params (name=compute) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:14.750882 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a146637-b7ed-47bd-8104-58c01c2f00dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:14.752276 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a146637-b7ed-47bd-8104-58c01c2f00dc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:14.758030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 489/1012] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 19 10:53:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:14.763644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a146637-b7ed-47bd-8104-58c01c2f00dc None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:14.773882 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 524/1013] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:14 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:14.800275 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74375a32-aedb-4097-a88c-83dc918b8f4f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:14.902029 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:14.908011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a146637-b7ed-47bd-8104-58c01c2f00dc None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:14.971393 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea0608-a496-42d6-a6b5-dde40b76179b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:14.972354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea0608-a496-42d6-a6b5-dde40b76179b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:14.972828 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea0608-a496-42d6-a6b5-dde40b76179b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:14.973264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea0608-a496-42d6-a6b5-dde40b76179b None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:14.974760 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea0608-a496-42d6-a6b5-dde40b76179b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:14.975233 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea0608-a496-42d6-a6b5-dde40b76179b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:14.977343 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea0608-a496-42d6-a6b5-dde40b76179b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:14.980011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:14.985583 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 490/1014] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 19 10:53:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:14.991553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74375a32-aedb-4097-a88c-83dc918b8f4f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:14.993396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea0608-a496-42d6-a6b5-dde40b76179b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:15.046922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ca9db-b314-4170-b170-c274f867838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:15.047662 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ca9db-b314-4170-b170-c274f867838c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:15.047963 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ca9db-b314-4170-b170-c274f867838c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:15.048206 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ca9db-b314-4170-b170-c274f867838c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:15.050383 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ca9db-b314-4170-b170-c274f867838c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:15.051864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ca9db-b314-4170-b170-c274f867838c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:15.053644 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 525/1015] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:15.059778 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ca9db-b314-4170-b170-c274f867838c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:15.149921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea0608-a496-42d6-a6b5-dde40b76179b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:15.201078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf5a28-a491-4d3f-87fa-522b8971ab24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:15.201964 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf5a28-a491-4d3f-87fa-522b8971ab24 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:15.202449 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf5a28-a491-4d3f-87fa-522b8971ab24 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:15.202931 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf5a28-a491-4d3f-87fa-522b8971ab24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:15.204282 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf5a28-a491-4d3f-87fa-522b8971ab24 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:15.205145 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ca9db-b314-4170-b170-c274f867838c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:15.207026 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf5a28-a491-4d3f-87fa-522b8971ab24 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:15.247256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 491/1016] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 19 10:53:14 2022] POST /identity/v3/endpoints => generated 334 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:53:15.254839 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1b54e-058c-46da-a6e0-0b49bd60e0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:15.255543 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1b54e-058c-46da-a6e0-0b49bd60e0a0 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:15.255816 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1b54e-058c-46da-a6e0-0b49bd60e0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:15.256344 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1b54e-058c-46da-a6e0-0b49bd60e0a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:15.257135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1b54e-058c-46da-a6e0-0b49bd60e0a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:15.258703 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1b54e-058c-46da-a6e0-0b49bd60e0a0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:15.304889 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 526/1017] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 19 10:53:15 2022] POST /identity/v3/projects => generated 311 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 10:53:15.541846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9de4f-ea70-4278-92f8-143295899373 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:15.542523 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9de4f-ea70-4278-92f8-143295899373 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:15.542523 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9de4f-ea70-4278-92f8-143295899373 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:15.544070 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 492/1018] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:15.550150 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390604c6-b980-47bc-8b1a-7d0a456ce4f5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:15.550456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390604c6-b980-47bc-8b1a-7d0a456ce4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:15.550698 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390604c6-b980-47bc-8b1a-7d0a456ce4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:15.578221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-390604c6-b980-47bc-8b1a-7d0a456ce4f5 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:15.585466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-390604c6-b980-47bc-8b1a-7d0a456ce4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:15.588116 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:15.717545 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 527/1019] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:15 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:15.740670 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9de4f-ea70-4278-92f8-143295899373 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:15.775140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:15.899012 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9de4f-ea70-4278-92f8-143295899373 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:15.946231 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5d9bc-8db5-4151-8b21-47fab2661838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:15.947442 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5d9bc-8db5-4151-8b21-47fab2661838 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:15.947989 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5d9bc-8db5-4151-8b21-47fab2661838 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:15.948491 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5d9bc-8db5-4151-8b21-47fab2661838 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:15.949744 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5d9bc-8db5-4151-8b21-47fab2661838 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:15.951571 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5d9bc-8db5-4151-8b21-47fab2661838 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:15.972628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 493/1020] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 19 10:53:15 2022] POST /identity/v3/services => generated 242 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:53:17.617130 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bfcb6-bfd2-45c4-99c0-342be5eba6c0 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:17.617945 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bfcb6-bfd2-45c4-99c0-342be5eba6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:17.617945 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bfcb6-bfd2-45c4-99c0-342be5eba6c0 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:17.619282 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 528/1021] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:53:17.624875 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e129f4c-b907-4d00-a5f9-f0eed892a664 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:17.625672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e129f4c-b907-4d00-a5f9-f0eed892a664 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:17.625672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e129f4c-b907-4d00-a5f9-f0eed892a664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:17.643198 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2e129f4c-b907-4d00-a5f9-f0eed892a664 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:17.644846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2e129f4c-b907-4d00-a5f9-f0eed892a664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:17.750714 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 494/1022] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:17.778792 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15bfcb6-bfd2-45c4-99c0-342be5eba6c0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:17.911116 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15bfcb6-bfd2-45c4-99c0-342be5eba6c0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:17.954654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a40a86-5f06-4884-82d7-e8ba4a310953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:17.956019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a40a86-5f06-4884-82d7-e8ba4a310953 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:17.956573 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a40a86-5f06-4884-82d7-e8ba4a310953 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:17.957081 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a40a86-5f06-4884-82d7-e8ba4a310953 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:17.958741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a40a86-5f06-4884-82d7-e8ba4a310953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:17.960475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a40a86-5f06-4884-82d7-e8ba4a310953 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:17.962546 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 529/1023] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:17.970250 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e129f4c-b907-4d00-a5f9-f0eed892a664 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:17.975238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:18.123333 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e129f4c-b907-4d00-a5f9-f0eed892a664 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:18.180937 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d79e4-c40d-4dd4-88f6-a961ec0c6030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:18.180937 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d79e4-c40d-4dd4-88f6-a961ec0c6030 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:18.180937 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d79e4-c40d-4dd4-88f6-a961ec0c6030 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:18.180937 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d79e4-c40d-4dd4-88f6-a961ec0c6030 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:18.181640 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d79e4-c40d-4dd4-88f6-a961ec0c6030 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:18.181640 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d79e4-c40d-4dd4-88f6-a961ec0c6030 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:18.216761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 495/1024] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 19 10:53:17 2022] POST /identity/v3/users => generated 285 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:53:18.285525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1f2d5-a395-4f9a-a0ba-022b6e4c8e75 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:18.285945 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1f2d5-a395-4f9a-a0ba-022b6e4c8e75 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:18.286364 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1f2d5-a395-4f9a-a0ba-022b6e4c8e75 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:18.288775 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 530/1025] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:18.296597 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1722c-99ad-467e-a007-85172781c701 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:18.296934 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1722c-99ad-467e-a007-85172781c701 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:18.297272 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1722c-99ad-467e-a007-85172781c701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:18.320541 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d6e1722c-99ad-467e-a007-85172781c701 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:18.322039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d6e1722c-99ad-467e-a007-85172781c701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:18.407204 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:18.428779 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 496/1026] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:18.466377 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1f2d5-a395-4f9a-a0ba-022b6e4c8e75 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:18.481011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:18.632776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1f2d5-a395-4f9a-a0ba-022b6e4c8e75 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:18.678756 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9eadee-e9eb-4448-8504-314614b77677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:18.679463 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9eadee-e9eb-4448-8504-314614b77677 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:18.679746 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9eadee-e9eb-4448-8504-314614b77677 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:18.680013 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9eadee-e9eb-4448-8504-314614b77677 None admin] PATH_INFO: `/v3/services/image` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:18.680701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9eadee-e9eb-4448-8504-314614b77677 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:18.682148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9eadee-e9eb-4448-8504-314614b77677 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:18.694946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-af9eadee-e9eb-4448-8504-314614b77677 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 10:53:18.694946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:18.694946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:18.694946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:18.694946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:18.694946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:18.694946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:18.694946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:18.694946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 10:53:18.694946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:18.694946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:18.694946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:18.694946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:18.694946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:18.694946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:18.694946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:18.694946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:18.696985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:18.696985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:18.696985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:18.696985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:18.696985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:18.696985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:18.696985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:18.696985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:18.696985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:18.696985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:18.696985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:18.696985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:18.696985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:18.696985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:18.696985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:18.696985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:18.698694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:18.698694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:18.698694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:18.698694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:18.698694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:18.698694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:18.698694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:18.698694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:18.698694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:18.698694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:18.698694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:18.698694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:18.698694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 10:53:18.698694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:18.698694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 531/1027] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Jul 19 10:53:18 2022] GET /identity/v3/services/image => generated 86 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:18.708747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a5ba5-ab54-4d90-aaa4-596b4a458393 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:18.708747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a5ba5-ab54-4d90-aaa4-596b4a458393 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:18.708747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a5ba5-ab54-4d90-aaa4-596b4a458393 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:18.710484 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 497/1028] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:18.711375 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9eadee-e9eb-4448-8504-314614b77677 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:18.715084 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733facf-51c2-4942-8eb3-315ee922217d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:18.715535 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733facf-51c2-4942-8eb3-315ee922217d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:18.715774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733facf-51c2-4942-8eb3-315ee922217d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:18.733922 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5733facf-51c2-4942-8eb3-315ee922217d None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:18.735119 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5733facf-51c2-4942-8eb3-315ee922217d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:18.798138 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:18.814647 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 498/1029] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:18.837256 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9eadee-e9eb-4448-8504-314614b77677 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:18.838276 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733facf-51c2-4942-8eb3-315ee922217d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:18.879761 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5d6a2-53ba-463b-820b-eea783ee16e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:18.880460 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5d6a2-53ba-463b-820b-eea783ee16e0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:18.880758 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5d6a2-53ba-463b-820b-eea783ee16e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:18.881014 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5d6a2-53ba-463b-820b-eea783ee16e0 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:18.881733 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5d6a2-53ba-463b-820b-eea783ee16e0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:18.882031 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5d6a2-53ba-463b-820b-eea783ee16e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:18.883541 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5d6a2-53ba-463b-820b-eea783ee16e0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:18.890047 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 532/1030] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:18.895723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5d6a2-53ba-463b-820b-eea783ee16e0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:18.964136 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733facf-51c2-4942-8eb3-315ee922217d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:19.002779 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:19.012463 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5d6a2-53ba-463b-820b-eea783ee16e0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:19.028933 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d2eb6-9f22-4b00-aa8f-8ebe1e3b106e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:19.030298 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d2eb6-9f22-4b00-aa8f-8ebe1e3b106e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:19.030787 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d2eb6-9f22-4b00-aa8f-8ebe1e3b106e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:19.031282 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d2eb6-9f22-4b00-aa8f-8ebe1e3b106e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:19.051414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d2eb6-9f22-4b00-aa8f-8ebe1e3b106e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:19.053497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb3848-16f8-4077-bb4f-6392d86b65c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:19.054175 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb3848-16f8-4077-bb4f-6392d86b65c5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:19.054452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb3848-16f8-4077-bb4f-6392d86b65c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:19.054721 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb3848-16f8-4077-bb4f-6392d86b65c5 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:19.055437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb3848-16f8-4077-bb4f-6392d86b65c5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:19.055794 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb3848-16f8-4077-bb4f-6392d86b65c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:19.057232 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb3848-16f8-4077-bb4f-6392d86b65c5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:19.059675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:19.067842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-081d2eb6-9f22-4b00-aa8f-8ebe1e3b106e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:53:19.067842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:19.067842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:19.067842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:19.067842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:19.067842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:19.067842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:19.067842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:19.067842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:19.067842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:19.067842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:19.067842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:19.067842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:19.067842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:19.067842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:19.067842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:19.069652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:19.069652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:19.069652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:19.069652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:19.069652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:19.069652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:19.069652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:19.069652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:19.069652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:19.069652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:19.069652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:19.069652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:19.069652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:19.069652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:19.069652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:19.069652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:19.071252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:19.071252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:19.071252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:19.071252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:19.071252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:19.071252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:19.071252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:19.071252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:19.071252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:19.071252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:19.071252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:53:19.071252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:19.072489 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 533/1031] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:19.072489 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb3848-16f8-4077-bb4f-6392d86b65c5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:19.074082 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 499/1032] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jul 19 10:53:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:19.076590 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d2eb6-9f22-4b00-aa8f-8ebe1e3b106e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:19.252509 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d2eb6-9f22-4b00-aa8f-8ebe1e3b106e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:19.263910 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb3848-16f8-4077-bb4f-6392d86b65c5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:19.309316 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c218b9f-f5f3-436f-86d4-491d13663b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:19.310012 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c218b9f-f5f3-436f-86d4-491d13663b6b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:19.310315 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c218b9f-f5f3-436f-86d4-491d13663b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:19.310552 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c218b9f-f5f3-436f-86d4-491d13663b6b None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:19.311314 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c218b9f-f5f3-436f-86d4-491d13663b6b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:19.311617 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c218b9f-f5f3-436f-86d4-491d13663b6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:19.313075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c218b9f-f5f3-436f-86d4-491d13663b6b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:19.323100 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 500/1033] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jul 19 10:53:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:19.329131 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c218b9f-f5f3-436f-86d4-491d13663b6b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:19.330689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a870c-376f-4c5d-aa43-d44bbf05bb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:19.331831 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a870c-376f-4c5d-aa43-d44bbf05bb0d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:19.332360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a870c-376f-4c5d-aa43-d44bbf05bb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:19.332856 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a870c-376f-4c5d-aa43-d44bbf05bb0d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:19.334419 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a870c-376f-4c5d-aa43-d44bbf05bb0d None admin] RBAC: Adding query filter params (interface=public, service_id=a3529743bb324acf913434e8d2994ece, region_id=RegionOne) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:19.334975 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a870c-376f-4c5d-aa43-d44bbf05bb0d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:19.337663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a870c-376f-4c5d-aa43-d44bbf05bb0d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:19.355993 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 534/1034] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jul 19 10:53:19 2022] GET /identity/v3/endpoints?service_id=a3529743bb324acf913434e8d2994ece&interface=public®ion_id=RegionOne => generated 194 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:19.357392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a870c-376f-4c5d-aa43-d44bbf05bb0d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:19.404503 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:19.476166 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:19.496975 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c218b9f-f5f3-436f-86d4-491d13663b6b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:19.538957 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c663e-b58f-4a8e-9274-72e08f9a602a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:19.539956 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c663e-b58f-4a8e-9274-72e08f9a602a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:19.540358 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c663e-b58f-4a8e-9274-72e08f9a602a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:19.540856 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c663e-b58f-4a8e-9274-72e08f9a602a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:19.554515 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c663e-b58f-4a8e-9274-72e08f9a602a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:19.556434 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c663e-b58f-4a8e-9274-72e08f9a602a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:19.561339 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a870c-376f-4c5d-aa43-d44bbf05bb0d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:19.584271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-407c663e-b58f-4a8e-9274-72e08f9a602a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:19.584271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:19.584271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:19.584271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:19.584271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:19.584271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:19.584271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:19.584271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:19.584271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:19.584271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:19.584271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:19.584271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:19.584271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:19.584271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:19.584271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:19.585340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:19.585340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:19.585340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:19.585340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:19.585340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:19.585340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:19.585340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:19.585340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:19.585340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:19.585340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:19.585340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:19.585340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:19.585340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:19.585340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:19.585340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:19.585340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:19.585340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:19.586274 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:19.586274 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:19.586274 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:19.586274 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:19.592369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 501/1035] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:19.594069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c663e-b58f-4a8e-9274-72e08f9a602a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:19.622130 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe916071-c5ad-423a-bfb7-01f808a8c7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:19.623181 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe916071-c5ad-423a-bfb7-01f808a8c7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:19.623630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe916071-c5ad-423a-bfb7-01f808a8c7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:19.624076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe916071-c5ad-423a-bfb7-01f808a8c7f2 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:19.625124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe916071-c5ad-423a-bfb7-01f808a8c7f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:19.626648 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe916071-c5ad-423a-bfb7-01f808a8c7f2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:19.635338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 535/1036] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 19 10:53:19 2022] GET /identity/v3/services => generated 1957 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 10:53:19.764284 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:19.774461 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c663e-b58f-4a8e-9274-72e08f9a602a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:19.816276 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1b007-ecdb-4985-800b-da3c630991e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:19.817103 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1b007-ecdb-4985-800b-da3c630991e9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:19.817511 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1b007-ecdb-4985-800b-da3c630991e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:19.817920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1b007-ecdb-4985-800b-da3c630991e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:19.818875 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1b007-ecdb-4985-800b-da3c630991e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:19.819314 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1b007-ecdb-4985-800b-da3c630991e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:19.820927 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1b007-ecdb-4985-800b-da3c630991e9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:19.841023 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 502/1037] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:19.842950 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe916071-c5ad-423a-bfb7-01f808a8c7f2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:19.998944 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe916071-c5ad-423a-bfb7-01f808a8c7f2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:20.033606 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:20.044515 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067eaf5-019f-44ca-b4be-b060f193cb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:20.045371 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067eaf5-019f-44ca-b4be-b060f193cb0a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:20.045642 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067eaf5-019f-44ca-b4be-b060f193cb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:20.045922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067eaf5-019f-44ca-b4be-b060f193cb0a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:20.055199 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067eaf5-019f-44ca-b4be-b060f193cb0a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:20.056676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067eaf5-019f-44ca-b4be-b060f193cb0a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:20.072601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-0067eaf5-019f-44ca-b4be-b060f193cb0a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:53:20.072601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:20.072601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:20.072601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:20.072601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:20.072601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:20.072601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:20.072601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:20.072601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:20.072601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:20.072601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:20.072601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:20.072601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:20.072601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:20.072601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:20.072601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:20.073929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:20.073929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:20.073929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:20.073929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:20.073929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:20.073929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:20.073929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:20.073929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:20.073929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:20.073929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:20.073929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:20.073929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:20.073929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:20.073929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:20.073929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:20.073929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:20.073929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:20.073929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:20.075154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:20.075154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:20.075154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:20.075154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:20.075154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:20.075154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:20.075154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:20.075154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:20.075154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:53:20.075154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:20.076655 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 536/1038] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 19 10:53:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:20.081277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1b007-ecdb-4985-800b-da3c630991e9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:20.248733 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1b007-ecdb-4985-800b-da3c630991e9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:20.301106 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2ea2a-9410-44c9-ad8d-65f7e4a8702d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:20.301811 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2ea2a-9410-44c9-ad8d-65f7e4a8702d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:20.302073 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2ea2a-9410-44c9-ad8d-65f7e4a8702d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:20.302352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2ea2a-9410-44c9-ad8d-65f7e4a8702d None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:20.303252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2ea2a-9410-44c9-ad8d-65f7e4a8702d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:20.303572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2ea2a-9410-44c9-ad8d-65f7e4a8702d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:20.305077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2ea2a-9410-44c9-ad8d-65f7e4a8702d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:20.332206 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 503/1039] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 19 10:53:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:20.334577 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067eaf5-019f-44ca-b4be-b060f193cb0a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:20.534838 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067eaf5-019f-44ca-b4be-b060f193cb0a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:20.576338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631f9bd-2b43-43ae-b705-0981cf6e39bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:20.577057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631f9bd-2b43-43ae-b705-0981cf6e39bb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:20.577340 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631f9bd-2b43-43ae-b705-0981cf6e39bb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:20.577618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631f9bd-2b43-43ae-b705-0981cf6e39bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:20.639040 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:20.654046 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631f9bd-2b43-43ae-b705-0981cf6e39bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:20.655507 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631f9bd-2b43-43ae-b705-0981cf6e39bb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:20.757692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2b6cd-1bf2-4c09-af49-6811b0ba2d94 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:20.757971 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2b6cd-1bf2-4c09-af49-6811b0ba2d94 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:20.758262 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2b6cd-1bf2-4c09-af49-6811b0ba2d94 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:20.759848 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 504/1040] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:53:20.765800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417f28f-fd86-4114-9c06-d9316f41cf7b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:20.766522 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417f28f-fd86-4114-9c06-d9316f41cf7b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:20.766522 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417f28f-fd86-4114-9c06-d9316f41cf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:20.787155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-0417f28f-fd86-4114-9c06-d9316f41cf7b None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:20.788349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0417f28f-fd86-4114-9c06-d9316f41cf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:20.788837 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 537/1041] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:20 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:53:20.794037 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631f9bd-2b43-43ae-b705-0981cf6e39bb None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:20.798972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:20.899479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:20.908754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 505/1042] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:20.919227 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631f9bd-2b43-43ae-b705-0981cf6e39bb None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:20.944793 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417f28f-fd86-4114-9c06-d9316f41cf7b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:20.956515 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e24b5-e4f5-4558-b6d3-415e3524a826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:20.957353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e24b5-e4f5-4558-b6d3-415e3524a826 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:20.957640 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e24b5-e4f5-4558-b6d3-415e3524a826 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:20.957907 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e24b5-e4f5-4558-b6d3-415e3524a826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:20.969079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e24b5-e4f5-4558-b6d3-415e3524a826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:20.970469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e24b5-e4f5-4558-b6d3-415e3524a826 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:20.989692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-f04e24b5-e4f5-4558-b6d3-415e3524a826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:20.989692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:20.989692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:20.989692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:20.989692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:20.989692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:20.989692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:20.989692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:20.989692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:20.989692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:20.989692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:20.989692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:20.989692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:20.989692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:20.989692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:20.990750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:20.990750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:20.990750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:20.990750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:20.990750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:20.990750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:20.990750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:20.990750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:20.990750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:20.990750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:20.990750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:20.990750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:20.990750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:20.990750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:20.990750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:20.990750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:20.990750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:20.991701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:20.991701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:20.991701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:20.991701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:20.991701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 538/1043] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:20.998475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e24b5-e4f5-4558-b6d3-415e3524a826 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:21.101498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417f28f-fd86-4114-9c06-d9316f41cf7b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:21.140869 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e24b5-e4f5-4558-b6d3-415e3524a826 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:21.141422 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db2bf5-003a-4024-adc8-1eb67012c772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:21.142254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db2bf5-003a-4024-adc8-1eb67012c772 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:21.142535 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db2bf5-003a-4024-adc8-1eb67012c772 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:21.142876 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db2bf5-003a-4024-adc8-1eb67012c772 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:21.155664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db2bf5-003a-4024-adc8-1eb67012c772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:21.163550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-c8db2bf5-003a-4024-adc8-1eb67012c772 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:21.163550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:21.163550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:21.163550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:21.163550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:21.163550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:21.163550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:21.163550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:21.163550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:21.163550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:21.163550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:21.163550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:21.163550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:21.163550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:21.163550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:21.163550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:21.164592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:21.164592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:21.164592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:21.164592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:21.164592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:21.164592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:21.164592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:21.164592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:21.164592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:21.164592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:21.164592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:21.164592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:21.164592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:21.164592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:21.164592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:21.164592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:21.165797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:21.165797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:21.165797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:21.165797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:21.165797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:21.165797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:21.165797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:21.165797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:21.165797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:21.165797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:21.165797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:21.165797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:21.165797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 506/1044] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:53:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:21.171234 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db2bf5-003a-4024-adc8-1eb67012c772 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:21.174359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:21.205295 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e350d-1121-4aa3-bdc4-674aa805bcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:21.206348 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e350d-1121-4aa3-bdc4-674aa805bcf2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:21.206818 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e350d-1121-4aa3-bdc4-674aa805bcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:21.207284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e350d-1121-4aa3-bdc4-674aa805bcf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:21.208223 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e350d-1121-4aa3-bdc4-674aa805bcf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:21.208747 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e350d-1121-4aa3-bdc4-674aa805bcf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:21.211212 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e350d-1121-4aa3-bdc4-674aa805bcf2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:21.228468 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:21.237496 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 539/1045] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:21.239627 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e350d-1121-4aa3-bdc4-674aa805bcf2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:21.345372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db2bf5-003a-4024-adc8-1eb67012c772 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:21.367147 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e350d-1121-4aa3-bdc4-674aa805bcf2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:21.397577 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff828e3-1468-4f4d-9508-116234025747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:21.398260 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff828e3-1468-4f4d-9508-116234025747 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:21.398540 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff828e3-1468-4f4d-9508-116234025747 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:21.398812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff828e3-1468-4f4d-9508-116234025747 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:21.399571 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff828e3-1468-4f4d-9508-116234025747 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:21.399871 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff828e3-1468-4f4d-9508-116234025747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:21.401326 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff828e3-1468-4f4d-9508-116234025747 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:21.414965 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 507/1046] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:53:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:21.418405 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b9d65-51ed-471f-a83e-b9a2412c68e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:21.419269 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b9d65-51ed-471f-a83e-b9a2412c68e5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:21.419603 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b9d65-51ed-471f-a83e-b9a2412c68e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:21.419916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b9d65-51ed-471f-a83e-b9a2412c68e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:21.429470 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff828e3-1468-4f4d-9508-116234025747 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:21.429730 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b9d65-51ed-471f-a83e-b9a2412c68e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:21.430189 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b9d65-51ed-471f-a83e-b9a2412c68e5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:21.445508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-3a1b9d65-51ed-471f-a83e-b9a2412c68e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:21.445508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:21.445508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:21.445508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:21.445508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:21.445508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:21.445508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:21.445508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:21.445508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:21.445508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:21.445508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:21.445508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:21.445508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:21.445508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:21.445508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:21.447432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:21.447432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:21.447432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:21.447432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:21.447432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:21.447432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:21.447432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:21.447432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:21.447432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:21.447432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:21.447432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:21.447432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:21.447432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:21.447432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:21.447432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:21.447432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:21.447432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:21.448953 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:21.448953 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:21.448953 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:21.448953 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:21.448953 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:21.448953 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:21.448953 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:21.448953 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:21.448953 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 540/1047] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:21.455933 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b9d65-51ed-471f-a83e-b9a2412c68e5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:21.531751 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:21.532404 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:21.584440 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff828e3-1468-4f4d-9508-116234025747 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:21.599176 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b9d65-51ed-471f-a83e-b9a2412c68e5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:21.638116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51114c18-f37b-4a16-b19f-9e0c020543f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:21.639727 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51114c18-f37b-4a16-b19f-9e0c020543f9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:21.640122 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51114c18-f37b-4a16-b19f-9e0c020543f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:21.640493 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51114c18-f37b-4a16-b19f-9e0c020543f9 None admin] PATH_INFO: `/v3/users/5441d6dfdd7d4cfca19aaec639eca0e8` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:21.660661 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b783b-1a20-41f2-8ae7-12cf04956c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:21.661859 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b783b-1a20-41f2-8ae7-12cf04956c82 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:21.662348 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b783b-1a20-41f2-8ae7-12cf04956c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:21.662825 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b783b-1a20-41f2-8ae7-12cf04956c82 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:21.664297 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b783b-1a20-41f2-8ae7-12cf04956c82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:21.664933 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b783b-1a20-41f2-8ae7-12cf04956c82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:21.665889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51114c18-f37b-4a16-b19f-9e0c020543f9 None admin] RBAC: Authorizing `identity:get_user(user_id=5441d6dfdd7d4cfca19aaec639eca0e8)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:21.667683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b783b-1a20-41f2-8ae7-12cf04956c82 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:21.669155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51114c18-f37b-4a16-b19f-9e0c020543f9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:21.673397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 508/1048] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:53:21 2022] GET /identity/v3/users/5441d6dfdd7d4cfca19aaec639eca0e8 => generated 285 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:21.682300 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51114c18-f37b-4a16-b19f-9e0c020543f9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:21.688178 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 541/1049] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:21.694599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b783b-1a20-41f2-8ae7-12cf04956c82 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:21.828319 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b783b-1a20-41f2-8ae7-12cf04956c82 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:21.829568 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51114c18-f37b-4a16-b19f-9e0c020543f9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:21.851620 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:21.856695 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:21.867663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f57780-0162-4c1f-8ede-1191a7856f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:21.868337 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f57780-0162-4c1f-8ede-1191a7856f22 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:21.868689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f57780-0162-4c1f-8ede-1191a7856f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:21.868967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f57780-0162-4c1f-8ede-1191a7856f22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:21.869750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f57780-0162-4c1f-8ede-1191a7856f22 None admin] RBAC: Adding query filter params (role.id=2b15d93fb65247dd8f0cc3f8a905fb38, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=3c50a821e9ef44cb9fccd49ee4af7dbf) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:21.870059 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f57780-0162-4c1f-8ede-1191a7856f22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:21.871512 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f57780-0162-4c1f-8ede-1191a7856f22 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:21.872646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4060d1-9aa7-44ed-8202-5444b68381a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:21.873614 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4060d1-9aa7-44ed-8202-5444b68381a6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:21.873873 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4060d1-9aa7-44ed-8202-5444b68381a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:21.874238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4060d1-9aa7-44ed-8202-5444b68381a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:21.877985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 542/1050] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:21 2022] GET /identity/v3/role_assignments?user.id=3c50a821e9ef44cb9fccd49ee4af7dbf&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=2b15d93fb65247dd8f0cc3f8a905fb38 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:21.879377 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327b344-1d66-47df-8cc9-6eef51edd4dc None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:21.879662 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327b344-1d66-47df-8cc9-6eef51edd4dc None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:21.879935 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327b344-1d66-47df-8cc9-6eef51edd4dc None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:21.881288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 543/1051] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:21.887309 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831f112-1ae9-4d74-8db8-7d202d4ac57e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:21.887563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831f112-1ae9-4d74-8db8-7d202d4ac57e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:21.887817 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831f112-1ae9-4d74-8db8-7d202d4ac57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:21.906526 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a831f112-1ae9-4d74-8db8-7d202d4ac57e None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:21.907757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a831f112-1ae9-4d74-8db8-7d202d4ac57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:21.988516 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4060d1-9aa7-44ed-8202-5444b68381a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:21.990295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4060d1-9aa7-44ed-8202-5444b68381a6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:22.028209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 544/1052] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:22.052186 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831f112-1ae9-4d74-8db8-7d202d4ac57e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:22.136747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 509/1053] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:21 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:53:22.141265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4060d1-9aa7-44ed-8202-5444b68381a6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:22.170651 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:22.190747 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831f112-1ae9-4d74-8db8-7d202d4ac57e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:22.212379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:22.250793 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d15588-4ef6-418a-9a97-d3e27d58e429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:22.252085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d15588-4ef6-418a-9a97-d3e27d58e429 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:22.252313 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d15588-4ef6-418a-9a97-d3e27d58e429 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:22.252665 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d15588-4ef6-418a-9a97-d3e27d58e429 None admin] PATH_INFO: `/v3/services/image` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:22.253752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d15588-4ef6-418a-9a97-d3e27d58e429 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:22.255355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d15588-4ef6-418a-9a97-d3e27d58e429 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:22.268667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-20d15588-4ef6-418a-9a97-d3e27d58e429 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 10:53:22.268667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:22.268667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:22.268667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:22.268667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:22.268667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:22.268667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:22.268667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:22.268667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 10:53:22.268667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:22.268667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:22.268667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:22.268667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:22.268667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:22.268667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:22.268667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:22.268667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:22.269795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:22.269795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:22.269795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:22.269795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:22.269795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:22.269795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:22.269795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:22.269795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:22.269795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:22.269795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:22.269795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:22.269795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:22.269795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:22.269795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:22.269795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:22.269795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:22.276474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:22.276474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:22.276474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:22.276474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:22.276474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:22.276474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:22.276474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:22.276474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:22.276474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:22.276474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:22.276474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:22.276474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:22.276474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 10:53:22.276474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:22.277523 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4060d1-9aa7-44ed-8202-5444b68381a6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:22.277615 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 545/1054] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Jul 19 10:53:22 2022] GET /identity/v3/services/image => generated 86 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:22.277615 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d15588-4ef6-418a-9a97-d3e27d58e429 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:22.319625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaac12f-47f7-4e32-9c8c-fac0b26d31ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:22.320501 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaac12f-47f7-4e32-9c8c-fac0b26d31ec None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:22.320871 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaac12f-47f7-4e32-9c8c-fac0b26d31ec None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:22.321067 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaac12f-47f7-4e32-9c8c-fac0b26d31ec None admin] PATH_INFO: `/v3/projects/e0adb1b85fc744bbb4f93fa370a7436c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:22.322275 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaac12f-47f7-4e32-9c8c-fac0b26d31ec None admin] RBAC: Authorizing `identity:get_project(project_id=e0adb1b85fc744bbb4f93fa370a7436c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:22.323740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaac12f-47f7-4e32-9c8c-fac0b26d31ec None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:22.325546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 510/1055] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:53:22 2022] GET /identity/v3/projects/e0adb1b85fc744bbb4f93fa370a7436c => generated 311 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:22.334959 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaac12f-47f7-4e32-9c8c-fac0b26d31ec None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:22.437181 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d15588-4ef6-418a-9a97-d3e27d58e429 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:22.479870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:22.489345 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366bba0-7241-4e04-bc36-4e2e8067e6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:22.490256 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366bba0-7241-4e04-bc36-4e2e8067e6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:22.490546 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366bba0-7241-4e04-bc36-4e2e8067e6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:22.490936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366bba0-7241-4e04-bc36-4e2e8067e6f9 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:22.491748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366bba0-7241-4e04-bc36-4e2e8067e6f9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:22.492066 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366bba0-7241-4e04-bc36-4e2e8067e6f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:22.493170 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaac12f-47f7-4e32-9c8c-fac0b26d31ec None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:22.494008 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366bba0-7241-4e04-bc36-4e2e8067e6f9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:22.501947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 546/1056] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:22.509189 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366bba0-7241-4e04-bc36-4e2e8067e6f9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:22.546618 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e0a1e-de44-4540-83d9-885a8e4cd894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:22.547694 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e0a1e-de44-4540-83d9-885a8e4cd894 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:22.548221 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e0a1e-de44-4540-83d9-885a8e4cd894 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:22.548780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e0a1e-de44-4540-83d9-885a8e4cd894 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:22.550144 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e0a1e-de44-4540-83d9-885a8e4cd894 None admin] RBAC: Adding query filter params (role.id=3f9528e7a7914797a4635aa6b536b7ff, scope.project.id=e0adb1b85fc744bbb4f93fa370a7436c, user.id=5441d6dfdd7d4cfca19aaec639eca0e8) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:22.550657 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e0a1e-de44-4540-83d9-885a8e4cd894 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:22.553177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e0a1e-de44-4540-83d9-885a8e4cd894 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:22.572773 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 511/1057] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:22 2022] GET /identity/v3/role_assignments?user.id=5441d6dfdd7d4cfca19aaec639eca0e8&scope.project.id=e0adb1b85fc744bbb4f93fa370a7436c&role.id=3f9528e7a7914797a4635aa6b536b7ff => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:22.584839 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:22.683055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366bba0-7241-4e04-bc36-4e2e8067e6f9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:22.745993 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660b007-1b63-479f-b408-9101efa589e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:22.747118 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660b007-1b63-479f-b408-9101efa589e6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:22.747612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660b007-1b63-479f-b408-9101efa589e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:22.748113 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660b007-1b63-479f-b408-9101efa589e6 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:22.750376 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660b007-1b63-479f-b408-9101efa589e6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:22.750376 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660b007-1b63-479f-b408-9101efa589e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:22.754556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660b007-1b63-479f-b408-9101efa589e6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:22.764777 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 547/1058] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:22.768738 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e0a1e-de44-4540-83d9-885a8e4cd894 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:22.916649 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e0a1e-de44-4540-83d9-885a8e4cd894 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:22.956803 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001026a9-2391-4666-af89-b89d7a0658c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:22.957478 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001026a9-2391-4666-af89-b89d7a0658c7 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:22.957757 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001026a9-2391-4666-af89-b89d7a0658c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:22.958027 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001026a9-2391-4666-af89-b89d7a0658c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:22.959074 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001026a9-2391-4666-af89-b89d7a0658c7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:22.960494 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001026a9-2391-4666-af89-b89d7a0658c7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:22.983829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 512/1059] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 19 10:53:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:53:24.283326 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a342f-12cb-4b31-a65a-13e8b5f0c589 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:24.284120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a342f-12cb-4b31-a65a-13e8b5f0c589 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:24.284214 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a342f-12cb-4b31-a65a-13e8b5f0c589 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:24.286712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 548/1060] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:24.295883 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ff46f-07f9-44a6-a8ba-99de15947989 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:24.296640 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ff46f-07f9-44a6-a8ba-99de15947989 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:24.296911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ff46f-07f9-44a6-a8ba-99de15947989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:24.324777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-822ff46f-07f9-44a6-a8ba-99de15947989 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:24.326831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-822ff46f-07f9-44a6-a8ba-99de15947989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:24.333169 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:24.456797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 513/1061] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:24.487172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a342f-12cb-4b31-a65a-13e8b5f0c589 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:24.626729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a342f-12cb-4b31-a65a-13e8b5f0c589 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:24.634439 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:24.666452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce5145-311c-4ac0-a560-1e886e0319d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:24.667330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce5145-311c-4ac0-a560-1e886e0319d6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:24.667601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce5145-311c-4ac0-a560-1e886e0319d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:24.667881 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce5145-311c-4ac0-a560-1e886e0319d6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:24.679538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce5145-311c-4ac0-a560-1e886e0319d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:24.687835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-71ce5145-311c-4ac0-a560-1e886e0319d6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:53:24.687835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:24.687835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:24.687835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:24.687835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:24.687835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:24.687835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:24.687835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:24.687835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:24.687835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:24.687835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:24.687835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:24.687835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:24.687835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:24.687835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:24.687835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:24.689391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:24.689391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:24.689391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:24.689391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:24.689391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:24.689391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:24.689391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:24.689391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:24.689391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:24.689391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:24.689391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:24.689391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:24.689391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:24.689391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:24.689391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:24.689391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:24.691082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:24.691082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:24.691082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:24.691082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:24.691082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:24.691082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:24.691082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:24.691082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:24.691082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:24.691082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:24.691082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:53:24.691082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:24.699254 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 549/1062] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jul 19 10:53:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:24.699605 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ff46f-07f9-44a6-a8ba-99de15947989 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:24.750459 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca050d-c9e3-4461-9e8b-85a0fa8ab483 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:24.750739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca050d-c9e3-4461-9e8b-85a0fa8ab483 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:24.751087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca050d-c9e3-4461-9e8b-85a0fa8ab483 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:24.752692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 550/1063] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:53:24.757979 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e186dce-6ed1-4c67-8d47-7b20a12c01f0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:24.758257 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e186dce-6ed1-4c67-8d47-7b20a12c01f0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:24.758534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e186dce-6ed1-4c67-8d47-7b20a12c01f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:24.776581 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1e186dce-6ed1-4c67-8d47-7b20a12c01f0 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:24.777828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1e186dce-6ed1-4c67-8d47-7b20a12c01f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:24.856659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 551/1064] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:24.864294 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ff46f-07f9-44a6-a8ba-99de15947989 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:24.880676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e186dce-6ed1-4c67-8d47-7b20a12c01f0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:24.923331 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c058af8-3b42-4f84-9b13-36f44a502cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:24.924038 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c058af8-3b42-4f84-9b13-36f44a502cdf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:24.924323 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c058af8-3b42-4f84-9b13-36f44a502cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:24.924604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c058af8-3b42-4f84-9b13-36f44a502cdf None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:24.925402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c058af8-3b42-4f84-9b13-36f44a502cdf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:24.925702 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c058af8-3b42-4f84-9b13-36f44a502cdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:24.927115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c058af8-3b42-4f84-9b13-36f44a502cdf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:24.930617 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:24.949725 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 514/1065] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jul 19 10:53:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:24.951052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c058af8-3b42-4f84-9b13-36f44a502cdf None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:25.014530 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:25.022666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e186dce-6ed1-4c67-8d47-7b20a12c01f0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:25.063284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cf267-53a0-4dad-a355-183443731d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:25.064087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cf267-53a0-4dad-a355-183443731d4e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:25.064441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cf267-53a0-4dad-a355-183443731d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:25.064707 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cf267-53a0-4dad-a355-183443731d4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:25.084419 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95cf267-53a0-4dad-a355-183443731d4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:25.098729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-f95cf267-53a0-4dad-a355-183443731d4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:25.098729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:25.098729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:25.098729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:25.098729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:25.098729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:25.098729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:25.098729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:25.098729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:25.098729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:25.098729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:25.098729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:25.098729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:25.098729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:25.098729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:25.098729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:25.100410 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:25.100410 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:25.100410 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:25.100410 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:25.100410 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:25.100410 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:25.100410 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:25.100410 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:25.100410 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:25.100410 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:25.100410 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:25.100410 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:25.100410 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:25.100410 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:25.100410 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:25.100410 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:25.108507 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:25.108507 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:25.108507 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:25.108507 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:25.108507 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:25.108507 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:25.108507 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:25.108507 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:25.108507 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:25.108507 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:25.108507 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:25.108507 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:25.108507 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 552/1066] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:53:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:25.112270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cf267-53a0-4dad-a355-183443731d4e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:25.115099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c058af8-3b42-4f84-9b13-36f44a502cdf None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:25.168855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc5fba-3252-4752-9860-4c85b5b56b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:25.170123 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc5fba-3252-4752-9860-4c85b5b56b3b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:25.170625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc5fba-3252-4752-9860-4c85b5b56b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:25.171137 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc5fba-3252-4752-9860-4c85b5b56b3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:25.191117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc5fba-3252-4752-9860-4c85b5b56b3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:25.194393 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc5fba-3252-4752-9860-4c85b5b56b3b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:25.227157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-6fcc5fba-3252-4752-9860-4c85b5b56b3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:25.227157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:25.227157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:25.227157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:25.227157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:25.227157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:25.227157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:25.227157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:25.227157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:25.227157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:25.227157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:25.227157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:25.227157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:25.227157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:25.227157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:25.228691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:25.228691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:25.228691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:25.228691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:25.228691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:25.228691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:25.228691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:25.228691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:25.228691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:25.228691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:25.228691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:25.228691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:25.228691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:25.228691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:25.228691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:25.228691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:25.228691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:25.230881 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:25.230881 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:25.230881 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:25.230881 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:25.230881 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 515/1067] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:25.234977 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc5fba-3252-4752-9860-4c85b5b56b3b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:25.239807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cf267-53a0-4dad-a355-183443731d4e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:25.299523 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f63ed-7f96-4428-a2f1-521099f0a833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:25.300602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f63ed-7f96-4428-a2f1-521099f0a833 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:25.301140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f63ed-7f96-4428-a2f1-521099f0a833 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:25.301591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f63ed-7f96-4428-a2f1-521099f0a833 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:25.302894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f63ed-7f96-4428-a2f1-521099f0a833 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:25.303411 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f63ed-7f96-4428-a2f1-521099f0a833 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:25.305521 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:25.306000 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f63ed-7f96-4428-a2f1-521099f0a833 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:25.328827 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 553/1068] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:53:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:25.335651 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f63ed-7f96-4428-a2f1-521099f0a833 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:25.375332 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:25.390521 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc5fba-3252-4752-9860-4c85b5b56b3b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:25.440786 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce5feb-781b-4a35-8c4f-5f801a7c0389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:25.440786 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce5feb-781b-4a35-8c4f-5f801a7c0389 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:25.440786 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce5feb-781b-4a35-8c4f-5f801a7c0389 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:25.441185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce5feb-781b-4a35-8c4f-5f801a7c0389 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:25.443149 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce5feb-781b-4a35-8c4f-5f801a7c0389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:25.443482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce5feb-781b-4a35-8c4f-5f801a7c0389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:25.444940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce5feb-781b-4a35-8c4f-5f801a7c0389 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:25.459593 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 516/1069] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:25.465961 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce5feb-781b-4a35-8c4f-5f801a7c0389 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:25.517111 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f63ed-7f96-4428-a2f1-521099f0a833 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:25.553366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc96cd-b3d0-4de2-8f24-3166b08d0810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:25.554267 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc96cd-b3d0-4de2-8f24-3166b08d0810 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:25.554542 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc96cd-b3d0-4de2-8f24-3166b08d0810 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:25.554812 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc96cd-b3d0-4de2-8f24-3166b08d0810 None admin] PATH_INFO: `/v3/users/5441d6dfdd7d4cfca19aaec639eca0e8` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:25.556032 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc96cd-b3d0-4de2-8f24-3166b08d0810 None admin] RBAC: Authorizing `identity:get_user(user_id=5441d6dfdd7d4cfca19aaec639eca0e8)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:25.557536 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc96cd-b3d0-4de2-8f24-3166b08d0810 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:25.559228 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 554/1070] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:53:25 2022] GET /identity/v3/users/5441d6dfdd7d4cfca19aaec639eca0e8 => generated 285 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:25.560695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff054d-25df-47e7-acf7-c5c0ab8f8316 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:25.560996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff054d-25df-47e7-acf7-c5c0ab8f8316 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:25.561269 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff054d-25df-47e7-acf7-c5c0ab8f8316 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:25.562625 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 555/1071] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:25.567261 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff054d-25df-47e7-acf7-c5c0ab8f8316 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:25.603644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce5feb-781b-4a35-8c4f-5f801a7c0389 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:25.621318 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:25.653077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d299b-c9cc-4385-adbc-a7ac86b7a904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:25.653899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d299b-c9cc-4385-adbc-a7ac86b7a904 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:25.654174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d299b-c9cc-4385-adbc-a7ac86b7a904 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:25.654437 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d299b-c9cc-4385-adbc-a7ac86b7a904 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:25.665485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d299b-c9cc-4385-adbc-a7ac86b7a904 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:25.668000 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d299b-c9cc-4385-adbc-a7ac86b7a904 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:25.668462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:25.683950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-129d299b-c9cc-4385-adbc-a7ac86b7a904 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:53:25.683950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:25.683950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:25.683950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:25.683950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:25.683950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:25.683950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:25.683950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:25.683950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:25.683950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:25.683950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:25.683950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:25.683950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:25.683950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:25.683950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:25.683950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:25.685150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:25.685150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:25.685150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:25.685150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:25.685150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:25.685150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:25.685150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:25.685150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:25.685150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:25.685150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:25.685150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:25.685150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:25.685150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:25.685150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:25.685150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:25.685150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:25.685150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:25.685150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:25.686147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:25.686147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:25.686147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:25.686147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:25.686147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:25.686147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:25.686147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:25.686147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:25.686147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:53:25.686147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:25.686147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 517/1072] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 19 10:53:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:25.687289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdf5ca-a768-46b3-84d3-f338817b2247 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:25.687289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdf5ca-a768-46b3-84d3-f338817b2247 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:25.687449 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdf5ca-a768-46b3-84d3-f338817b2247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:25.696378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff054d-25df-47e7-acf7-c5c0ab8f8316 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:25.706086 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-dccdf5ca-a768-46b3-84d3-f338817b2247 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:25.707482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dccdf5ca-a768-46b3-84d3-f338817b2247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:25.735662 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1db5c-163a-409e-a93c-e187306f76c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:25.736556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1db5c-163a-409e-a93c-e187306f76c9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:25.736873 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1db5c-163a-409e-a93c-e187306f76c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:25.737146 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1db5c-163a-409e-a93c-e187306f76c9 None admin] PATH_INFO: `/v3/projects/e0adb1b85fc744bbb4f93fa370a7436c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:25.738403 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1db5c-163a-409e-a93c-e187306f76c9 None admin] RBAC: Authorizing `identity:get_project(project_id=e0adb1b85fc744bbb4f93fa370a7436c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:25.739941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1db5c-163a-409e-a93c-e187306f76c9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:25.742242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 556/1073] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:53:25 2022] GET /identity/v3/projects/e0adb1b85fc744bbb4f93fa370a7436c => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:25.743081 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1db5c-163a-409e-a93c-e187306f76c9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:25.807293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 518/1074] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:25.807293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdf5ca-a768-46b3-84d3-f338817b2247 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:25.854534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1db5c-163a-409e-a93c-e187306f76c9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:25.897544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a5e6a-70d6-468f-ac48-510b273c0049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:25.898234 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a5e6a-70d6-468f-ac48-510b273c0049 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:25.898516 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a5e6a-70d6-468f-ac48-510b273c0049 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:25.898790 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a5e6a-70d6-468f-ac48-510b273c0049 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:25.899644 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a5e6a-70d6-468f-ac48-510b273c0049 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:25.899947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a5e6a-70d6-468f-ac48-510b273c0049 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:25.901602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a5e6a-70d6-468f-ac48-510b273c0049 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:25.926235 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:25.935013 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 557/1075] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 19 10:53:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:25.935013 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a5e6a-70d6-468f-ac48-510b273c0049 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:25.935372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdf5ca-a768-46b3-84d3-f338817b2247 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:25.951382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:25.972180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae714c0-5d88-4762-a054-992c3b3d71a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:25.973241 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae714c0-5d88-4762-a054-992c3b3d71a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:25.973516 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae714c0-5d88-4762-a054-992c3b3d71a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:25.973782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae714c0-5d88-4762-a054-992c3b3d71a6 None admin] PATH_INFO: `/v3/projects/e0adb1b85fc744bbb4f93fa370a7436c/users/5441d6dfdd7d4cfca19aaec639eca0e8/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:25.976217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae714c0-5d88-4762-a054-992c3b3d71a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=e0adb1b85fc744bbb4f93fa370a7436c, user_id=5441d6dfdd7d4cfca19aaec639eca0e8, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:25.977746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae714c0-5d88-4762-a054-992c3b3d71a6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:25.996914 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 519/1076] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:53:25 2022] PUT /identity/v3/projects/e0adb1b85fc744bbb4f93fa370a7436c/users/5441d6dfdd7d4cfca19aaec639eca0e8/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:53:25.998286 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae714c0-5d88-4762-a054-992c3b3d71a6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:26.061106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a5e6a-70d6-468f-ac48-510b273c0049 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:26.106300 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2dca6-da1c-4811-95a5-70dbdb433638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:26.106999 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2dca6-da1c-4811-95a5-70dbdb433638 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:26.107283 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2dca6-da1c-4811-95a5-70dbdb433638 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:26.107553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2dca6-da1c-4811-95a5-70dbdb433638 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:26.173424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae714c0-5d88-4762-a054-992c3b3d71a6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:26.225509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2dca6-da1c-4811-95a5-70dbdb433638 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:26.227110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2dca6-da1c-4811-95a5-70dbdb433638 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:26.235683 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69523cd0-2fcd-4d39-8f6b-a6a739f4d90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:26.237235 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69523cd0-2fcd-4d39-8f6b-a6a739f4d90f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:26.237734 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69523cd0-2fcd-4d39-8f6b-a6a739f4d90f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:26.238243 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69523cd0-2fcd-4d39-8f6b-a6a739f4d90f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:26.245386 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:26.258594 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69523cd0-2fcd-4d39-8f6b-a6a739f4d90f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:26.261509 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69523cd0-2fcd-4d39-8f6b-a6a739f4d90f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:26.296659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-69523cd0-2fcd-4d39-8f6b-a6a739f4d90f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:26.296659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:26.296659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:26.296659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:26.296659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:26.296659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:26.296659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:26.296659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:26.296659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:26.296659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:26.296659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:26.296659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:26.296659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:26.296659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:26.296659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:26.298446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:26.298446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:26.298446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:26.298446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:26.298446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:26.298446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:26.298446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:26.298446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:26.298446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:26.298446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:26.298446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:26.298446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:26.298446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:26.298446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:26.298446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:26.298446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:26.298446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:26.300224 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:26.300224 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:26.300224 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:26.300224 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:26.300224 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 520/1077] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:26.305337 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69523cd0-2fcd-4d39-8f6b-a6a739f4d90f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:26.328929 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:26.358368 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 558/1078] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:53:26.364506 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2dca6-da1c-4811-95a5-70dbdb433638 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:26.466030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69523cd0-2fcd-4d39-8f6b-a6a739f4d90f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:26.518973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3c6e9-63a7-43cb-9168-770f2872e341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:26.519968 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3c6e9-63a7-43cb-9168-770f2872e341 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:26.520451 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3c6e9-63a7-43cb-9168-770f2872e341 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:26.520976 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3c6e9-63a7-43cb-9168-770f2872e341 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:26.522369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3c6e9-63a7-43cb-9168-770f2872e341 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:26.522914 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3c6e9-63a7-43cb-9168-770f2872e341 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:26.523035 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2dca6-da1c-4811-95a5-70dbdb433638 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:26.525515 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3c6e9-63a7-43cb-9168-770f2872e341 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:26.543801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:26.556962 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 521/1079] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:26.559400 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3c6e9-63a7-43cb-9168-770f2872e341 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:26.586287 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fd6d5-cc9b-4e4a-8167-4242541a2cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:26.587421 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fd6d5-cc9b-4e4a-8167-4242541a2cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:26.588081 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fd6d5-cc9b-4e4a-8167-4242541a2cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:26.588448 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fd6d5-cc9b-4e4a-8167-4242541a2cd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:26.611077 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fd6d5-cc9b-4e4a-8167-4242541a2cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:26.614131 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fd6d5-cc9b-4e4a-8167-4242541a2cd8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:26.648213 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:26.648525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-3a9fd6d5-cc9b-4e4a-8167-4242541a2cd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:26.648525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:26.648525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:26.648525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:26.648525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:26.648525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:26.648525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:26.648525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:26.648525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:26.648525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:26.648525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:26.648525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:26.648525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:26.648525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:26.648525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:26.650441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:26.650441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:26.650441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:26.650441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:26.650441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:26.650441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:26.650441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:26.650441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:26.650441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:26.650441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:26.650441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:26.650441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:26.650441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:26.650441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:26.650441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:26.650441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:26.650441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:26.652217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:26.652217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:26.652217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:26.652217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:26.659096 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 559/1080] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:26.660495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fd6d5-cc9b-4e4a-8167-4242541a2cd8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:26.686359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3c6e9-63a7-43cb-9168-770f2872e341 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:26.730138 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a1110-0874-4b0e-bb3d-be290732abf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:26.731541 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a1110-0874-4b0e-bb3d-be290732abf7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:26.732025 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a1110-0874-4b0e-bb3d-be290732abf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:26.732520 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a1110-0874-4b0e-bb3d-be290732abf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:26.747581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a1110-0874-4b0e-bb3d-be290732abf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:26.750462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a1110-0874-4b0e-bb3d-be290732abf7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:26.778517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-bc7a1110-0874-4b0e-bb3d-be290732abf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:26.778517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:26.778517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:26.778517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:26.778517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:26.778517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:26.778517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:26.778517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:26.778517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:26.778517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:26.778517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:26.778517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:26.778517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:26.778517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:26.778517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:26.779534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:26.779534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:26.779534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:26.779534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:26.779534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:26.779534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:26.779534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:26.779534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:26.779534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:26.779534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:26.779534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:26.779534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:26.779534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:26.779534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:26.779534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:26.779534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:26.779534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:26.780423 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:26.780423 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:26.780423 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:26.780423 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:26.780423 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:26.780423 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:26.780423 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:26.780423 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:26.785107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 522/1081] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:26.790634 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a1110-0874-4b0e-bb3d-be290732abf7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:26.826492 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fd6d5-cc9b-4e4a-8167-4242541a2cd8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:26.880196 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18dffab-ae5f-49ba-9d0e-83c20ddc11ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:26.881227 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dffab-ae5f-49ba-9d0e-83c20ddc11ea None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:26.881671 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dffab-ae5f-49ba-9d0e-83c20ddc11ea None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:26.882115 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dffab-ae5f-49ba-9d0e-83c20ddc11ea None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:26.883078 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18dffab-ae5f-49ba-9d0e-83c20ddc11ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:26.883579 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18dffab-ae5f-49ba-9d0e-83c20ddc11ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:26.885934 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18dffab-ae5f-49ba-9d0e-83c20ddc11ea None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:26.903222 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 560/1082] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:27.000509 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a1110-0874-4b0e-bb3d-be290732abf7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:27.062775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:27.072513 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a3215-0512-4800-842d-7b0b751255d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:27.074058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a3215-0512-4800-842d-7b0b751255d4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:27.074547 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a3215-0512-4800-842d-7b0b751255d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:27.075031 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a3215-0512-4800-842d-7b0b751255d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:27.076484 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a3215-0512-4800-842d-7b0b751255d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:27.077125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a3215-0512-4800-842d-7b0b751255d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:27.079945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a3215-0512-4800-842d-7b0b751255d4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:27.099935 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 523/1083] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:27.109288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18dffab-ae5f-49ba-9d0e-83c20ddc11ea None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:27.150713 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:27.271259 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18dffab-ae5f-49ba-9d0e-83c20ddc11ea None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:27.331447 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec0384-2fec-445c-b155-556f729a070d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:27.333017 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec0384-2fec-445c-b155-556f729a070d None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:27.333522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec0384-2fec-445c-b155-556f729a070d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:27.333995 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec0384-2fec-445c-b155-556f729a070d None admin] PATH_INFO: `/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/3c50a821e9ef44cb9fccd49ee4af7dbf/roles/2b15d93fb65247dd8f0cc3f8a905fb38` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:27.337972 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec0384-2fec-445c-b155-556f729a070d None admin] RBAC: Authorizing `identity:create_grant(project_id=789e54670f7c40ffb67f20478aba00f2, user_id=3c50a821e9ef44cb9fccd49ee4af7dbf, role_id=2b15d93fb65247dd8f0cc3f8a905fb38)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:27.340835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec0384-2fec-445c-b155-556f729a070d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:27.363532 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 561/1084] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:53:27 2022] PUT /identity/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/3c50a821e9ef44cb9fccd49ee4af7dbf/roles/2b15d93fb65247dd8f0cc3f8a905fb38 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:53:28.133133 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282a365-b622-46d5-a917-37019196e531 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:28.133717 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282a365-b622-46d5-a917-37019196e531 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:28.134128 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282a365-b622-46d5-a917-37019196e531 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:28.136776 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 524/1085] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:28.145316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa19c3-f1a5-469d-a249-3015b38c1c78 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:28.145739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa19c3-f1a5-469d-a249-3015b38c1c78 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:28.146134 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa19c3-f1a5-469d-a249-3015b38c1c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:28.164646 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9faa19c3-f1a5-469d-a249-3015b38c1c78 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:28.165869 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9faa19c3-f1a5-469d-a249-3015b38c1c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:28.238781 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 562/1086] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:28.262260 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282a365-b622-46d5-a917-37019196e531 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:28.383433 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282a365-b622-46d5-a917-37019196e531 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:28.426972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168f04a-648f-49c0-a3bb-530f8298b421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:28.427787 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168f04a-648f-49c0-a3bb-530f8298b421 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:28.428060 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168f04a-648f-49c0-a3bb-530f8298b421 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:28.428327 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168f04a-648f-49c0-a3bb-530f8298b421 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:28.442438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168f04a-648f-49c0-a3bb-530f8298b421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:28.452264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-2168f04a-648f-49c0-a3bb-530f8298b421 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:28.452264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:28.452264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:28.452264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:28.452264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:28.452264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:28.452264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:28.452264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:28.452264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:28.452264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:28.452264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:28.452264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:28.452264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:28.452264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:28.452264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:28.452264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:28.454462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:28.454462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:28.454462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:28.454462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:28.454462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:28.454462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:28.454462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:28.454462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:28.454462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:28.454462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:28.454462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:28.454462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:28.454462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:28.454462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:28.454462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:28.454462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:28.456548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:28.456548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:28.456548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:28.456548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:28.456548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:28.456548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:28.456548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:28.456548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:28.456548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:28.456548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:28.456548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:28.456548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:28.456548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 525/1087] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:53:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:28.462046 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa19c3-f1a5-469d-a249-3015b38c1c78 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:28.481468 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:28.589001 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa19c3-f1a5-469d-a249-3015b38c1c78 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:28.629745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17ea08-1218-4785-9c3f-c592461e37c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:28.630436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17ea08-1218-4785-9c3f-c592461e37c4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:28.630708 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17ea08-1218-4785-9c3f-c592461e37c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:28.630975 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17ea08-1218-4785-9c3f-c592461e37c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:28.631746 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17ea08-1218-4785-9c3f-c592461e37c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:28.632047 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17ea08-1218-4785-9c3f-c592461e37c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:28.633692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17ea08-1218-4785-9c3f-c592461e37c4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:28.643692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 563/1088] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:53:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:28.650620 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168f04a-648f-49c0-a3bb-530f8298b421 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:28.767716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:28.848672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168f04a-648f-49c0-a3bb-530f8298b421 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:28.910586 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76073fd6-6042-44f0-a967-6373994ade00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:28.912015 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76073fd6-6042-44f0-a967-6373994ade00 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:28.912523 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76073fd6-6042-44f0-a967-6373994ade00 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:28.913048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76073fd6-6042-44f0-a967-6373994ade00 None admin] PATH_INFO: `/v3/users/5441d6dfdd7d4cfca19aaec639eca0e8` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:28.915114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76073fd6-6042-44f0-a967-6373994ade00 None admin] RBAC: Authorizing `identity:get_user(user_id=5441d6dfdd7d4cfca19aaec639eca0e8)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:28.917767 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76073fd6-6042-44f0-a967-6373994ade00 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:28.920956 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 526/1089] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:53:28 2022] GET /identity/v3/users/5441d6dfdd7d4cfca19aaec639eca0e8 => generated 285 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:28.927674 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17ea08-1218-4785-9c3f-c592461e37c4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:29.058041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:29.090127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17ea08-1218-4785-9c3f-c592461e37c4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:29.135683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba307af4-90d6-4cd0-b55b-5da45f515df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:29.136353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba307af4-90d6-4cd0-b55b-5da45f515df5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:29.136627 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba307af4-90d6-4cd0-b55b-5da45f515df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:29.136943 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba307af4-90d6-4cd0-b55b-5da45f515df5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:29.218162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba307af4-90d6-4cd0-b55b-5da45f515df5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:29.219740 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba307af4-90d6-4cd0-b55b-5da45f515df5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:29.303605 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:29.340421 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 564/1090] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:53:29.342723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76073fd6-6042-44f0-a967-6373994ade00 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:29.481539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1c909-0916-4be8-80d6-a98081f8bec2 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:29.482103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1c909-0916-4be8-80d6-a98081f8bec2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:29.482984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1c909-0916-4be8-80d6-a98081f8bec2 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:29.486347 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 565/1091] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:29.493401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c810bdb-39c7-4e3b-868c-a2191b1e6e0a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:29.493970 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c810bdb-39c7-4e3b-868c-a2191b1e6e0a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:29.494523 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c810bdb-39c7-4e3b-868c-a2191b1e6e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:29.502271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76073fd6-6042-44f0-a967-6373994ade00 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:29.514956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7c810bdb-39c7-4e3b-868c-a2191b1e6e0a None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:29.516188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7c810bdb-39c7-4e3b-868c-a2191b1e6e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:29.526479 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:29.541778 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45b172-3c10-447a-8468-18b412e04d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:29.542653 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45b172-3c10-447a-8468-18b412e04d1e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:29.542931 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45b172-3c10-447a-8468-18b412e04d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:29.543201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45b172-3c10-447a-8468-18b412e04d1e None admin] PATH_INFO: `/v3/projects/e0adb1b85fc744bbb4f93fa370a7436c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:29.544513 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45b172-3c10-447a-8468-18b412e04d1e None admin] RBAC: Authorizing `identity:get_project(project_id=e0adb1b85fc744bbb4f93fa370a7436c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:29.546057 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45b172-3c10-447a-8468-18b412e04d1e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:29.547908 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 527/1092] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:53:29 2022] GET /identity/v3/projects/e0adb1b85fc744bbb4f93fa370a7436c => generated 311 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:29.554252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45b172-3c10-447a-8468-18b412e04d1e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:29.628464 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 566/1093] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:29.669045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c810bdb-39c7-4e3b-868c-a2191b1e6e0a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:29.687830 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45b172-3c10-447a-8468-18b412e04d1e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:29.733280 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce9e8c-56e8-4ce2-9011-18d32f8c6124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:29.734172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce9e8c-56e8-4ce2-9011-18d32f8c6124 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:29.734618 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce9e8c-56e8-4ce2-9011-18d32f8c6124 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:29.735063 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce9e8c-56e8-4ce2-9011-18d32f8c6124 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:29.736568 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce9e8c-56e8-4ce2-9011-18d32f8c6124 None admin] RBAC: Adding query filter params (role.id=3f9528e7a7914797a4635aa6b536b7ff, scope.project.id=e0adb1b85fc744bbb4f93fa370a7436c, user.id=5441d6dfdd7d4cfca19aaec639eca0e8) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:29.737074 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce9e8c-56e8-4ce2-9011-18d32f8c6124 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:29.739509 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce9e8c-56e8-4ce2-9011-18d32f8c6124 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:29.760782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 528/1094] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:29 2022] GET /identity/v3/role_assignments?user.id=5441d6dfdd7d4cfca19aaec639eca0e8&scope.project.id=e0adb1b85fc744bbb4f93fa370a7436c&role.id=3f9528e7a7914797a4635aa6b536b7ff => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:29.806521 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c810bdb-39c7-4e3b-868c-a2191b1e6e0a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:29.817058 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:29.850829 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea438fa3-7045-45b9-84b3-c63abb62ab28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:29.851780 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea438fa3-7045-45b9-84b3-c63abb62ab28 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:29.852121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea438fa3-7045-45b9-84b3-c63abb62ab28 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:29.852472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea438fa3-7045-45b9-84b3-c63abb62ab28 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:29.865779 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea438fa3-7045-45b9-84b3-c63abb62ab28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:29.874435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-ea438fa3-7045-45b9-84b3-c63abb62ab28 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:53:29.874435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:29.874435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:29.874435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:29.874435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:29.874435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:29.874435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:29.874435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:29.874435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:29.874435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:29.874435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:29.874435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:29.874435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:29.874435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:29.874435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:29.874435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:29.876452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:29.876452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:29.876452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:29.876452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:29.876452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:29.876452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:29.876452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:29.876452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:29.876452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:29.876452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:29.876452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:29.876452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:29.876452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:29.876452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:29.876452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:29.876452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:29.878714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:29.878714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:29.878714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:29.878714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:29.878714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:29.878714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:29.878714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:29.878714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:29.878714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:29.878714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:29.878714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:53:29.878714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:29.878714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 567/1095] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jul 19 10:53:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:29.884011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce9e8c-56e8-4ce2-9011-18d32f8c6124 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:29.950589 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:30.024489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce9e8c-56e8-4ce2-9011-18d32f8c6124 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:30.072726 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414898fe-eebb-4066-bd7d-72b71432f5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:30.073853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414898fe-eebb-4066-bd7d-72b71432f5cb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:30.074318 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414898fe-eebb-4066-bd7d-72b71432f5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:30.074786 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414898fe-eebb-4066-bd7d-72b71432f5cb None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:30.076147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414898fe-eebb-4066-bd7d-72b71432f5cb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:30.076746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414898fe-eebb-4066-bd7d-72b71432f5cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:30.079337 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414898fe-eebb-4066-bd7d-72b71432f5cb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:30.095156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 529/1096] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jul 19 10:53:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:30.102853 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea438fa3-7045-45b9-84b3-c63abb62ab28 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:30.216274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea438fa3-7045-45b9-84b3-c63abb62ab28 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:30.255244 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bb598-35c0-4411-b9db-ac6190f36f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:30.256067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bb598-35c0-4411-b9db-ac6190f36f2c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:30.256348 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bb598-35c0-4411-b9db-ac6190f36f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:30.256621 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bb598-35c0-4411-b9db-ac6190f36f2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:30.269531 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bb598-35c0-4411-b9db-ac6190f36f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:30.271006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bb598-35c0-4411-b9db-ac6190f36f2c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:30.290611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-5a1bb598-35c0-4411-b9db-ac6190f36f2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:30.290611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:30.290611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:30.290611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:30.290611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:30.290611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:30.290611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:30.290611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:30.290611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:30.290611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:30.290611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:30.290611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:30.290611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:30.290611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:30.290611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:30.292174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:30.292174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:30.292174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:30.292174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:30.292174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:30.292174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:30.292174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:30.292174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:30.292174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:30.292174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:30.292174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:30.292174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:30.292174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:30.292174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:30.292174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:30.292174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:30.292174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:30.293787 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:30.293787 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:30.293787 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:30.293787 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:30.293787 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 568/1097] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:30.298935 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414898fe-eebb-4066-bd7d-72b71432f5cb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:30.491144 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414898fe-eebb-4066-bd7d-72b71432f5cb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:30.518683 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:30.547965 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8aa40-d379-4d73-9d38-24b8dccf69ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:30.548651 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8aa40-d379-4d73-9d38-24b8dccf69ec None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:30.548976 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8aa40-d379-4d73-9d38-24b8dccf69ec None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:30.549254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8aa40-d379-4d73-9d38-24b8dccf69ec None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:30.549995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8aa40-d379-4d73-9d38-24b8dccf69ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:30.550352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8aa40-d379-4d73-9d38-24b8dccf69ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:30.551786 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8aa40-d379-4d73-9d38-24b8dccf69ec None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:30.566511 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 530/1098] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:30.572918 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bb598-35c0-4411-b9db-ac6190f36f2c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:30.596239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:30.694785 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bb598-35c0-4411-b9db-ac6190f36f2c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:30.734957 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95673796-ea59-4dcf-b9fa-e161c98c79a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:30.735857 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95673796-ea59-4dcf-b9fa-e161c98c79a6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:30.736283 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95673796-ea59-4dcf-b9fa-e161c98c79a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:30.736680 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95673796-ea59-4dcf-b9fa-e161c98c79a6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:30.746692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95673796-ea59-4dcf-b9fa-e161c98c79a6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:30.748170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95673796-ea59-4dcf-b9fa-e161c98c79a6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:30.764048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-95673796-ea59-4dcf-b9fa-e161c98c79a6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:53:30.764048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:30.764048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:30.764048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:30.764048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:30.764048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:30.764048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:30.764048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:30.764048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:30.764048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:30.764048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:30.764048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:30.764048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:30.764048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:30.764048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:30.764048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:30.765868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:30.765868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:30.765868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:30.765868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:30.765868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:30.765868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:30.765868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:30.765868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:30.765868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:30.765868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:30.765868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:30.765868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:30.765868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:30.765868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:30.765868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:30.765868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:30.765868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:30.765868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:30.767629 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:30.767629 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:30.767629 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:30.767629 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:30.767629 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:30.767629 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:30.767629 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:30.767629 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:30.767629 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:53:30.767629 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:30.767629 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 569/1099] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 19 10:53:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:30.772307 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8aa40-d379-4d73-9d38-24b8dccf69ec None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:30.886436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8aa40-d379-4d73-9d38-24b8dccf69ec None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:30.926469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5443019-fcce-4d1c-b3ea-90408316731e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:30.927235 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5443019-fcce-4d1c-b3ea-90408316731e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:30.927601 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5443019-fcce-4d1c-b3ea-90408316731e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:30.927962 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5443019-fcce-4d1c-b3ea-90408316731e None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:30.928953 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5443019-fcce-4d1c-b3ea-90408316731e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:30.929366 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5443019-fcce-4d1c-b3ea-90408316731e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:30.930944 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5443019-fcce-4d1c-b3ea-90408316731e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:30.953497 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 531/1100] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 19 10:53:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:30.959729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95673796-ea59-4dcf-b9fa-e161c98c79a6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:31.065015 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:31.092953 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95673796-ea59-4dcf-b9fa-e161c98c79a6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:31.136340 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65504ef0-ead3-4a01-b0c7-83c31f3cd685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:31.137120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65504ef0-ead3-4a01-b0c7-83c31f3cd685 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:31.137333 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65504ef0-ead3-4a01-b0c7-83c31f3cd685 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:31.137596 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65504ef0-ead3-4a01-b0c7-83c31f3cd685 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:31.215012 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65504ef0-ead3-4a01-b0c7-83c31f3cd685 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:31.216590 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65504ef0-ead3-4a01-b0c7-83c31f3cd685 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:31.304562 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:31.329722 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 570/1101] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 10:53:31.335913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5443019-fcce-4d1c-b3ea-90408316731e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:31.372089 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:31.485358 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5443019-fcce-4d1c-b3ea-90408316731e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:31.523944 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b59885-f12c-4b44-8762-8d6c5787b906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:31.524957 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b59885-f12c-4b44-8762-8d6c5787b906 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:31.525161 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b59885-f12c-4b44-8762-8d6c5787b906 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:31.525508 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b59885-f12c-4b44-8762-8d6c5787b906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:31.537520 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b59885-f12c-4b44-8762-8d6c5787b906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:31.539093 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b59885-f12c-4b44-8762-8d6c5787b906 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:31.558626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-18b59885-f12c-4b44-8762-8d6c5787b906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:31.558626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:31.558626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:31.558626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:31.558626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:31.558626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:31.558626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:31.558626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:31.558626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:31.558626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:31.558626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:31.558626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:31.558626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:31.558626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:31.558626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:31.560774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:31.560774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:31.560774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:31.560774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:31.560774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:31.560774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:31.560774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:31.560774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:31.560774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:31.560774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:31.560774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:31.560774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:31.560774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:31.560774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:31.560774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:31.560774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:31.560774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:31.563152 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:31.563152 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:31.563152 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:31.563152 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:31.563152 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 532/1102] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:31.566821 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65504ef0-ead3-4a01-b0c7-83c31f3cd685 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:31.677852 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65504ef0-ead3-4a01-b0c7-83c31f3cd685 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:31.721138 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae4d4b-45d0-44ac-aca0-d2aab2f69393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:31.721846 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae4d4b-45d0-44ac-aca0-d2aab2f69393 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:31.722205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae4d4b-45d0-44ac-aca0-d2aab2f69393 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:31.722572 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae4d4b-45d0-44ac-aca0-d2aab2f69393 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:31.723390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae4d4b-45d0-44ac-aca0-d2aab2f69393 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:31.723777 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae4d4b-45d0-44ac-aca0-d2aab2f69393 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:31.726396 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae4d4b-45d0-44ac-aca0-d2aab2f69393 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:31.752273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 571/1103] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:31.753648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b59885-f12c-4b44-8762-8d6c5787b906 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:31.865122 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:31.884860 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b59885-f12c-4b44-8762-8d6c5787b906 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:31.931691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787519f-2a5b-456b-be40-53fbb5fdd270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:31.933068 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787519f-2a5b-456b-be40-53fbb5fdd270 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:31.933553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787519f-2a5b-456b-be40-53fbb5fdd270 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:31.934039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787519f-2a5b-456b-be40-53fbb5fdd270 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:31.946843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787519f-2a5b-456b-be40-53fbb5fdd270 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:31.950112 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787519f-2a5b-456b-be40-53fbb5fdd270 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:31.967708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-f787519f-2a5b-456b-be40-53fbb5fdd270 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:31.967708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:31.967708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:31.967708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:31.967708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:31.967708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:31.967708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:31.967708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:31.967708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:31.967708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:31.967708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:31.967708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:31.967708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:31.967708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:31.967708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:31.969476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:31.969476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:31.969476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:31.969476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:31.969476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:31.969476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:31.969476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:31.969476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:31.969476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:31.969476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:31.969476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:31.969476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:31.969476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:31.969476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:31.969476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:31.969476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:31.969476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:31.971390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:31.971390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:31.971390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:31.971390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:31.971390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:31.971390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:31.971390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:31.971390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:31.971390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 533/1104] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:31.976080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae4d4b-45d0-44ac-aca0-d2aab2f69393 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:32.024371 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:32.092188 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb73ea4-52b7-4b61-a687-49d3fbeb0824 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:32.092479 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb73ea4-52b7-4b61-a687-49d3fbeb0824 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:32.092773 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb73ea4-52b7-4b61-a687-49d3fbeb0824 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:32.093163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae4d4b-45d0-44ac-aca0-d2aab2f69393 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:32.094143 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 534/1105] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:53:32.100211 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e76f2-9243-4d6e-86ae-5f586fa99971 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:32.100558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e76f2-9243-4d6e-86ae-5f586fa99971 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:32.101056 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e76f2-9243-4d6e-86ae-5f586fa99971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:32.119583 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-440e76f2-9243-4d6e-86ae-5f586fa99971 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:32.120819 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-440e76f2-9243-4d6e-86ae-5f586fa99971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:32.144878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594dff2-4231-418c-8524-30cdcf598907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:32.145835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594dff2-4231-418c-8524-30cdcf598907 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:32.146110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594dff2-4231-418c-8524-30cdcf598907 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:32.146382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594dff2-4231-418c-8524-30cdcf598907 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:32.147526 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594dff2-4231-418c-8524-30cdcf598907 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:32.147822 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594dff2-4231-418c-8524-30cdcf598907 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:32.149922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594dff2-4231-418c-8524-30cdcf598907 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:32.163156 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 572/1106] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:32.173413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594dff2-4231-418c-8524-30cdcf598907 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:32.216795 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 535/1107] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:32.245266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e76f2-9243-4d6e-86ae-5f586fa99971 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:32.303821 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:32.308590 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594dff2-4231-418c-8524-30cdcf598907 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:32.347396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:32.361805 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0a261-47be-4157-a6ae-c86ec6dc4872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:32.362572 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0a261-47be-4157-a6ae-c86ec6dc4872 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:32.362932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0a261-47be-4157-a6ae-c86ec6dc4872 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:32.363270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0a261-47be-4157-a6ae-c86ec6dc4872 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:32.364160 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0a261-47be-4157-a6ae-c86ec6dc4872 None admin] RBAC: Adding query filter params (role.id=2b15d93fb65247dd8f0cc3f8a905fb38, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=3c50a821e9ef44cb9fccd49ee4af7dbf) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:32.364507 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0a261-47be-4157-a6ae-c86ec6dc4872 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:32.366363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0a261-47be-4157-a6ae-c86ec6dc4872 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:32.373977 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 573/1108] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:32 2022] GET /identity/v3/role_assignments?user.id=3c50a821e9ef44cb9fccd49ee4af7dbf&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=2b15d93fb65247dd8f0cc3f8a905fb38 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:32.384266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e76f2-9243-4d6e-86ae-5f586fa99971 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:32.432990 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1511fd-7feb-456a-9fec-d29bd4ed3631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:32.434235 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1511fd-7feb-456a-9fec-d29bd4ed3631 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:32.434650 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1511fd-7feb-456a-9fec-d29bd4ed3631 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:32.435057 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1511fd-7feb-456a-9fec-d29bd4ed3631 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:32.437220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1511fd-7feb-456a-9fec-d29bd4ed3631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:32.439714 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1511fd-7feb-456a-9fec-d29bd4ed3631 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:32.442811 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 536/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:32.450933 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0a261-47be-4157-a6ae-c86ec6dc4872 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:32.589658 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0a261-47be-4157-a6ae-c86ec6dc4872 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:32.638121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29e83a-6538-40f1-bfb4-64ba2e7f10ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:32.639019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29e83a-6538-40f1-bfb4-64ba2e7f10ca None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:32.639400 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29e83a-6538-40f1-bfb4-64ba2e7f10ca None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:32.639843 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29e83a-6538-40f1-bfb4-64ba2e7f10ca None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:32.641117 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29e83a-6538-40f1-bfb4-64ba2e7f10ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:32.643160 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29e83a-6538-40f1-bfb4-64ba2e7f10ca None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:32.666203 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 574/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 19 10:53:32 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:53:34.822812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabdb90-d05b-4bb6-9f21-9fbd6c7d5243 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:34.823444 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabdb90-d05b-4bb6-9f21-9fbd6c7d5243 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:34.823444 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabdb90-d05b-4bb6-9f21-9fbd6c7d5243 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:34.824823 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 537/1111] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:34.830965 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b293c-6d5c-45f3-8d9c-5f83682543e9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:34.831529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b293c-6d5c-45f3-8d9c-5f83682543e9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:34.831529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b293c-6d5c-45f3-8d9c-5f83682543e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:34.851417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-779b293c-6d5c-45f3-8d9c-5f83682543e9 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:34.852766 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-779b293c-6d5c-45f3-8d9c-5f83682543e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:34.869727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:34.934306 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 575/1112] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:34.958060 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabdb90-d05b-4bb6-9f21-9fbd6c7d5243 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:35.085909 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabdb90-d05b-4bb6-9f21-9fbd6c7d5243 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:35.132748 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c0e5f-aad3-42e7-bc12-058544231565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:35.133629 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c0e5f-aad3-42e7-bc12-058544231565 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:35.133908 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c0e5f-aad3-42e7-bc12-058544231565 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:35.134200 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c0e5f-aad3-42e7-bc12-058544231565 None admin] PATH_INFO: `/v3/roles/0a734da5c17d4cd39ea84b75878e55f1` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:35.135773 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c0e5f-aad3-42e7-bc12-058544231565 None admin] RBAC: Authorizing `identity:get_role(role_id=0a734da5c17d4cd39ea84b75878e55f1)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:35.137199 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c0e5f-aad3-42e7-bc12-058544231565 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:35.138585 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 538/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:53:34 2022] GET /identity/v3/roles/0a734da5c17d4cd39ea84b75878e55f1 => generated 223 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:35.145061 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b293c-6d5c-45f3-8d9c-5f83682543e9 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:35.261455 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b293c-6d5c-45f3-8d9c-5f83682543e9 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:35.303974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f87fd-ab55-418e-82fd-1bfe90660a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:35.304924 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f87fd-ab55-418e-82fd-1bfe90660a00 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:35.305206 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f87fd-ab55-418e-82fd-1bfe90660a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:35.305478 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f87fd-ab55-418e-82fd-1bfe90660a00 None admin] PATH_INFO: `/v3/users/f5f0bccbe5734fbd9e90f5a3ea4840b8` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:35.323465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f87fd-ab55-418e-82fd-1bfe90660a00 None admin] RBAC: Authorizing `identity:get_user(user_id=f5f0bccbe5734fbd9e90f5a3ea4840b8)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:35.325375 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f87fd-ab55-418e-82fd-1bfe90660a00 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:35.327253 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 576/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:53:35 2022] GET /identity/v3/users/f5f0bccbe5734fbd9e90f5a3ea4840b8 => generated 286 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:35.334126 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c0e5f-aad3-42e7-bc12-058544231565 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:35.349412 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:35.458366 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c0e5f-aad3-42e7-bc12-058544231565 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:35.499241 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e378ac-a6b2-4784-a3cf-35705f2eca05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:35.499986 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e378ac-a6b2-4784-a3cf-35705f2eca05 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:35.500313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e378ac-a6b2-4784-a3cf-35705f2eca05 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:35.500644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e378ac-a6b2-4784-a3cf-35705f2eca05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:35.573962 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e378ac-a6b2-4784-a3cf-35705f2eca05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:35.575529 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e378ac-a6b2-4784-a3cf-35705f2eca05 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:35.588193 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:35.696741 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 539/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:53:35.707495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f87fd-ab55-418e-82fd-1bfe90660a00 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:35.716848 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:35.813919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f87fd-ab55-418e-82fd-1bfe90660a00 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:35.850715 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7116d53-1026-4f8b-a863-16f88f0eec8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:35.851588 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7116d53-1026-4f8b-a863-16f88f0eec8e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:35.851864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7116d53-1026-4f8b-a863-16f88f0eec8e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:35.852132 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7116d53-1026-4f8b-a863-16f88f0eec8e None admin] PATH_INFO: `/v3/projects/e0adb1b85fc744bbb4f93fa370a7436c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:35.853387 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7116d53-1026-4f8b-a863-16f88f0eec8e None admin] RBAC: Authorizing `identity:get_project(project_id=e0adb1b85fc744bbb4f93fa370a7436c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:35.854823 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7116d53-1026-4f8b-a863-16f88f0eec8e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:35.856550 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 577/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:53:35 2022] GET /identity/v3/projects/e0adb1b85fc744bbb4f93fa370a7436c => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:35.873697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e378ac-a6b2-4784-a3cf-35705f2eca05 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:35.984475 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e378ac-a6b2-4784-a3cf-35705f2eca05 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:35.996815 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:36.029357 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ccd20-b32d-4385-baa0-c6f9ee100578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:36.030260 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ccd20-b32d-4385-baa0-c6f9ee100578 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:36.030631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ccd20-b32d-4385-baa0-c6f9ee100578 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:36.030990 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ccd20-b32d-4385-baa0-c6f9ee100578 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:36.031963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ccd20-b32d-4385-baa0-c6f9ee100578 None admin] RBAC: Adding query filter params (role.id=0a734da5c17d4cd39ea84b75878e55f1, scope.project.id=e0adb1b85fc744bbb4f93fa370a7436c, user.id=f5f0bccbe5734fbd9e90f5a3ea4840b8) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:36.032386 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ccd20-b32d-4385-baa0-c6f9ee100578 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:36.034599 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ccd20-b32d-4385-baa0-c6f9ee100578 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:36.041229 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 540/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:35 2022] GET /identity/v3/role_assignments?user.id=f5f0bccbe5734fbd9e90f5a3ea4840b8&scope.project.id=e0adb1b85fc744bbb4f93fa370a7436c&role.id=0a734da5c17d4cd39ea84b75878e55f1 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:38.087999 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82194aa-2325-4d01-9d39-d9a64c0ed906 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:38.088580 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82194aa-2325-4d01-9d39-d9a64c0ed906 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:38.088580 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82194aa-2325-4d01-9d39-d9a64c0ed906 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:38.089929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 578/1118] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:38.096405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1c74b-4223-4f3a-831f-128d771a3988 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:38.097223 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1c74b-4223-4f3a-831f-128d771a3988 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:38.097223 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1c74b-4223-4f3a-831f-128d771a3988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:38.115911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c9b1c74b-4223-4f3a-831f-128d771a3988 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:38.117176 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c9b1c74b-4223-4f3a-831f-128d771a3988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:38.186639 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 541/1119] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:38.210137 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82194aa-2325-4d01-9d39-d9a64c0ed906 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:38.309966 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:38.340432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82194aa-2325-4d01-9d39-d9a64c0ed906 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:38.379321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9200e0e-e566-43ad-90ad-43a7031c0afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:38.380197 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9200e0e-e566-43ad-90ad-43a7031c0afd None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:38.380479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9200e0e-e566-43ad-90ad-43a7031c0afd None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:38.380764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9200e0e-e566-43ad-90ad-43a7031c0afd None admin] PATH_INFO: `/v3/roles/0a734da5c17d4cd39ea84b75878e55f1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:38.382323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9200e0e-e566-43ad-90ad-43a7031c0afd None admin] RBAC: Authorizing `identity:get_role(role_id=0a734da5c17d4cd39ea84b75878e55f1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:38.383715 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9200e0e-e566-43ad-90ad-43a7031c0afd None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:38.385173 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 579/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:53:38 2022] GET /identity/v3/roles/0a734da5c17d4cd39ea84b75878e55f1 => generated 223 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:38.392101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1c74b-4223-4f3a-831f-128d771a3988 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:38.530425 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1c74b-4223-4f3a-831f-128d771a3988 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:38.533283 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:38.568978 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76080ad2-2e18-4fd4-b3cd-973c0e724d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:38.569865 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76080ad2-2e18-4fd4-b3cd-973c0e724d61 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:38.570147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76080ad2-2e18-4fd4-b3cd-973c0e724d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:38.570422 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76080ad2-2e18-4fd4-b3cd-973c0e724d61 None admin] PATH_INFO: `/v3/users/f5f0bccbe5734fbd9e90f5a3ea4840b8` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:38.571695 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76080ad2-2e18-4fd4-b3cd-973c0e724d61 None admin] RBAC: Authorizing `identity:get_user(user_id=f5f0bccbe5734fbd9e90f5a3ea4840b8)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:38.573188 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76080ad2-2e18-4fd4-b3cd-973c0e724d61 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:38.574838 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 542/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:53:38 2022] GET /identity/v3/users/f5f0bccbe5734fbd9e90f5a3ea4840b8 => generated 286 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:38.581260 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9200e0e-e566-43ad-90ad-43a7031c0afd None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:38.695745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9200e0e-e566-43ad-90ad-43a7031c0afd None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:38.733954 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da84205-6a8e-4222-aa9d-7e466a022eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:38.734840 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da84205-6a8e-4222-aa9d-7e466a022eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:38.735121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da84205-6a8e-4222-aa9d-7e466a022eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:38.735489 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da84205-6a8e-4222-aa9d-7e466a022eb3 None admin] PATH_INFO: `/v3/projects/e0adb1b85fc744bbb4f93fa370a7436c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:38.736790 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da84205-6a8e-4222-aa9d-7e466a022eb3 None admin] RBAC: Authorizing `identity:get_project(project_id=e0adb1b85fc744bbb4f93fa370a7436c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:38.738243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da84205-6a8e-4222-aa9d-7e466a022eb3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:38.739995 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 580/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:53:38 2022] GET /identity/v3/projects/e0adb1b85fc744bbb4f93fa370a7436c => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:38.746568 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76080ad2-2e18-4fd4-b3cd-973c0e724d61 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:38.858841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76080ad2-2e18-4fd4-b3cd-973c0e724d61 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:38.903978 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adffa29-87fa-425e-b0b8-c0ef4080f6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:38.905572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adffa29-87fa-425e-b0b8-c0ef4080f6e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:38.906082 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adffa29-87fa-425e-b0b8-c0ef4080f6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:38.906582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adffa29-87fa-425e-b0b8-c0ef4080f6e0 None admin] PATH_INFO: `/v3/projects/e0adb1b85fc744bbb4f93fa370a7436c/users/f5f0bccbe5734fbd9e90f5a3ea4840b8/roles/0a734da5c17d4cd39ea84b75878e55f1` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:38.910748 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adffa29-87fa-425e-b0b8-c0ef4080f6e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=e0adb1b85fc744bbb4f93fa370a7436c, user_id=f5f0bccbe5734fbd9e90f5a3ea4840b8, role_id=0a734da5c17d4cd39ea84b75878e55f1)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:38.913564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adffa29-87fa-425e-b0b8-c0ef4080f6e0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:38.936084 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 543/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:53:38 2022] PUT /identity/v3/projects/e0adb1b85fc744bbb4f93fa370a7436c/users/f5f0bccbe5734fbd9e90f5a3ea4840b8/roles/0a734da5c17d4cd39ea84b75878e55f1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:53:41.029817 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff3790-ce73-47a4-9d19-eb654c31baa6 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:41.030438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff3790-ce73-47a4-9d19-eb654c31baa6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:41.030438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff3790-ce73-47a4-9d19-eb654c31baa6 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:41.031875 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 581/1124] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:41.037840 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c987f49-7810-4bec-a385-98a5354b5ba5 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:41.038359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c987f49-7810-4bec-a385-98a5354b5ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:41.038459 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c987f49-7810-4bec-a385-98a5354b5ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:41.056827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9c987f49-7810-4bec-a385-98a5354b5ba5 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:41.058052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9c987f49-7810-4bec-a385-98a5354b5ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:41.086597 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:41.144859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 544/1125] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:41.170120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff3790-ce73-47a4-9d19-eb654c31baa6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:41.184606 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:41.284413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff3790-ce73-47a4-9d19-eb654c31baa6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:41.325832 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0023c2e-787d-4606-b98c-59d3eeee40e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:41.326711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0023c2e-787d-4606-b98c-59d3eeee40e3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:41.326986 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0023c2e-787d-4606-b98c-59d3eeee40e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:41.327250 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0023c2e-787d-4606-b98c-59d3eeee40e3 None admin] PATH_INFO: `/v3/roles/0a734da5c17d4cd39ea84b75878e55f1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:41.328967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0023c2e-787d-4606-b98c-59d3eeee40e3 None admin] RBAC: Authorizing `identity:get_role(role_id=0a734da5c17d4cd39ea84b75878e55f1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:41.330446 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0023c2e-787d-4606-b98c-59d3eeee40e3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:41.331924 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 582/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:53:41 2022] GET /identity/v3/roles/0a734da5c17d4cd39ea84b75878e55f1 => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:41.338537 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c987f49-7810-4bec-a385-98a5354b5ba5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:41.459168 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c987f49-7810-4bec-a385-98a5354b5ba5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:41.502632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5203c-e29f-4d1e-892a-9d9a3f80df63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:41.503533 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5203c-e29f-4d1e-892a-9d9a3f80df63 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:41.503813 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5203c-e29f-4d1e-892a-9d9a3f80df63 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:41.504089 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5203c-e29f-4d1e-892a-9d9a3f80df63 None admin] PATH_INFO: `/v3/users/f5f0bccbe5734fbd9e90f5a3ea4840b8` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:41.505495 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5203c-e29f-4d1e-892a-9d9a3f80df63 None admin] RBAC: Authorizing `identity:get_user(user_id=f5f0bccbe5734fbd9e90f5a3ea4840b8)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:41.506989 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5203c-e29f-4d1e-892a-9d9a3f80df63 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:41.508737 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 545/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:53:41 2022] GET /identity/v3/users/f5f0bccbe5734fbd9e90f5a3ea4840b8 => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:41.515108 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0023c2e-787d-4606-b98c-59d3eeee40e3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:41.608028 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:41.633922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0023c2e-787d-4606-b98c-59d3eeee40e3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:41.673629 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd54af-9707-40a5-aab3-f4143d3a6d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:41.674301 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd54af-9707-40a5-aab3-f4143d3a6d59 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:41.674579 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd54af-9707-40a5-aab3-f4143d3a6d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:41.674849 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd54af-9707-40a5-aab3-f4143d3a6d59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:41.755365 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd54af-9707-40a5-aab3-f4143d3a6d59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:41.756873 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd54af-9707-40a5-aab3-f4143d3a6d59 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:41.840884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:41.865644 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 583/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:53:41.871901 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5203c-e29f-4d1e-892a-9d9a3f80df63 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:41.904437 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:41.986357 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5203c-e29f-4d1e-892a-9d9a3f80df63 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:42.030559 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c8593-c024-4c6e-ab7a-ff95a36e9a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:42.031439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c8593-c024-4c6e-ab7a-ff95a36e9a03 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:42.031719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c8593-c024-4c6e-ab7a-ff95a36e9a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:42.031989 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c8593-c024-4c6e-ab7a-ff95a36e9a03 None admin] PATH_INFO: `/v3/projects/e0adb1b85fc744bbb4f93fa370a7436c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:42.033418 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c8593-c024-4c6e-ab7a-ff95a36e9a03 None admin] RBAC: Authorizing `identity:get_project(project_id=e0adb1b85fc744bbb4f93fa370a7436c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:42.034882 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c8593-c024-4c6e-ab7a-ff95a36e9a03 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:42.036685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 546/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:53:41 2022] GET /identity/v3/projects/e0adb1b85fc744bbb4f93fa370a7436c => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:42.046626 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd54af-9707-40a5-aab3-f4143d3a6d59 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:42.182361 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd54af-9707-40a5-aab3-f4143d3a6d59 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:42.222189 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b86b6-6559-4748-b2f9-2228ad44fd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:42.222882 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b86b6-6559-4748-b2f9-2228ad44fd79 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:42.223162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b86b6-6559-4748-b2f9-2228ad44fd79 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:42.223753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b86b6-6559-4748-b2f9-2228ad44fd79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:42.224893 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b86b6-6559-4748-b2f9-2228ad44fd79 None admin] RBAC: Adding query filter params (role.id=0a734da5c17d4cd39ea84b75878e55f1, scope.project.id=e0adb1b85fc744bbb4f93fa370a7436c, user.id=f5f0bccbe5734fbd9e90f5a3ea4840b8) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:42.225210 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b86b6-6559-4748-b2f9-2228ad44fd79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:42.226832 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b86b6-6559-4748-b2f9-2228ad44fd79 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:42.234323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 584/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:42 2022] GET /identity/v3/role_assignments?user.id=f5f0bccbe5734fbd9e90f5a3ea4840b8&scope.project.id=e0adb1b85fc744bbb4f93fa370a7436c&role.id=0a734da5c17d4cd39ea84b75878e55f1 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:44.311586 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda686f3-bf0e-4ef8-a609-d564c9b686ec None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:44.312206 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda686f3-bf0e-4ef8-a609-d564c9b686ec None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:44.312206 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda686f3-bf0e-4ef8-a609-d564c9b686ec None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:44.313729 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 547/1131] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:44.326727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374f002-c84a-4e2f-bdf7-dcb8145f80cf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:44.327316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374f002-c84a-4e2f-bdf7-dcb8145f80cf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:44.327804 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374f002-c84a-4e2f-bdf7-dcb8145f80cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:44.356517 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6374f002-c84a-4e2f-bdf7-dcb8145f80cf None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:44.358578 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6374f002-c84a-4e2f-bdf7-dcb8145f80cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:44.423371 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:44.483391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 585/1132] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:44.525388 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda686f3-bf0e-4ef8-a609-d564c9b686ec None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:44.635138 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:44.641107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda686f3-bf0e-4ef8-a609-d564c9b686ec None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:44.679266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3957e-0b64-4756-9dfc-30be9c6c8987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:44.680075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3957e-0b64-4756-9dfc-30be9c6c8987 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:44.680362 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3957e-0b64-4756-9dfc-30be9c6c8987 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:44.680636 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3957e-0b64-4756-9dfc-30be9c6c8987 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:44.681949 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3957e-0b64-4756-9dfc-30be9c6c8987 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:44.683419 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3957e-0b64-4756-9dfc-30be9c6c8987 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:44.685204 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 548/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:44.691590 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374f002-c84a-4e2f-bdf7-dcb8145f80cf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:44.797764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374f002-c84a-4e2f-bdf7-dcb8145f80cf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:44.833816 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30367518-1e5e-4a7a-a23f-264b3a179a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:44.834477 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30367518-1e5e-4a7a-a23f-264b3a179a77 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:44.834752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30367518-1e5e-4a7a-a23f-264b3a179a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:44.835020 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30367518-1e5e-4a7a-a23f-264b3a179a77 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:44.835737 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30367518-1e5e-4a7a-a23f-264b3a179a77 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:44.837209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30367518-1e5e-4a7a-a23f-264b3a179a77 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:44.864499 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 586/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 19 10:53:44 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:53:46.961583 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b212e-c8ef-4d93-8a11-9f6448b5958d None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:46.962482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b212e-c8ef-4d93-8a11-9f6448b5958d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:46.962482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b212e-c8ef-4d93-8a11-9f6448b5958d None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:46.964037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 549/1135] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:46.969637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa4a68-408f-4ee2-bd0f-5b77354f0f41 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:46.970154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa4a68-408f-4ee2-bd0f-5b77354f0f41 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:46.970154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa4a68-408f-4ee2-bd0f-5b77354f0f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:46.987862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-cdaa4a68-408f-4ee2-bd0f-5b77354f0f41 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:46.989168 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cdaa4a68-408f-4ee2-bd0f-5b77354f0f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:47.008198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:47.061813 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 587/1136] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:47.086422 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b212e-c8ef-4d93-8a11-9f6448b5958d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:47.194978 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b212e-c8ef-4d93-8a11-9f6448b5958d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:47.234447 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ecc55-240d-4e0c-8f1b-103e8f51ce22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:47.235217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ecc55-240d-4e0c-8f1b-103e8f51ce22 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:47.235493 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ecc55-240d-4e0c-8f1b-103e8f51ce22 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:47.235760 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ecc55-240d-4e0c-8f1b-103e8f51ce22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:47.237007 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ecc55-240d-4e0c-8f1b-103e8f51ce22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:47.238437 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ecc55-240d-4e0c-8f1b-103e8f51ce22 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:47.240060 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 550/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:47.246155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa4a68-408f-4ee2-bd0f-5b77354f0f41 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:47.351502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa4a68-408f-4ee2-bd0f-5b77354f0f41 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:47.387424 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2afcc-8373-4567-98e1-d24cfc4e71c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:47.388089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2afcc-8373-4567-98e1-d24cfc4e71c7 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:47.388362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2afcc-8373-4567-98e1-d24cfc4e71c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:47.388634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2afcc-8373-4567-98e1-d24cfc4e71c7 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:47.389363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2afcc-8373-4567-98e1-d24cfc4e71c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:47.390797 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2afcc-8373-4567-98e1-d24cfc4e71c7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:47.412891 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 588/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 19 10:53:47 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:53:49.527198 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531440f-61c2-4f00-b317-3cd7316f4546 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:49.528012 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531440f-61c2-4f00-b317-3cd7316f4546 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:49.528207 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531440f-61c2-4f00-b317-3cd7316f4546 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:49.529753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 551/1139] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:49.538946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e2c8b-77dd-49b6-82a8-93c3990e9b4f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:49.539452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e2c8b-77dd-49b6-82a8-93c3990e9b4f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:49.539911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e2c8b-77dd-49b6-82a8-93c3990e9b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:49.566591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-964e2c8b-77dd-49b6-82a8-93c3990e9b4f None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:49.568631 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-964e2c8b-77dd-49b6-82a8-93c3990e9b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:49.573257 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:49.645775 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 589/1140] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:49.669564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531440f-61c2-4f00-b317-3cd7316f4546 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:49.709346 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:49.817739 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531440f-61c2-4f00-b317-3cd7316f4546 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:49.876930 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf577d5-cded-499f-b582-b0554749eba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:49.878263 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf577d5-cded-499f-b582-b0554749eba9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:49.878751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf577d5-cded-499f-b582-b0554749eba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:49.879239 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf577d5-cded-499f-b582-b0554749eba9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:49.898181 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf577d5-cded-499f-b582-b0554749eba9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:49.912758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-cdf577d5-cded-499f-b582-b0554749eba9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:49.912758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:49.912758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:49.912758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:49.912758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:49.912758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:49.912758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:49.912758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:49.912758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:49.912758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:49.912758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:49.912758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:49.912758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:49.912758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:49.912758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:49.912758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:49.914059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:49.914059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:49.914059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:49.914059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:49.914059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:49.914059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:49.914059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:49.914059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:49.914059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:49.914059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:49.914059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:49.914059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:49.914059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:49.914059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:49.914059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:49.914059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:49.915173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:49.915173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:49.915173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:49.915173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:49.915173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:49.915173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:49.915173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:49.915173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:49.915173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:49.915173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:49.915173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:49.915173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:49.915173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 552/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:53:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:49.921660 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e2c8b-77dd-49b6-82a8-93c3990e9b4f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:50.032248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e2c8b-77dd-49b6-82a8-93c3990e9b4f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:50.068570 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c26ad1-4a84-4d95-8215-ff0f89e59546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:50.069346 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c26ad1-4a84-4d95-8215-ff0f89e59546 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:50.069665 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c26ad1-4a84-4d95-8215-ff0f89e59546 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:50.069977 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c26ad1-4a84-4d95-8215-ff0f89e59546 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:50.070774 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c26ad1-4a84-4d95-8215-ff0f89e59546 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:50.071120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c26ad1-4a84-4d95-8215-ff0f89e59546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:50.072562 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c26ad1-4a84-4d95-8215-ff0f89e59546 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:50.082482 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 590/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:53:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:50.088589 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf577d5-cded-499f-b582-b0554749eba9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:50.194449 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:50.202534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf577d5-cded-499f-b582-b0554749eba9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:50.240230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161239c-7604-4002-a989-001f4bec0e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:50.241142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161239c-7604-4002-a989-001f4bec0e99 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:50.241419 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161239c-7604-4002-a989-001f4bec0e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:50.241689 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161239c-7604-4002-a989-001f4bec0e99 None admin] PATH_INFO: `/v3/users/b88a25376574499eb221d996573645cc` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:50.256132 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161239c-7604-4002-a989-001f4bec0e99 None admin] RBAC: Authorizing `identity:get_user(user_id=b88a25376574499eb221d996573645cc)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:50.257627 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161239c-7604-4002-a989-001f4bec0e99 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:50.259335 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 553/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:53:50 2022] GET /identity/v3/users/b88a25376574499eb221d996573645cc => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:50.265582 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c26ad1-4a84-4d95-8215-ff0f89e59546 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:50.268759 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:50.376320 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c26ad1-4a84-4d95-8215-ff0f89e59546 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:50.411567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22ba03-e673-4c91-ad91-c5dfb899092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:50.412215 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22ba03-e673-4c91-ad91-c5dfb899092d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:50.412487 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22ba03-e673-4c91-ad91-c5dfb899092d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:50.412762 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22ba03-e673-4c91-ad91-c5dfb899092d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:50.486259 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22ba03-e673-4c91-ad91-c5dfb899092d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:50.487706 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22ba03-e673-4c91-ad91-c5dfb899092d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:50.489653 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:50.597272 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 591/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:53:50.603811 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161239c-7604-4002-a989-001f4bec0e99 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:50.709621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161239c-7604-4002-a989-001f4bec0e99 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:50.745520 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb1fbd-b0a5-43c3-947f-a90121417c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:50.746448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb1fbd-b0a5-43c3-947f-a90121417c7d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:50.746781 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb1fbd-b0a5-43c3-947f-a90121417c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:50.747129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb1fbd-b0a5-43c3-947f-a90121417c7d None admin] PATH_INFO: `/v3/projects/700ca39adad04b6799848d26df9719f9` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:50.748400 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb1fbd-b0a5-43c3-947f-a90121417c7d None admin] RBAC: Authorizing `identity:get_project(project_id=700ca39adad04b6799848d26df9719f9)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:50.749912 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb1fbd-b0a5-43c3-947f-a90121417c7d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:50.751714 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 554/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:53:50 2022] GET /identity/v3/projects/700ca39adad04b6799848d26df9719f9 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:50.758156 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22ba03-e673-4c91-ad91-c5dfb899092d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:50.865643 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22ba03-e673-4c91-ad91-c5dfb899092d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:50.867255 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:50.903004 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322c998-32b4-4ba7-a1ad-1e696a8099df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:50.903675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322c998-32b4-4ba7-a1ad-1e696a8099df None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:50.903951 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322c998-32b4-4ba7-a1ad-1e696a8099df None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:50.904214 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322c998-32b4-4ba7-a1ad-1e696a8099df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:50.905082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322c998-32b4-4ba7-a1ad-1e696a8099df None admin] RBAC: Adding query filter params (role.id=3f9528e7a7914797a4635aa6b536b7ff, scope.project.id=700ca39adad04b6799848d26df9719f9, user.id=b88a25376574499eb221d996573645cc) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:50.905389 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322c998-32b4-4ba7-a1ad-1e696a8099df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:50.906883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322c998-32b4-4ba7-a1ad-1e696a8099df None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:50.913195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 592/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:50 2022] GET /identity/v3/role_assignments?user.id=b88a25376574499eb221d996573645cc&scope.project.id=700ca39adad04b6799848d26df9719f9&role.id=3f9528e7a7914797a4635aa6b536b7ff => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:52.980533 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96025fcc-f02e-4b1e-8a5e-3ddf5cd0fd9d None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:52.981224 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96025fcc-f02e-4b1e-8a5e-3ddf5cd0fd9d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:52.981224 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96025fcc-f02e-4b1e-8a5e-3ddf5cd0fd9d None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:52.982507 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 555/1147] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:52.988386 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f6708-5eb1-4433-8d05-bc0bc470ff53 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:52.988950 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f6708-5eb1-4433-8d05-bc0bc470ff53 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:52.988950 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f6708-5eb1-4433-8d05-bc0bc470ff53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:53.006852 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-271f6708-5eb1-4433-8d05-bc0bc470ff53 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:53.008112 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-271f6708-5eb1-4433-8d05-bc0bc470ff53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:53.077222 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 593/1148] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:53.101114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96025fcc-f02e-4b1e-8a5e-3ddf5cd0fd9d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:53.124168 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:53.212004 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96025fcc-f02e-4b1e-8a5e-3ddf5cd0fd9d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:53.250739 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f34b0-803f-4090-9ce1-b364eecee101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:53.251497 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f34b0-803f-4090-9ce1-b364eecee101 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:53.251813 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f34b0-803f-4090-9ce1-b364eecee101 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:53.252127 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f34b0-803f-4090-9ce1-b364eecee101 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:53.262855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f34b0-803f-4090-9ce1-b364eecee101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:53.270526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-ef4f34b0-803f-4090-9ce1-b364eecee101 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:53.270526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:53.270526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:53.270526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:53.270526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:53.270526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:53.270526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:53.270526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:53.270526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:53.270526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:53.270526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:53.270526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:53.270526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:53.270526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:53.270526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:53.270526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:53.272228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:53.272228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:53.272228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:53.272228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:53.272228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:53.272228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:53.272228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:53.272228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:53.272228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:53.272228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:53.272228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:53.272228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:53.272228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:53.272228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:53.272228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:53.272228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:53.274004 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:53.274004 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:53.274004 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:53.274004 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:53.274004 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:53.274004 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:53.274004 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:53.274004 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:53.274004 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:53.274004 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:53.274004 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:53.274004 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:53:53.274004 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 556/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:53:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:53.279286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f6708-5eb1-4433-8d05-bc0bc470ff53 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:53.378222 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:53.385670 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f6708-5eb1-4433-8d05-bc0bc470ff53 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:53.422210 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663311b4-aee5-4e4a-972f-92860964442f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:53.422893 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663311b4-aee5-4e4a-972f-92860964442f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:53.423174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663311b4-aee5-4e4a-972f-92860964442f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:53.423432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663311b4-aee5-4e4a-972f-92860964442f None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:53.424206 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663311b4-aee5-4e4a-972f-92860964442f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:53.424514 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663311b4-aee5-4e4a-972f-92860964442f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:53.425953 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663311b4-aee5-4e4a-972f-92860964442f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:53.435109 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 594/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:53:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:53.441479 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f34b0-803f-4090-9ce1-b364eecee101 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:53.533792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:53.563910 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f34b0-803f-4090-9ce1-b364eecee101 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:53.600147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4b7f0-7f1e-4ff8-9ad6-178c15042c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:53.601074 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4b7f0-7f1e-4ff8-9ad6-178c15042c6d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:53.601356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4b7f0-7f1e-4ff8-9ad6-178c15042c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:53.601628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4b7f0-7f1e-4ff8-9ad6-178c15042c6d None admin] PATH_INFO: `/v3/users/b88a25376574499eb221d996573645cc` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:53.602877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4b7f0-7f1e-4ff8-9ad6-178c15042c6d None admin] RBAC: Authorizing `identity:get_user(user_id=b88a25376574499eb221d996573645cc)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:53.604322 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4b7f0-7f1e-4ff8-9ad6-178c15042c6d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:53.606025 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 557/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:53:53 2022] GET /identity/v3/users/b88a25376574499eb221d996573645cc => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:53.612425 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663311b4-aee5-4e4a-972f-92860964442f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:53.719929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663311b4-aee5-4e4a-972f-92860964442f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:53.758943 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23921f3f-838e-4485-a558-c383cf241c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:53.759834 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23921f3f-838e-4485-a558-c383cf241c2c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:53.760113 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23921f3f-838e-4485-a558-c383cf241c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:53.760379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23921f3f-838e-4485-a558-c383cf241c2c None admin] PATH_INFO: `/v3/projects/700ca39adad04b6799848d26df9719f9` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:53.761662 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23921f3f-838e-4485-a558-c383cf241c2c None admin] RBAC: Authorizing `identity:get_project(project_id=700ca39adad04b6799848d26df9719f9)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:53.763122 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23921f3f-838e-4485-a558-c383cf241c2c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:53.764893 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 595/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:53:53 2022] GET /identity/v3/projects/700ca39adad04b6799848d26df9719f9 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:53.771744 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4b7f0-7f1e-4ff8-9ad6-178c15042c6d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:53.881198 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4b7f0-7f1e-4ff8-9ad6-178c15042c6d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:53.915932 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95cd75-c743-4c9a-86e2-aa7072ee386c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:53.916868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95cd75-c743-4c9a-86e2-aa7072ee386c None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:53.917144 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95cd75-c743-4c9a-86e2-aa7072ee386c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:53.917419 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95cd75-c743-4c9a-86e2-aa7072ee386c None admin] PATH_INFO: `/v3/projects/700ca39adad04b6799848d26df9719f9/users/b88a25376574499eb221d996573645cc/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:53.919425 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95cd75-c743-4c9a-86e2-aa7072ee386c None admin] RBAC: Authorizing `identity:create_grant(project_id=700ca39adad04b6799848d26df9719f9, user_id=b88a25376574499eb221d996573645cc, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:53.920886 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95cd75-c743-4c9a-86e2-aa7072ee386c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:53.936152 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 558/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:53:53 2022] PUT /identity/v3/projects/700ca39adad04b6799848d26df9719f9/users/b88a25376574499eb221d996573645cc/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:53:55.964198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae3299-c496-4067-b1be-c03dbec06906 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:55.964794 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae3299-c496-4067-b1be-c03dbec06906 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:55.964794 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae3299-c496-4067-b1be-c03dbec06906 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:55.966168 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 596/1154] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:55.972289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2b2d3-8e14-4baa-a123-94ef3520d855 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:55.972828 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2b2d3-8e14-4baa-a123-94ef3520d855 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:55.973253 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2b2d3-8e14-4baa-a123-94ef3520d855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:55.992356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d8b2b2d3-8e14-4baa-a123-94ef3520d855 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:55.993769 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d8b2b2d3-8e14-4baa-a123-94ef3520d855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:55.996386 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:56.079611 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 559/1155] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:56.104687 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae3299-c496-4067-b1be-c03dbec06906 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:56.135660 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:56.217102 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae3299-c496-4067-b1be-c03dbec06906 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:56.256880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4bc77-55b2-4297-8e4d-52829611366f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:56.257717 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4bc77-55b2-4297-8e4d-52829611366f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:56.257994 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4bc77-55b2-4297-8e4d-52829611366f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:56.258263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4bc77-55b2-4297-8e4d-52829611366f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:56.271236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4bc77-55b2-4297-8e4d-52829611366f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:56.279080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-91b4bc77-55b2-4297-8e4d-52829611366f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:56.279080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:56.279080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:56.279080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:56.279080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:56.279080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:56.279080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:56.279080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:56.279080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:56.279080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:56.279080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:56.279080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:56.279080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:56.279080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:56.279080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:56.279080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:56.280878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:56.280878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:56.280878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:56.280878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:56.280878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:56.280878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:56.280878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:56.280878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:56.280878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:56.280878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:56.280878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:56.280878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:56.280878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:56.280878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:56.280878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:56.280878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:56.282472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:56.282472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:56.282472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:56.282472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:56.282472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:56.282472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:56.282472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:56.282472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:56.282472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:56.282472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:56.282472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:56.282472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:53:56.282472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 597/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:53:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:56.287863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2b2d3-8e14-4baa-a123-94ef3520d855 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:56.469513 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2b2d3-8e14-4baa-a123-94ef3520d855 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:56.507687 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8585f-ea0d-4bd0-be34-23d0fe18435c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:56.508368 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8585f-ea0d-4bd0-be34-23d0fe18435c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:56.508648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8585f-ea0d-4bd0-be34-23d0fe18435c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:56.508954 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8585f-ea0d-4bd0-be34-23d0fe18435c None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:56.509701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8585f-ea0d-4bd0-be34-23d0fe18435c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:56.510005 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8585f-ea0d-4bd0-be34-23d0fe18435c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:56.511388 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8585f-ea0d-4bd0-be34-23d0fe18435c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:56.517593 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:56.521330 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 560/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:53:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:56.527522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4bc77-55b2-4297-8e4d-52829611366f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:56.629397 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:56.655426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4bc77-55b2-4297-8e4d-52829611366f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:56.721247 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1da70c-6c01-4954-8c79-7ba6df05a2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:56.722701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1da70c-6c01-4954-8c79-7ba6df05a2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:56.723499 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1da70c-6c01-4954-8c79-7ba6df05a2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:56.723984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1da70c-6c01-4954-8c79-7ba6df05a2e5 None admin] PATH_INFO: `/v3/users/b88a25376574499eb221d996573645cc` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:56.726158 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1da70c-6c01-4954-8c79-7ba6df05a2e5 None admin] RBAC: Authorizing `identity:get_user(user_id=b88a25376574499eb221d996573645cc)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:56.728662 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1da70c-6c01-4954-8c79-7ba6df05a2e5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:56.731565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 598/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:53:56 2022] GET /identity/v3/users/b88a25376574499eb221d996573645cc => generated 286 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:56.738307 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8585f-ea0d-4bd0-be34-23d0fe18435c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:56.903074 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8585f-ea0d-4bd0-be34-23d0fe18435c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:56.943866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357e6c3-c996-4726-b064-4546855003ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:56.944646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357e6c3-c996-4726-b064-4546855003ad None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:56.944957 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357e6c3-c996-4726-b064-4546855003ad None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:56.945227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357e6c3-c996-4726-b064-4546855003ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:57.015233 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:57.018244 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357e6c3-c996-4726-b064-4546855003ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:57.019906 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357e6c3-c996-4726-b064-4546855003ad None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:57.125586 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 561/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:53:57.135485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1da70c-6c01-4954-8c79-7ba6df05a2e5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:57.288319 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1da70c-6c01-4954-8c79-7ba6df05a2e5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:57.328636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4cd2df-49fb-4894-96b5-d7915c2a2547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:57.329616 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cd2df-49fb-4894-96b5-d7915c2a2547 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:57.329939 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cd2df-49fb-4894-96b5-d7915c2a2547 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:57.330256 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cd2df-49fb-4894-96b5-d7915c2a2547 None admin] PATH_INFO: `/v3/projects/700ca39adad04b6799848d26df9719f9` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:57.331593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4cd2df-49fb-4894-96b5-d7915c2a2547 None admin] RBAC: Authorizing `identity:get_project(project_id=700ca39adad04b6799848d26df9719f9)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:57.333518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4cd2df-49fb-4894-96b5-d7915c2a2547 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:57.335278 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 599/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:53:57 2022] GET /identity/v3/projects/700ca39adad04b6799848d26df9719f9 => generated 311 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:57.342089 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357e6c3-c996-4726-b064-4546855003ad None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:57.451914 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:57.455068 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357e6c3-c996-4726-b064-4546855003ad None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:57.498497 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b498f4-1e5b-4bf1-afe5-3fcd3b4df596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:57.499223 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b498f4-1e5b-4bf1-afe5-3fcd3b4df596 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:57.499542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b498f4-1e5b-4bf1-afe5-3fcd3b4df596 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:57.499837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b498f4-1e5b-4bf1-afe5-3fcd3b4df596 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:57.500817 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b498f4-1e5b-4bf1-afe5-3fcd3b4df596 None admin] RBAC: Adding query filter params (role.id=3f9528e7a7914797a4635aa6b536b7ff, scope.project.id=700ca39adad04b6799848d26df9719f9, user.id=b88a25376574499eb221d996573645cc) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:57.501178 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b498f4-1e5b-4bf1-afe5-3fcd3b4df596 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:57.502664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b498f4-1e5b-4bf1-afe5-3fcd3b4df596 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:57.509282 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 562/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:57 2022] GET /identity/v3/role_assignments?user.id=b88a25376574499eb221d996573645cc&scope.project.id=700ca39adad04b6799848d26df9719f9&role.id=3f9528e7a7914797a4635aa6b536b7ff => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:59.585337 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659be5b5-09a1-43a3-8f9e-3d80cf24c90d None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:59.585935 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659be5b5-09a1-43a3-8f9e-3d80cf24c90d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:59.585935 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659be5b5-09a1-43a3-8f9e-3d80cf24c90d None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:59.587238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 600/1162] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:59.593070 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dd862-6a9a-4f16-b493-d900076eae05 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:59.593645 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dd862-6a9a-4f16-b493-d900076eae05 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:59.593645 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dd862-6a9a-4f16-b493-d900076eae05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:59.612347 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-125dd862-6a9a-4f16-b493-d900076eae05 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:59.613580 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-125dd862-6a9a-4f16-b493-d900076eae05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:59.696611 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 563/1163] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:59.736633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659be5b5-09a1-43a3-8f9e-3d80cf24c90d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:59.765980 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:59.856371 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659be5b5-09a1-43a3-8f9e-3d80cf24c90d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:59.912330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235de8c-666e-4c5a-8e0e-a4e800c593d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:59.913019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235de8c-666e-4c5a-8e0e-a4e800c593d5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:59.913302 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235de8c-666e-4c5a-8e0e-a4e800c593d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:59.913577 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235de8c-666e-4c5a-8e0e-a4e800c593d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:59.990227 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235de8c-666e-4c5a-8e0e-a4e800c593d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:59.991639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235de8c-666e-4c5a-8e0e-a4e800c593d5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:00.017728 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:00.105204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 601/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:54:00.112158 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125dd862-6a9a-4f16-b493-d900076eae05 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:00.209248 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:00.216507 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125dd862-6a9a-4f16-b493-d900076eae05 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:00.253252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1799c-1e55-484b-9a9f-9dd232ea13e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:00.253956 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1799c-1e55-484b-9a9f-9dd232ea13e2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:00.254247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1799c-1e55-484b-9a9f-9dd232ea13e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:00.254527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1799c-1e55-484b-9a9f-9dd232ea13e2 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:00.261695 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1799c-1e55-484b-9a9f-9dd232ea13e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:00.263176 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1799c-1e55-484b-9a9f-9dd232ea13e2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:00.277992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-0fd1799c-1e55-484b-9a9f-9dd232ea13e2 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 19 10:54:00.277992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:00.277992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 10:54:00.277992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 10:54:00.277992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:54:00.277992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:54:00.277992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:54:00.277992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:54:00.277992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 19 10:54:00.277992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:54:00.277992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:54:00.277992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:54:00.277992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:00.277992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:00.277992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:00.277992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:00.277992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:00.279852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:00.279852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:00.279852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:00.279852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:00.279852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:00.279852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:00.279852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:54:00.279852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:54:00.279852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:54:00.279852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:54:00.279852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:00.279852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:00.279852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:00.279852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:00.279852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:00.279852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:00.281615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:00.281615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:00.281615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:00.281615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:00.281615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:00.281615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:00.281615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:00.281615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:00.281615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:00.281615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:00.281615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 10:54:00.281615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:54:00.281615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 19 10:54:00.281615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:54:00.284349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 564/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jul 19 10:54:00 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:00.285654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235de8c-666e-4c5a-8e0e-a4e800c593d5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:00.393366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235de8c-666e-4c5a-8e0e-a4e800c593d5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:00.417975 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:00.430884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1efbb3-92cd-4fe1-b883-9ecbda13add5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:00.431576 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1efbb3-92cd-4fe1-b883-9ecbda13add5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:00.431847 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1efbb3-92cd-4fe1-b883-9ecbda13add5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:00.432114 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1efbb3-92cd-4fe1-b883-9ecbda13add5 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:00.432913 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1efbb3-92cd-4fe1-b883-9ecbda13add5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:00.433205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1efbb3-92cd-4fe1-b883-9ecbda13add5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:00.434606 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1efbb3-92cd-4fe1-b883-9ecbda13add5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:00.443261 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 602/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jul 19 10:54:00 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:54:02.552360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b242f-8e50-47b8-8f13-8b06019c767a None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:02.553019 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b242f-8e50-47b8-8f13-8b06019c767a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:02.553019 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b242f-8e50-47b8-8f13-8b06019c767a None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:02.554353 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 565/1167] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:54:02.560327 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21f737-d2ac-4538-a855-da9cbdd8b604 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:02.560842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21f737-d2ac-4538-a855-da9cbdd8b604 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:02.560932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21f737-d2ac-4538-a855-da9cbdd8b604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:02.577797 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ce21f737-d2ac-4538-a855-da9cbdd8b604 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:02.578997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ce21f737-d2ac-4538-a855-da9cbdd8b604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:02.647259 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 603/1168] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:02.671292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b242f-8e50-47b8-8f13-8b06019c767a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:02.780513 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b242f-8e50-47b8-8f13-8b06019c767a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:02.815443 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02c0bf-e619-4ccd-b038-ec5d7df3fd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:02.816108 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02c0bf-e619-4ccd-b038-ec5d7df3fd79 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:02.816385 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02c0bf-e619-4ccd-b038-ec5d7df3fd79 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:02.816650 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02c0bf-e619-4ccd-b038-ec5d7df3fd79 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:02.817423 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02c0bf-e619-4ccd-b038-ec5d7df3fd79 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:02.818796 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02c0bf-e619-4ccd-b038-ec5d7df3fd79 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:02.835547 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 566/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Tue Jul 19 10:54:02 2022] POST /identity/v3/domains => generated 267 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:54:04.926887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70291d9e-ccca-4d22-b7f5-a2e2ba327e5e None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:04.927411 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70291d9e-ccca-4d22-b7f5-a2e2ba327e5e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:04.927411 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70291d9e-ccca-4d22-b7f5-a2e2ba327e5e None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:04.928747 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 604/1170] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:04.934281 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdef58-a1f8-422f-8533-2b15fd94460d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:04.934704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdef58-a1f8-422f-8533-2b15fd94460d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:04.934808 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdef58-a1f8-422f-8533-2b15fd94460d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:04.952598 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a8cdef58-a1f8-422f-8533-2b15fd94460d None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:04.953954 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a8cdef58-a1f8-422f-8533-2b15fd94460d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:04.964230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:05.027598 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 567/1171] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:05.051690 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70291d9e-ccca-4d22-b7f5-a2e2ba327e5e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:05.162273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70291d9e-ccca-4d22-b7f5-a2e2ba327e5e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:05.179729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:05.198670 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f50e1-b535-4421-9af9-d97dff50345f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:05.199547 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f50e1-b535-4421-9af9-d97dff50345f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:05.199828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f50e1-b535-4421-9af9-d97dff50345f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:05.200098 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f50e1-b535-4421-9af9-d97dff50345f None admin] PATH_INFO: `/v3/domains/1e2b472f3b3f47949dc802d8d50b4f6c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:05.211303 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f50e1-b535-4421-9af9-d97dff50345f None admin] RBAC: Authorizing `identity:get_domain(domain_id=1e2b472f3b3f47949dc802d8d50b4f6c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:05.212793 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f50e1-b535-4421-9af9-d97dff50345f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:05.214503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 605/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Tue Jul 19 10:54:05 2022] GET /identity/v3/domains/1e2b472f3b3f47949dc802d8d50b4f6c => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:05.220680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdef58-a1f8-422f-8533-2b15fd94460d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:05.321286 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdef58-a1f8-422f-8533-2b15fd94460d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:05.357115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8113f9f-be93-46f1-9137-34c509083b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:05.357776 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8113f9f-be93-46f1-9137-34c509083b47 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:05.358055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8113f9f-be93-46f1-9137-34c509083b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:05.358328 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8113f9f-be93-46f1-9137-34c509083b47 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:05.359061 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8113f9f-be93-46f1-9137-34c509083b47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:05.360499 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8113f9f-be93-46f1-9137-34c509083b47 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:05.375046 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:05.389763 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 568/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 19 10:54:05 2022] POST /identity/v3/projects => generated 361 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:54:07.497374 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128bd61-960d-4aa3-8c91-1f535a4651a7 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:07.497968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128bd61-960d-4aa3-8c91-1f535a4651a7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:07.497968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128bd61-960d-4aa3-8c91-1f535a4651a7 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:07.499301 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 606/1174] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:07.505026 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f3e85-ba66-4a19-b433-22a6c56e3862 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:07.505521 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f3e85-ba66-4a19-b433-22a6c56e3862 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:07.505682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f3e85-ba66-4a19-b433-22a6c56e3862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:07.523048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-cd3f3e85-ba66-4a19-b433-22a6c56e3862 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:07.524240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cd3f3e85-ba66-4a19-b433-22a6c56e3862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:07.593378 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 569/1175] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:07.618289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128bd61-960d-4aa3-8c91-1f535a4651a7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:07.733979 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128bd61-960d-4aa3-8c91-1f535a4651a7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:07.769557 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90d1e8-220a-4a8e-bc13-c4707f2ae2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:07.770424 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90d1e8-220a-4a8e-bc13-c4707f2ae2cd None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:07.770697 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90d1e8-220a-4a8e-bc13-c4707f2ae2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:07.770965 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90d1e8-220a-4a8e-bc13-c4707f2ae2cd None admin] PATH_INFO: `/v3/domains/1e2b472f3b3f47949dc802d8d50b4f6c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:07.772137 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90d1e8-220a-4a8e-bc13-c4707f2ae2cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=1e2b472f3b3f47949dc802d8d50b4f6c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:07.773594 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90d1e8-220a-4a8e-bc13-c4707f2ae2cd None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:07.775239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 607/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Tue Jul 19 10:54:07 2022] GET /identity/v3/domains/1e2b472f3b3f47949dc802d8d50b4f6c => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:07.781309 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f3e85-ba66-4a19-b433-22a6c56e3862 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:07.883720 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f3e85-ba66-4a19-b433-22a6c56e3862 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:07.910619 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:07.920902 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2322d56-c6c5-49fa-aa06-90efb13a17c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:07.921728 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2322d56-c6c5-49fa-aa06-90efb13a17c2 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:07.922093 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2322d56-c6c5-49fa-aa06-90efb13a17c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:07.922463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2322d56-c6c5-49fa-aa06-90efb13a17c2 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:07.923262 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2322d56-c6c5-49fa-aa06-90efb13a17c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:07.924830 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2322d56-c6c5-49fa-aa06-90efb13a17c2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:07.948160 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 570/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 19 10:54:07 2022] POST /identity/v3/users => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:54:10.029356 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d2fb9-86a4-4ab1-a61c-fa4f539c262e None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:10.029974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d2fb9-86a4-4ab1-a61c-fa4f539c262e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:10.029974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d2fb9-86a4-4ab1-a61c-fa4f539c262e None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:10.031387 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 608/1178] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:10.037393 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d2fd8-a475-47b1-9224-7776d4b2c9e7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:10.037922 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d2fd8-a475-47b1-9224-7776d4b2c9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:10.037922 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d2fd8-a475-47b1-9224-7776d4b2c9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:10.055557 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ed7d2fd8-a475-47b1-9224-7776d4b2c9e7 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:10.056768 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ed7d2fd8-a475-47b1-9224-7776d4b2c9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:10.126914 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 571/1179] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:54:10.151005 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d2fb9-86a4-4ab1-a61c-fa4f539c262e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:10.201727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:10.263110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d2fb9-86a4-4ab1-a61c-fa4f539c262e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:10.297907 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277ffbb-88a5-4c73-8879-52f408c2403f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:10.298636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277ffbb-88a5-4c73-8879-52f408c2403f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:10.298910 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277ffbb-88a5-4c73-8879-52f408c2403f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:10.299181 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277ffbb-88a5-4c73-8879-52f408c2403f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:10.310022 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277ffbb-88a5-4c73-8879-52f408c2403f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:54:10.317710 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-0277ffbb-88a5-4c73-8879-52f408c2403f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:54:10.317710 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:10.317710 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:10.317710 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:10.317710 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:10.317710 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:10.317710 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:10.317710 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:10.317710 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:10.317710 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:10.317710 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:10.317710 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:10.317710 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:54:10.317710 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:54:10.317710 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:54:10.317710 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:54:10.319593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:54:10.319593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:54:10.319593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:54:10.319593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:54:10.319593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:10.319593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:10.319593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:10.319593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:10.319593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:10.319593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:10.319593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:10.319593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:10.319593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:10.319593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:10.319593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:10.319593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:10.321683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:10.321683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:10.321683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:10.321683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:10.321683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:54:10.321683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:54:10.321683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:54:10.321683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:54:10.321683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:54:10.321683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:54:10.321683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:54:10.321683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:54:10.321683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 609/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:54:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:10.327170 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d2fd8-a475-47b1-9224-7776d4b2c9e7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:10.433638 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d2fd8-a475-47b1-9224-7776d4b2c9e7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:10.448609 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:10.472304 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834738bd-6b12-476f-9460-1f7640823489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:10.473319 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834738bd-6b12-476f-9460-1f7640823489 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:10.473598 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834738bd-6b12-476f-9460-1f7640823489 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:10.473874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834738bd-6b12-476f-9460-1f7640823489 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:10.474611 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834738bd-6b12-476f-9460-1f7640823489 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:10.474914 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834738bd-6b12-476f-9460-1f7640823489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:10.476289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834738bd-6b12-476f-9460-1f7640823489 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:10.485260 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 572/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:54:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:10.491320 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277ffbb-88a5-4c73-8879-52f408c2403f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:10.600185 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277ffbb-88a5-4c73-8879-52f408c2403f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:10.602872 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:10.637381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf4343-4a6d-476a-8eb5-de2de125d422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:10.638249 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf4343-4a6d-476a-8eb5-de2de125d422 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:10.638526 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf4343-4a6d-476a-8eb5-de2de125d422 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:10.638810 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf4343-4a6d-476a-8eb5-de2de125d422 None admin] PATH_INFO: `/v3/users/f7498dc8b47d41809546e287983f18f9` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:10.654263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf4343-4a6d-476a-8eb5-de2de125d422 None admin] RBAC: Authorizing `identity:get_user(user_id=f7498dc8b47d41809546e287983f18f9)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:10.655799 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf4343-4a6d-476a-8eb5-de2de125d422 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:10.657604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 610/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:54:10 2022] GET /identity/v3/users/f7498dc8b47d41809546e287983f18f9 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:10.663876 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834738bd-6b12-476f-9460-1f7640823489 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:10.774187 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834738bd-6b12-476f-9460-1f7640823489 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:10.810060 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0379987-a861-4562-8b09-7657865a26fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:10.810687 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0379987-a861-4562-8b09-7657865a26fc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:10.810966 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0379987-a861-4562-8b09-7657865a26fc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:10.811234 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0379987-a861-4562-8b09-7657865a26fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:10.855505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:10.880880 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0379987-a861-4562-8b09-7657865a26fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:10.882338 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0379987-a861-4562-8b09-7657865a26fc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:10.985197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 573/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:54:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 10:54:10.994277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf4343-4a6d-476a-8eb5-de2de125d422 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:11.111217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf4343-4a6d-476a-8eb5-de2de125d422 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:11.150139 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844fffd-5a04-47db-9150-3f60a670abe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:11.151008 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844fffd-5a04-47db-9150-3f60a670abe5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:11.151288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844fffd-5a04-47db-9150-3f60a670abe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:11.151557 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844fffd-5a04-47db-9150-3f60a670abe5 None admin] PATH_INFO: `/v3/projects/9c4ffbdb4bb440a09c6a016b24375a7f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:11.153275 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844fffd-5a04-47db-9150-3f60a670abe5 None admin] RBAC: Authorizing `identity:get_project(project_id=9c4ffbdb4bb440a09c6a016b24375a7f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:11.154724 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844fffd-5a04-47db-9150-3f60a670abe5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:11.156506 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 611/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:54:10 2022] GET /identity/v3/projects/9c4ffbdb4bb440a09c6a016b24375a7f => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:11.163523 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0379987-a861-4562-8b09-7657865a26fc None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:11.268837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:11.295193 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0379987-a861-4562-8b09-7657865a26fc None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:11.332164 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b0cd9-5ea1-4474-a2f6-a9c53fc5049d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:11.333194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b0cd9-5ea1-4474-a2f6-a9c53fc5049d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:11.333487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b0cd9-5ea1-4474-a2f6-a9c53fc5049d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:11.333761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b0cd9-5ea1-4474-a2f6-a9c53fc5049d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:11.334604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b0cd9-5ea1-4474-a2f6-a9c53fc5049d None admin] RBAC: Adding query filter params (role.id=3f9528e7a7914797a4635aa6b536b7ff, scope.project.id=9c4ffbdb4bb440a09c6a016b24375a7f, user.id=f7498dc8b47d41809546e287983f18f9) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:11.334915 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b0cd9-5ea1-4474-a2f6-a9c53fc5049d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:11.336372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b0cd9-5ea1-4474-a2f6-a9c53fc5049d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:11.342669 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 574/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:54:11 2022] GET /identity/v3/role_assignments?user.id=f7498dc8b47d41809546e287983f18f9&scope.project.id=9c4ffbdb4bb440a09c6a016b24375a7f&role.id=3f9528e7a7914797a4635aa6b536b7ff => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:13.409052 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35d637-f9d9-4830-8d7b-485aefadac8a None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:13.409651 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35d637-f9d9-4830-8d7b-485aefadac8a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:13.409651 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35d637-f9d9-4830-8d7b-485aefadac8a None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:13.410941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 612/1186] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:13.416708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e9dcc-a61f-4707-bbd9-3c22f9543e59 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:13.417186 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e9dcc-a61f-4707-bbd9-3c22f9543e59 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:13.417286 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e9dcc-a61f-4707-bbd9-3c22f9543e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:13.435775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-af2e9dcc-a61f-4707-bbd9-3c22f9543e59 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:13.437011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-af2e9dcc-a61f-4707-bbd9-3c22f9543e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:13.506680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 575/1187] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:13.529992 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35d637-f9d9-4830-8d7b-485aefadac8a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:13.562032 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:13.636519 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35d637-f9d9-4830-8d7b-485aefadac8a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:13.671743 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dc4ce-f892-4bcd-9a88-75d0188d696b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:13.672451 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dc4ce-f892-4bcd-9a88-75d0188d696b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:13.672741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dc4ce-f892-4bcd-9a88-75d0188d696b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:13.673026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dc4ce-f892-4bcd-9a88-75d0188d696b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:13.684128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84dc4ce-f892-4bcd-9a88-75d0188d696b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:54:13.692328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-c84dc4ce-f892-4bcd-9a88-75d0188d696b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:54:13.692328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:13.692328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:13.692328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:13.692328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:13.692328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:13.692328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:13.692328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:13.692328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:13.692328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:13.692328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:13.692328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:13.692328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:54:13.692328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:54:13.692328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:54:13.692328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:54:13.693475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:54:13.693475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:54:13.693475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:54:13.693475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:54:13.693475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:13.693475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:13.693475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:13.693475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:13.693475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:13.693475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:13.693475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:13.693475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:13.693475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:13.693475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:13.693475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:13.693475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:13.694393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:13.694393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:13.694393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:13.694393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:13.694393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:54:13.694393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:54:13.694393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:54:13.694393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:54:13.694393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:54:13.694393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:54:13.694393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:54:13.694393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:54:13.694393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 613/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:54:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:13.700126 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e9dcc-a61f-4707-bbd9-3c22f9543e59 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:13.769622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:13.809716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e9dcc-a61f-4707-bbd9-3c22f9543e59 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:13.848680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774012c-b072-4069-82e1-dbfad2db5044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:13.849480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774012c-b072-4069-82e1-dbfad2db5044 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:13.849824 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774012c-b072-4069-82e1-dbfad2db5044 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:13.850160 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774012c-b072-4069-82e1-dbfad2db5044 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:13.850911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774012c-b072-4069-82e1-dbfad2db5044 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:13.851219 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774012c-b072-4069-82e1-dbfad2db5044 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:13.852603 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774012c-b072-4069-82e1-dbfad2db5044 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:13.862162 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 576/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:54:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:13.868766 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dc4ce-f892-4bcd-9a88-75d0188d696b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:13.963992 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:13.975891 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dc4ce-f892-4bcd-9a88-75d0188d696b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:14.013457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be66794-638a-4b85-b5b7-384ecf48019c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:14.014352 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be66794-638a-4b85-b5b7-384ecf48019c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:14.014714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be66794-638a-4b85-b5b7-384ecf48019c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:14.014997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be66794-638a-4b85-b5b7-384ecf48019c None admin] PATH_INFO: `/v3/users/f7498dc8b47d41809546e287983f18f9` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:14.016217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be66794-638a-4b85-b5b7-384ecf48019c None admin] RBAC: Authorizing `identity:get_user(user_id=f7498dc8b47d41809546e287983f18f9)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:14.017705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be66794-638a-4b85-b5b7-384ecf48019c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:14.019388 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 614/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:54:13 2022] GET /identity/v3/users/f7498dc8b47d41809546e287983f18f9 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:14.025642 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774012c-b072-4069-82e1-dbfad2db5044 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:14.132352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774012c-b072-4069-82e1-dbfad2db5044 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:14.163724 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:14.170213 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ddd57-7300-45f6-b8f2-ed8b39b64bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:14.171123 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ddd57-7300-45f6-b8f2-ed8b39b64bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:14.171413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ddd57-7300-45f6-b8f2-ed8b39b64bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:14.171682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ddd57-7300-45f6-b8f2-ed8b39b64bc3 None admin] PATH_INFO: `/v3/projects/9c4ffbdb4bb440a09c6a016b24375a7f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:14.172920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ddd57-7300-45f6-b8f2-ed8b39b64bc3 None admin] RBAC: Authorizing `identity:get_project(project_id=9c4ffbdb4bb440a09c6a016b24375a7f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:14.174378 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ddd57-7300-45f6-b8f2-ed8b39b64bc3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:14.176113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 577/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:54:14 2022] GET /identity/v3/projects/9c4ffbdb4bb440a09c6a016b24375a7f => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:14.182609 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be66794-638a-4b85-b5b7-384ecf48019c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:14.292125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be66794-638a-4b85-b5b7-384ecf48019c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:14.326858 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034de5b-723f-4f81-bec1-6a0232d53ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:14.327792 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034de5b-723f-4f81-bec1-6a0232d53ad9 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:14.328073 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034de5b-723f-4f81-bec1-6a0232d53ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:14.328349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034de5b-723f-4f81-bec1-6a0232d53ad9 None admin] PATH_INFO: `/v3/projects/9c4ffbdb4bb440a09c6a016b24375a7f/users/f7498dc8b47d41809546e287983f18f9/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:14.330360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034de5b-723f-4f81-bec1-6a0232d53ad9 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c4ffbdb4bb440a09c6a016b24375a7f, user_id=f7498dc8b47d41809546e287983f18f9, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:14.331804 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034de5b-723f-4f81-bec1-6a0232d53ad9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:14.345426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 615/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:54:14 2022] PUT /identity/v3/projects/9c4ffbdb4bb440a09c6a016b24375a7f/users/f7498dc8b47d41809546e287983f18f9/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 10:54:16.373053 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bfb9c-0b4d-45e1-983e-ca93077baaa3 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:16.373648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bfb9c-0b4d-45e1-983e-ca93077baaa3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:16.373648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bfb9c-0b4d-45e1-983e-ca93077baaa3 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:16.375013 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 578/1193] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:16.380629 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7177a3-42cc-4fab-bef0-aafd23d4dd89 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:16.381153 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7177a3-42cc-4fab-bef0-aafd23d4dd89 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:16.381252 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7177a3-42cc-4fab-bef0-aafd23d4dd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:16.402881 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-db7177a3-42cc-4fab-bef0-aafd23d4dd89 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:16.404096 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-db7177a3-42cc-4fab-bef0-aafd23d4dd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:16.419465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:16.482923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 616/1194] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:16.506563 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bfb9c-0b4d-45e1-983e-ca93077baaa3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:16.613970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bfb9c-0b4d-45e1-983e-ca93077baaa3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:16.649866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d550f-4c8c-4096-86a4-43f1be35d854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:16.650570 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d550f-4c8c-4096-86a4-43f1be35d854 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:16.650856 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d550f-4c8c-4096-86a4-43f1be35d854 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:16.651128 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d550f-4c8c-4096-86a4-43f1be35d854 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:16.662482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d550f-4c8c-4096-86a4-43f1be35d854 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:54:16.670142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-286d550f-4c8c-4096-86a4-43f1be35d854 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:54:16.670142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:16.670142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:16.670142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:16.670142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:16.670142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:16.670142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:16.670142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:16.670142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:16.670142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:16.670142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:16.670142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:16.670142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:54:16.670142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:54:16.670142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:54:16.670142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:54:16.671242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:54:16.671242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:54:16.671242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:54:16.671242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:54:16.671242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:16.671242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:16.671242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:16.671242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:16.671242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:16.671242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:16.671242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:16.671242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:16.671242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:16.671242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:16.671242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:16.671242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:16.672215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:16.672215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:16.672215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:16.672215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:16.672215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:54:16.672215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:54:16.672215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:54:16.672215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:54:16.672215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:54:16.672215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:54:16.672215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:54:16.672215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:54:16.676411 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 579/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:54:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:16.677646 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7177a3-42cc-4fab-bef0-aafd23d4dd89 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:16.778459 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7177a3-42cc-4fab-bef0-aafd23d4dd89 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:16.815505 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e72af3-3967-4dc9-a797-b91bad380a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:16.816169 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e72af3-3967-4dc9-a797-b91bad380a3b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:16.816441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e72af3-3967-4dc9-a797-b91bad380a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:16.816742 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e72af3-3967-4dc9-a797-b91bad380a3b None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:16.817483 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e72af3-3967-4dc9-a797-b91bad380a3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:16.817778 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e72af3-3967-4dc9-a797-b91bad380a3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:16.819141 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e72af3-3967-4dc9-a797-b91bad380a3b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:16.827212 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 617/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:54:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:16.833316 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d550f-4c8c-4096-86a4-43f1be35d854 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:16.895323 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:16.938552 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d550f-4c8c-4096-86a4-43f1be35d854 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:16.973196 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c3b2d-a3ee-4b39-897f-5a9eedff6b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:16.974078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c3b2d-a3ee-4b39-897f-5a9eedff6b4f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:16.974362 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c3b2d-a3ee-4b39-897f-5a9eedff6b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:16.974705 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c3b2d-a3ee-4b39-897f-5a9eedff6b4f None admin] PATH_INFO: `/v3/users/f7498dc8b47d41809546e287983f18f9` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:16.975865 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c3b2d-a3ee-4b39-897f-5a9eedff6b4f None admin] RBAC: Authorizing `identity:get_user(user_id=f7498dc8b47d41809546e287983f18f9)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:16.977348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c3b2d-a3ee-4b39-897f-5a9eedff6b4f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:16.978986 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 580/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 19 10:54:16 2022] GET /identity/v3/users/f7498dc8b47d41809546e287983f18f9 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:16.990101 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e72af3-3967-4dc9-a797-b91bad380a3b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:17.003786 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:17.096548 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e72af3-3967-4dc9-a797-b91bad380a3b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:17.134674 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418fe7a-aa31-47b3-af7b-8bbd3400c72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:17.135328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418fe7a-aa31-47b3-af7b-8bbd3400c72a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:17.135608 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418fe7a-aa31-47b3-af7b-8bbd3400c72a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:17.135873 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418fe7a-aa31-47b3-af7b-8bbd3400c72a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:17.207607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418fe7a-aa31-47b3-af7b-8bbd3400c72a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:17.209001 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418fe7a-aa31-47b3-af7b-8bbd3400c72a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:17.220568 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:17.314839 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 618/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:54:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:54:17.320931 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c3b2d-a3ee-4b39-897f-5a9eedff6b4f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:17.423682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c3b2d-a3ee-4b39-897f-5a9eedff6b4f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:17.452266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:17.461976 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fce81c-dabd-4728-8824-62edd20dd081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:17.462782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fce81c-dabd-4728-8824-62edd20dd081 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:17.463059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fce81c-dabd-4728-8824-62edd20dd081 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:17.463331 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fce81c-dabd-4728-8824-62edd20dd081 None admin] PATH_INFO: `/v3/projects/9c4ffbdb4bb440a09c6a016b24375a7f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:17.464513 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fce81c-dabd-4728-8824-62edd20dd081 None admin] RBAC: Authorizing `identity:get_project(project_id=9c4ffbdb4bb440a09c6a016b24375a7f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:17.465996 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fce81c-dabd-4728-8824-62edd20dd081 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:17.467775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 581/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 19 10:54:17 2022] GET /identity/v3/projects/9c4ffbdb4bb440a09c6a016b24375a7f => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:17.474478 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418fe7a-aa31-47b3-af7b-8bbd3400c72a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:17.575090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418fe7a-aa31-47b3-af7b-8bbd3400c72a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:17.586108 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:17.611061 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce5aa0-5806-460a-b6da-0dcf459950d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:17.611716 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce5aa0-5806-460a-b6da-0dcf459950d5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:17.611976 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce5aa0-5806-460a-b6da-0dcf459950d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:17.612241 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce5aa0-5806-460a-b6da-0dcf459950d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:17.613096 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce5aa0-5806-460a-b6da-0dcf459950d5 None admin] RBAC: Adding query filter params (role.id=3f9528e7a7914797a4635aa6b536b7ff, scope.project.id=9c4ffbdb4bb440a09c6a016b24375a7f, user.id=f7498dc8b47d41809546e287983f18f9) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:17.613398 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce5aa0-5806-460a-b6da-0dcf459950d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:17.614817 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce5aa0-5806-460a-b6da-0dcf459950d5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:17.620864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 619/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:54:17 2022] GET /identity/v3/role_assignments?user.id=f7498dc8b47d41809546e287983f18f9&scope.project.id=9c4ffbdb4bb440a09c6a016b24375a7f&role.id=3f9528e7a7914797a4635aa6b536b7ff => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:27.458460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:27.618103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=13 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:13.412866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118ece0-8c78-469c-a0f7-ef19127b8257 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:13.420748 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118ece0-8c78-469c-a0f7-ef19127b8257 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:13.421826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118ece0-8c78-469c-a0f7-ef19127b8257 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:13.424588 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 582/1201] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:55:13 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:55:13.432329 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f67b76-6934-4a2e-b2c6-faa059aff414 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:13.433174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f67b76-6934-4a2e-b2c6-faa059aff414 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:13.433174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f67b76-6934-4a2e-b2c6-faa059aff414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:13.456770 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-79f67b76-6934-4a2e-b2c6-faa059aff414 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:55:13.458376 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-79f67b76-6934-4a2e-b2c6-faa059aff414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:55:13.554099 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 620/1202] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:55:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:55:13.582832 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118ece0-8c78-469c-a0f7-ef19127b8257 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:13.737082 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118ece0-8c78-469c-a0f7-ef19127b8257 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:13.778104 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2c3d2-642a-4869-993b-dbf5b04ff378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:13.779069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2c3d2-642a-4869-993b-dbf5b04ff378 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:13.779358 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2c3d2-642a-4869-993b-dbf5b04ff378 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:13.779652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2c3d2-642a-4869-993b-dbf5b04ff378 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:13.795676 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2c3d2-642a-4869-993b-dbf5b04ff378 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:13.797485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2c3d2-642a-4869-993b-dbf5b04ff378 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:13.824066 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d4d2c3d2-642a-4869-993b-dbf5b04ff378 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:13.824066 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:13.824066 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:13.824066 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:13.824066 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:13.824066 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:13.824066 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:13.824066 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:13.824066 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:13.824066 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:13.824066 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:13.824066 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:13.824066 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:55:13.824066 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:55:13.824066 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:55:13.825299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:55:13.825299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:13.825299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:13.825299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:13.825299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:13.825299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:13.825299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:13.825299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:13.825299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:13.825299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:13.825299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:13.825299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:13.825299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:13.825299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:13.825299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:13.825299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:13.825299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:13.826421 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:55:13.826421 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:55:13.826421 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:13.826421 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:55:13.833936 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 583/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:55:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:13.834131 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f67b76-6934-4a2e-b2c6-faa059aff414 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:13.982946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f67b76-6934-4a2e-b2c6-faa059aff414 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:14.021332 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:14.029846 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8eb32f-8a6e-4fbf-8734-92dc4a16cfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:14.030593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8eb32f-8a6e-4fbf-8734-92dc4a16cfe0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:14.030872 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8eb32f-8a6e-4fbf-8734-92dc4a16cfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:14.031162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8eb32f-8a6e-4fbf-8734-92dc4a16cfe0 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:14.032039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8eb32f-8a6e-4fbf-8734-92dc4a16cfe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:14.032469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8eb32f-8a6e-4fbf-8734-92dc4a16cfe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:14.034261 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8eb32f-8a6e-4fbf-8734-92dc4a16cfe0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:14.050039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 621/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:14.056157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2c3d2-642a-4869-993b-dbf5b04ff378 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:14.140407 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:14.210002 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2c3d2-642a-4869-993b-dbf5b04ff378 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:14.257794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47e656-a437-4973-b3f0-97a8b92e3074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:14.258477 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47e656-a437-4973-b3f0-97a8b92e3074 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:14.258808 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47e656-a437-4973-b3f0-97a8b92e3074 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:14.259044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47e656-a437-4973-b3f0-97a8b92e3074 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:14.259858 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47e656-a437-4973-b3f0-97a8b92e3074 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:14.261409 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47e656-a437-4973-b3f0-97a8b92e3074 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:14.286271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 584/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 19 10:55:14 2022] POST /identity/v3/users => generated 251 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:55:16.773521 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f951dc-d5e1-4aaf-9c72-76c45d81d6cf None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:16.774072 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f951dc-d5e1-4aaf-9c72-76c45d81d6cf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:16.774072 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f951dc-d5e1-4aaf-9c72-76c45d81d6cf None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:16.775779 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 622/1206] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:55:16.782456 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bf817-1492-4a2b-9f33-d40059ceb8d1 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:16.783004 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bf817-1492-4a2b-9f33-d40059ceb8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:16.783004 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bf817-1492-4a2b-9f33-d40059ceb8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:16.817279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9a1bf817-1492-4a2b-9f33-d40059ceb8d1 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:55:16.824751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9a1bf817-1492-4a2b-9f33-d40059ceb8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:55:17.057643 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 585/1207] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:55:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:55:17.100586 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f951dc-d5e1-4aaf-9c72-76c45d81d6cf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:17.249737 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f951dc-d5e1-4aaf-9c72-76c45d81d6cf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:17.299702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37da58-66a4-4b35-8743-a253da42f153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:17.300635 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37da58-66a4-4b35-8743-a253da42f153 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:17.300953 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37da58-66a4-4b35-8743-a253da42f153 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:17.301237 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37da58-66a4-4b35-8743-a253da42f153 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:17.314866 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37da58-66a4-4b35-8743-a253da42f153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:55:17.328619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-3b37da58-66a4-4b35-8743-a253da42f153 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:55:17.328619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:17.328619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:17.328619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:17.328619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:17.328619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:17.328619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:17.328619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:17.328619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:17.328619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:17.328619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:17.328619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:17.328619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:55:17.328619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:55:17.328619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:55:17.328619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:55:17.329894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:55:17.329894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:55:17.329894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:55:17.329894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:55:17.329894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:17.329894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:17.329894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:17.329894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:17.329894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:17.329894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:17.329894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:17.329894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:17.329894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:17.329894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:17.329894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:17.329894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:17.330871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:17.330871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:17.330871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:17.330871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:17.330871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:55:17.330871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:55:17.330871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:55:17.330871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:55:17.330871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:55:17.330871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:55:17.330871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:55:17.330871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:17.330871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 623/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:55:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:55:17.338108 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1bf817-1492-4a2b-9f33-d40059ceb8d1 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:17.458092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:17.587277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1bf817-1492-4a2b-9f33-d40059ceb8d1 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:17.637512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685aa2a9-d2b3-422b-96f0-75fd97d07b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:17.638304 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aa2a9-d2b3-422b-96f0-75fd97d07b5b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:17.638586 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aa2a9-d2b3-422b-96f0-75fd97d07b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:17.638867 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aa2a9-d2b3-422b-96f0-75fd97d07b5b None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:17.639650 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685aa2a9-d2b3-422b-96f0-75fd97d07b5b None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:17.639988 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685aa2a9-d2b3-422b-96f0-75fd97d07b5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:17.641498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685aa2a9-d2b3-422b-96f0-75fd97d07b5b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:17.654935 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 586/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 19 10:55:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:17.661426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37da58-66a4-4b35-8743-a253da42f153 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:17.735998 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:17.814153 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37da58-66a4-4b35-8743-a253da42f153 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:17.876498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68ad1c-30d9-4dbf-9ac3-d5bb9ea0fa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:17.877885 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68ad1c-30d9-4dbf-9ac3-d5bb9ea0fa5a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:17.878257 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68ad1c-30d9-4dbf-9ac3-d5bb9ea0fa5a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:17.878580 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68ad1c-30d9-4dbf-9ac3-d5bb9ea0fa5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:17.897643 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68ad1c-30d9-4dbf-9ac3-d5bb9ea0fa5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:17.899210 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68ad1c-30d9-4dbf-9ac3-d5bb9ea0fa5a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:17.917855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-8e68ad1c-30d9-4dbf-9ac3-d5bb9ea0fa5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:17.917855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:17.917855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:17.917855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:17.917855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:17.917855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:17.917855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:17.917855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:17.917855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:17.917855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:17.917855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:17.917855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:17.917855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:55:17.917855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:55:17.917855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:55:17.918989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:55:17.918989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:17.918989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:17.918989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:17.918989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:17.918989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:17.918989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:17.918989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:17.918989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:17.918989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:17.918989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:17.918989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:17.918989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:17.918989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:17.918989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:17.918989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:17.918989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:17.920173 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:55:17.920173 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:55:17.920173 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:17.920173 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:17.920951 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 624/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:55:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:17.928210 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685aa2a9-d2b3-422b-96f0-75fd97d07b5b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:18.105693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:18.109302 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685aa2a9-d2b3-422b-96f0-75fd97d07b5b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:18.157953 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcabb16-2069-4607-8eec-e07acd3ad0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:18.158814 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcabb16-2069-4607-8eec-e07acd3ad0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:18.159357 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcabb16-2069-4607-8eec-e07acd3ad0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:18.159902 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcabb16-2069-4607-8eec-e07acd3ad0f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:18.160893 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcabb16-2069-4607-8eec-e07acd3ad0f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:18.161422 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcabb16-2069-4607-8eec-e07acd3ad0f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:18.163279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcabb16-2069-4607-8eec-e07acd3ad0f3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:18.183775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 587/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:18.191295 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68ad1c-30d9-4dbf-9ac3-d5bb9ea0fa5a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:18.336775 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68ad1c-30d9-4dbf-9ac3-d5bb9ea0fa5a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:18.338804 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:18.378088 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e4ab9-4414-4577-93e7-7ed950b2048d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:18.378960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e4ab9-4414-4577-93e7-7ed950b2048d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:18.379234 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e4ab9-4414-4577-93e7-7ed950b2048d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:18.379509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e4ab9-4414-4577-93e7-7ed950b2048d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:18.388645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e4ab9-4414-4577-93e7-7ed950b2048d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:18.390236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e4ab9-4414-4577-93e7-7ed950b2048d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:18.406522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-465e4ab9-4414-4577-93e7-7ed950b2048d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:55:18.406522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:18.406522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:18.406522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:18.406522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:18.406522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:18.406522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:18.406522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:18.406522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:18.406522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:18.406522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:18.406522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:18.406522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:55:18.406522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:55:18.406522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:55:18.406522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:55:18.407807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:18.407807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:18.407807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:55:18.407807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:55:18.407807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:55:18.407807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:55:18.407807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:18.407807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:18.407807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:18.407807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:18.407807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:18.407807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:18.407807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:18.407807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:18.407807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:18.407807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:18.407807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:18.407807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:18.414638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:18.414638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:18.414638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:55:18.414638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:55:18.414638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:55:18.414638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:55:18.414638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:55:18.414638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:55:18.414638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:55:18.414638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:18.414638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 625/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:55:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:18.416853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcabb16-2069-4607-8eec-e07acd3ad0f3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:18.555670 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcabb16-2069-4607-8eec-e07acd3ad0f3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:18.593502 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66025ddc-4a3e-45d0-9164-bfd939b18157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:18.594187 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66025ddc-4a3e-45d0-9164-bfd939b18157 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:18.594483 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66025ddc-4a3e-45d0-9164-bfd939b18157 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:18.594749 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66025ddc-4a3e-45d0-9164-bfd939b18157 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:18.596157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66025ddc-4a3e-45d0-9164-bfd939b18157 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:18.596461 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66025ddc-4a3e-45d0-9164-bfd939b18157 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:18.597936 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66025ddc-4a3e-45d0-9164-bfd939b18157 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:18.620617 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 588/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jul 19 10:55:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:18.626559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e4ab9-4414-4577-93e7-7ed950b2048d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:18.738892 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e4ab9-4414-4577-93e7-7ed950b2048d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:18.783878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cec0db-d99f-40d1-ab08-fb88412efe78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:18.784697 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cec0db-d99f-40d1-ab08-fb88412efe78 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:18.784930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cec0db-d99f-40d1-ab08-fb88412efe78 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:18.785180 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cec0db-d99f-40d1-ab08-fb88412efe78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:18.820327 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:18.865416 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cec0db-d99f-40d1-ab08-fb88412efe78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:18.867019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cec0db-d99f-40d1-ab08-fb88412efe78 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:18.986006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 626/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:55:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 10:55:18.992011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66025ddc-4a3e-45d0-9164-bfd939b18157 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:19.013188 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:19.115072 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66025ddc-4a3e-45d0-9164-bfd939b18157 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:19.182651 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cea79-857c-4877-9100-dc1e7b15626f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:19.183580 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cea79-857c-4877-9100-dc1e7b15626f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:19.183947 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cea79-857c-4877-9100-dc1e7b15626f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:19.184521 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cea79-857c-4877-9100-dc1e7b15626f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:19.203707 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cea79-857c-4877-9100-dc1e7b15626f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:19.205547 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cea79-857c-4877-9100-dc1e7b15626f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:19.228505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-678cea79-857c-4877-9100-dc1e7b15626f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:19.228505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:19.228505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:19.228505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:19.228505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:19.228505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:19.228505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:19.228505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:19.228505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:19.228505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:19.228505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:19.228505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:19.228505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:55:19.228505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:55:19.228505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:55:19.229723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:55:19.229723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:19.229723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:19.229723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:19.229723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:19.229723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:19.229723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:19.229723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:19.229723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:19.229723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:19.229723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:19.229723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:19.229723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:19.229723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:19.229723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:19.229723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:19.229723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:19.231032 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:55:19.231032 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:55:19.231032 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:19.231032 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:55:19.234976 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 589/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:55:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:55:19.238051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cec0db-d99f-40d1-ab08-fb88412efe78 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:19.331113 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:19.383667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cec0db-d99f-40d1-ab08-fb88412efe78 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:19.432567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515d0d2-c8ef-4cdd-b3a4-17b2c19662bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:19.433596 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515d0d2-c8ef-4cdd-b3a4-17b2c19662bc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:19.434107 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515d0d2-c8ef-4cdd-b3a4-17b2c19662bc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:19.434419 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515d0d2-c8ef-4cdd-b3a4-17b2c19662bc None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:19.435266 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515d0d2-c8ef-4cdd-b3a4-17b2c19662bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:19.435573 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515d0d2-c8ef-4cdd-b3a4-17b2c19662bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:19.437120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515d0d2-c8ef-4cdd-b3a4-17b2c19662bc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:19.452979 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 627/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:55:19.458990 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cea79-857c-4877-9100-dc1e7b15626f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:19.545234 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:19.582952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cea79-857c-4877-9100-dc1e7b15626f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:19.624607 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34047f-7d8c-4de7-b419-bfc0e00c3ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:19.626148 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34047f-7d8c-4de7-b419-bfc0e00c3ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:19.626837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34047f-7d8c-4de7-b419-bfc0e00c3ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:19.627425 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34047f-7d8c-4de7-b419-bfc0e00c3ff8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:19.636671 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34047f-7d8c-4de7-b419-bfc0e00c3ff8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:19.639195 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34047f-7d8c-4de7-b419-bfc0e00c3ff8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:19.657544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-4a34047f-7d8c-4de7-b419-bfc0e00c3ff8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:55:19.657544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:19.657544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:19.657544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:19.657544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:19.657544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:19.657544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:19.657544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:19.657544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:19.657544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:19.657544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:19.657544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:19.657544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:55:19.657544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:55:19.657544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:55:19.659153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:55:19.659153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:19.659153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:19.659153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:19.659153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:19.659153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:19.659153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:19.659153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:19.659153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:19.659153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:19.659153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:19.659153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:19.659153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:19.659153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:19.659153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:19.659153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:19.659153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:19.660415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:55:19.660415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:55:19.660415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:55:19.660415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:55:19.660415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:55:19.660415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:55:19.660415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:55:19.660415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:55:19.662459 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 590/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:55:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:55:19.670709 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515d0d2-c8ef-4cdd-b3a4-17b2c19662bc None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:19.808589 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515d0d2-c8ef-4cdd-b3a4-17b2c19662bc None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:19.835878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:19.850411 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131417d-4d67-463c-9606-5ea3a4683f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:19.851129 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131417d-4d67-463c-9606-5ea3a4683f0a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:19.851479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131417d-4d67-463c-9606-5ea3a4683f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:19.851803 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131417d-4d67-463c-9606-5ea3a4683f0a None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:19.852758 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131417d-4d67-463c-9606-5ea3a4683f0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:19.853070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131417d-4d67-463c-9606-5ea3a4683f0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:19.854721 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131417d-4d67-463c-9606-5ea3a4683f0a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:19.870965 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 628/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:55:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:19.876851 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34047f-7d8c-4de7-b419-bfc0e00c3ff8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:20.004533 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34047f-7d8c-4de7-b419-bfc0e00c3ff8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:20.042581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:20.051052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990eec79-8f2c-4062-9172-683ee5df7cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:20.052156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990eec79-8f2c-4062-9172-683ee5df7cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:20.052573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990eec79-8f2c-4062-9172-683ee5df7cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:20.053116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990eec79-8f2c-4062-9172-683ee5df7cb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:20.054383 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990eec79-8f2c-4062-9172-683ee5df7cb8 None admin] RBAC: Adding query filter params (role.id=669088b4ca4644f4bb586dfeaf427fb0, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=cc3d4e645a3349e78452f67cbe79f052) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:20.054838 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990eec79-8f2c-4062-9172-683ee5df7cb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:20.056937 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990eec79-8f2c-4062-9172-683ee5df7cb8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:20.064561 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 591/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:55:19 2022] GET /identity/v3/role_assignments?user.id=cc3d4e645a3349e78452f67cbe79f052&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=669088b4ca4644f4bb586dfeaf427fb0 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:22.216529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15273e81-cc36-405b-935f-e5ffe34b7111 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:22.217139 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15273e81-cc36-405b-935f-e5ffe34b7111 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:22.217139 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15273e81-cc36-405b-935f-e5ffe34b7111 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:22.218492 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 629/1220] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:55:22.224377 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dc2f4-3351-4f44-b58f-08605c7e81a5 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:22.224928 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dc2f4-3351-4f44-b58f-08605c7e81a5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:22.225085 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dc2f4-3351-4f44-b58f-08605c7e81a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:22.243352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-cf4dc2f4-3351-4f44-b58f-08605c7e81a5 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:55:22.244613 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cf4dc2f4-3351-4f44-b58f-08605c7e81a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:55:22.319657 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 592/1221] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:55:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:55:22.343806 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15273e81-cc36-405b-935f-e5ffe34b7111 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:22.456769 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15273e81-cc36-405b-935f-e5ffe34b7111 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:22.496066 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c9d29-c058-42a9-89b4-97be51ba256a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:22.496799 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c9d29-c058-42a9-89b4-97be51ba256a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:22.497101 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c9d29-c058-42a9-89b4-97be51ba256a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:22.497401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c9d29-c058-42a9-89b4-97be51ba256a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:22.508270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c9d29-c058-42a9-89b4-97be51ba256a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:55:22.516404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-f93c9d29-c058-42a9-89b4-97be51ba256a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:55:22.516404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:22.516404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:22.516404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:22.516404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:22.516404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:22.516404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:22.516404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:22.516404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:22.516404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:22.516404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:22.516404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:22.516404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:55:22.516404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:55:22.516404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:55:22.516404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:55:22.517437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:55:22.517437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:55:22.517437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:55:22.517437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:55:22.517437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:22.517437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:22.517437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:22.517437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:22.517437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:22.517437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:22.517437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:22.517437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:22.517437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:22.517437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:22.517437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:22.517437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:22.518265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:22.518265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:22.518265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:22.518265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:22.518265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:55:22.518265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:55:22.518265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:55:22.518265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:55:22.518265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:55:22.518265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:55:22.518265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:55:22.518265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:22.518265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 630/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:55:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:22.524742 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dc2f4-3351-4f44-b58f-08605c7e81a5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:22.639027 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dc2f4-3351-4f44-b58f-08605c7e81a5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:22.669566 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:22.683531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89f469-5fc5-4223-9221-0174f6716fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:22.684267 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89f469-5fc5-4223-9221-0174f6716fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:22.684550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89f469-5fc5-4223-9221-0174f6716fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:22.684983 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89f469-5fc5-4223-9221-0174f6716fc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:22.685738 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89f469-5fc5-4223-9221-0174f6716fc4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:22.686046 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89f469-5fc5-4223-9221-0174f6716fc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:22.687428 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89f469-5fc5-4223-9221-0174f6716fc4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:22.695981 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 593/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 19 10:55:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:22.702042 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c9d29-c058-42a9-89b4-97be51ba256a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:22.748065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:22.818026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c9d29-c058-42a9-89b4-97be51ba256a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:22.857530 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce9bc2-809e-429c-a9d5-7172b0f8d0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:22.858409 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce9bc2-809e-429c-a9d5-7172b0f8d0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:22.858662 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce9bc2-809e-429c-a9d5-7172b0f8d0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:22.858929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce9bc2-809e-429c-a9d5-7172b0f8d0d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:22.870954 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce9bc2-809e-429c-a9d5-7172b0f8d0d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:22.872613 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce9bc2-809e-429c-a9d5-7172b0f8d0d6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:22.890689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-afce9bc2-809e-429c-a9d5-7172b0f8d0d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:22.890689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:22.890689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:22.890689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:22.890689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:22.890689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:22.890689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:22.890689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:22.890689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:22.890689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:22.890689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:22.890689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:22.890689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:55:22.890689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:55:22.890689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:55:22.891677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:55:22.891677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:22.891677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:22.891677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:22.891677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:22.891677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:22.891677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:22.891677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:22.891677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:22.891677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:22.891677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:22.891677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:22.891677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:22.891677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:22.891677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:22.891677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:22.891677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:22.892574 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:55:22.892574 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:55:22.892574 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:22.892574 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:22.892574 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 631/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:55:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:22.898430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89f469-5fc5-4223-9221-0174f6716fc4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:23.005866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89f469-5fc5-4223-9221-0174f6716fc4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:23.043643 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64d129-282d-492d-a9c8-ffaf7b7828c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:23.044448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64d129-282d-492d-a9c8-ffaf7b7828c7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:23.044693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64d129-282d-492d-a9c8-ffaf7b7828c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:23.045004 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64d129-282d-492d-a9c8-ffaf7b7828c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:23.045815 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64d129-282d-492d-a9c8-ffaf7b7828c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:23.046150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64d129-282d-492d-a9c8-ffaf7b7828c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:23.047657 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64d129-282d-492d-a9c8-ffaf7b7828c7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:23.061024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 594/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:23.067167 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce9bc2-809e-429c-a9d5-7172b0f8d0d6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:23.180558 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:23.187679 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce9bc2-809e-429c-a9d5-7172b0f8d0d6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:23.225063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a28fc5-0a32-4754-a036-825bc1d0beb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:23.225908 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a28fc5-0a32-4754-a036-825bc1d0beb2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:23.226192 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a28fc5-0a32-4754-a036-825bc1d0beb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:23.226517 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a28fc5-0a32-4754-a036-825bc1d0beb2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:23.236457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a28fc5-0a32-4754-a036-825bc1d0beb2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:23.238159 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a28fc5-0a32-4754-a036-825bc1d0beb2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:23.257148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-42a28fc5-0a32-4754-a036-825bc1d0beb2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:55:23.257148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:23.257148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:23.257148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:23.257148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:23.257148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:23.257148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:23.257148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:23.257148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:23.257148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:23.257148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:23.257148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:23.257148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:55:23.257148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:55:23.257148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:55:23.257148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:55:23.258338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:23.258338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:23.258338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:55:23.258338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:55:23.258338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:55:23.258338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:55:23.258338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:23.258338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:23.258338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:23.258338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:23.258338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:23.258338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:23.258338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:23.258338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:23.258338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:23.258338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:23.258338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:23.258338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:23.259479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:23.259479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:23.259479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:55:23.259479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:55:23.259479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:55:23.259479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:55:23.259479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:55:23.259479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:55:23.259479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:55:23.259479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:23.259479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 632/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:55:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:23.265037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64d129-282d-492d-a9c8-ffaf7b7828c7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:23.320002 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:23.384604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64d129-282d-492d-a9c8-ffaf7b7828c7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:23.425047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c396c1-55f5-44f7-9256-4949c7d01f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:23.425736 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c396c1-55f5-44f7-9256-4949c7d01f93 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:23.426018 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c396c1-55f5-44f7-9256-4949c7d01f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:23.426493 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c396c1-55f5-44f7-9256-4949c7d01f93 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:23.427228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c396c1-55f5-44f7-9256-4949c7d01f93 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:23.427583 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c396c1-55f5-44f7-9256-4949c7d01f93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:23.429274 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c396c1-55f5-44f7-9256-4949c7d01f93 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:23.454263 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 595/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jul 19 10:55:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:23.460512 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a28fc5-0a32-4754-a036-825bc1d0beb2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:23.574908 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a28fc5-0a32-4754-a036-825bc1d0beb2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:23.618707 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e4ff0-6217-46b1-8c86-654819409e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:23.619653 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e4ff0-6217-46b1-8c86-654819409e29 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:23.619955 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e4ff0-6217-46b1-8c86-654819409e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:23.620361 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e4ff0-6217-46b1-8c86-654819409e29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:23.632779 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e4ff0-6217-46b1-8c86-654819409e29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:23.634240 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e4ff0-6217-46b1-8c86-654819409e29 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:23.652385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d23e4ff0-6217-46b1-8c86-654819409e29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:23.652385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:23.652385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:23.652385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:23.652385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:23.652385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:23.652385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:23.652385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:23.652385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:23.652385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:23.652385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:23.652385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:23.652385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:55:23.652385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:55:23.652385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:55:23.653600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:55:23.653600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:23.653600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:23.653600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:23.653600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:23.653600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:23.653600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:23.653600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:23.653600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:23.653600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:23.653600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:23.653600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:23.653600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:23.653600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:23.653600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:23.653600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:23.653600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:23.654610 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:55:23.654610 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:55:23.654610 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:23.654610 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:23.654610 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 633/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:55:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:55:23.660419 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c396c1-55f5-44f7-9256-4949c7d01f93 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:23.767838 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c396c1-55f5-44f7-9256-4949c7d01f93 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:23.770680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:23.805421 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17b117-4a86-4f8e-b1bf-abc7ec8f3bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:23.806110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17b117-4a86-4f8e-b1bf-abc7ec8f3bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:23.806411 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17b117-4a86-4f8e-b1bf-abc7ec8f3bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:23.806660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17b117-4a86-4f8e-b1bf-abc7ec8f3bf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:23.807455 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17b117-4a86-4f8e-b1bf-abc7ec8f3bf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:23.807762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17b117-4a86-4f8e-b1bf-abc7ec8f3bf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:23.809209 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17b117-4a86-4f8e-b1bf-abc7ec8f3bf2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:23.822814 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 596/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:23.829260 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e4ff0-6217-46b1-8c86-654819409e29 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:23.839922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:23.940693 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e4ff0-6217-46b1-8c86-654819409e29 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:23.979065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba03ed8-0b10-42c0-acc4-c0ee21422d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:23.979923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba03ed8-0b10-42c0-acc4-c0ee21422d2b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:23.980205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba03ed8-0b10-42c0-acc4-c0ee21422d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:23.980479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba03ed8-0b10-42c0-acc4-c0ee21422d2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:23.987901 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba03ed8-0b10-42c0-acc4-c0ee21422d2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:23.989500 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba03ed8-0b10-42c0-acc4-c0ee21422d2b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:24.005783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-1ba03ed8-0b10-42c0-acc4-c0ee21422d2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:55:24.005783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:24.005783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:24.005783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:24.005783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:24.005783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:24.005783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:24.005783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:24.005783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:24.005783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:24.005783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:24.005783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:24.005783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:55:24.005783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:55:24.005783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:55:24.006899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:55:24.006899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:24.006899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:24.006899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:24.006899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:24.006899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:24.006899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:24.006899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:24.006899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:24.006899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:24.006899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:24.006899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:24.006899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:24.006899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:24.006899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:24.006899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:24.006899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:24.007934 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:55:24.007934 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:55:24.007934 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:55:24.007934 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:55:24.007934 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:55:24.007934 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:55:24.007934 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:55:24.007934 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:24.007934 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 634/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:55:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:24.013527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17b117-4a86-4f8e-b1bf-abc7ec8f3bf2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:24.128059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17b117-4a86-4f8e-b1bf-abc7ec8f3bf2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:24.168324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d41883-021a-4451-89a4-09bb800e3eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:24.169191 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d41883-021a-4451-89a4-09bb800e3eea None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:24.169606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d41883-021a-4451-89a4-09bb800e3eea None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:24.170014 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d41883-021a-4451-89a4-09bb800e3eea None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:24.171003 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d41883-021a-4451-89a4-09bb800e3eea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:24.171439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d41883-021a-4451-89a4-09bb800e3eea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:24.173443 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d41883-021a-4451-89a4-09bb800e3eea None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:24.188596 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 597/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:55:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:55:24.194728 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba03ed8-0b10-42c0-acc4-c0ee21422d2b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:24.268521 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:24.306618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba03ed8-0b10-42c0-acc4-c0ee21422d2b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:24.345351 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5fa2d-33e9-4a4d-855b-79aff12f4f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:24.346255 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5fa2d-33e9-4a4d-855b-79aff12f4f25 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:24.346536 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5fa2d-33e9-4a4d-855b-79aff12f4f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:24.346809 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5fa2d-33e9-4a4d-855b-79aff12f4f25 None admin] PATH_INFO: `/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/cc3d4e645a3349e78452f67cbe79f052/roles/669088b4ca4644f4bb586dfeaf427fb0` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:24.361802 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5fa2d-33e9-4a4d-855b-79aff12f4f25 None admin] RBAC: Authorizing `identity:create_grant(project_id=789e54670f7c40ffb67f20478aba00f2, user_id=cc3d4e645a3349e78452f67cbe79f052, role_id=669088b4ca4644f4bb586dfeaf427fb0)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:24.363468 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5fa2d-33e9-4a4d-855b-79aff12f4f25 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:24.377116 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 635/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:55:24 2022] PUT /identity/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/cc3d4e645a3349e78452f67cbe79f052/roles/669088b4ca4644f4bb586dfeaf427fb0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 10:55:26.554712 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85a976-ca88-4239-af89-ca39973056a2 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:26.555304 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85a976-ca88-4239-af89-ca39973056a2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:26.555304 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85a976-ca88-4239-af89-ca39973056a2 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:26.556680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 598/1233] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:55:26.563273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871da149-3359-4e65-8804-9bfbc48a4f6e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:26.563902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871da149-3359-4e65-8804-9bfbc48a4f6e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:26.563902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871da149-3359-4e65-8804-9bfbc48a4f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:26.583502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-871da149-3359-4e65-8804-9bfbc48a4f6e None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:55:26.584773 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-871da149-3359-4e65-8804-9bfbc48a4f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:55:26.664634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 636/1234] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:55:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:55:26.690040 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85a976-ca88-4239-af89-ca39973056a2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:26.725027 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:26.812703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85a976-ca88-4239-af89-ca39973056a2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:26.850987 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdf6b1-82a0-4e1d-8b1a-142d50fee872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:26.852105 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdf6b1-82a0-4e1d-8b1a-142d50fee872 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:26.852404 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdf6b1-82a0-4e1d-8b1a-142d50fee872 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:26.852658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdf6b1-82a0-4e1d-8b1a-142d50fee872 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:26.863759 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcdf6b1-82a0-4e1d-8b1a-142d50fee872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:55:26.871430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-5fcdf6b1-82a0-4e1d-8b1a-142d50fee872 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:55:26.871430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:26.871430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:26.871430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:26.871430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:26.871430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:26.871430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:26.871430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:26.871430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:26.871430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:26.871430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:26.871430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:26.871430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:55:26.871430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:55:26.871430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:55:26.871430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:55:26.872730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:55:26.872730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:55:26.872730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:55:26.872730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:55:26.872730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:26.872730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:26.872730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:26.872730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:26.872730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:26.872730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:26.872730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:26.872730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:26.872730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:26.872730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:26.872730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:26.872730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:26.873782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:26.873782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:26.873782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:26.873782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:26.873782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:55:26.873782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:55:26.873782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:55:26.873782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:55:26.873782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:55:26.873782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:55:26.873782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:55:26.873782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:55:26.873782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 599/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 19 10:55:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:26.879075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871da149-3359-4e65-8804-9bfbc48a4f6e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:26.927584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:26.991842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871da149-3359-4e65-8804-9bfbc48a4f6e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:27.029586 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139602d-fe3a-40a9-981a-91454859ee68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:27.030451 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139602d-fe3a-40a9-981a-91454859ee68 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:27.030888 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139602d-fe3a-40a9-981a-91454859ee68 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:27.031206 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139602d-fe3a-40a9-981a-91454859ee68 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:27.032062 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139602d-fe3a-40a9-981a-91454859ee68 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:27.032463 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139602d-fe3a-40a9-981a-91454859ee68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:27.033963 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139602d-fe3a-40a9-981a-91454859ee68 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:27.042943 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 637/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 19 10:55:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:55:27.048967 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdf6b1-82a0-4e1d-8b1a-142d50fee872 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:27.141809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:27.165284 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdf6b1-82a0-4e1d-8b1a-142d50fee872 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:27.204373 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c9ad8-b9c4-446b-bcb9-b93662d6cb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:27.205195 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c9ad8-b9c4-446b-bcb9-b93662d6cb03 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:27.205504 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c9ad8-b9c4-446b-bcb9-b93662d6cb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:27.205780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c9ad8-b9c4-446b-bcb9-b93662d6cb03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:27.217980 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c9ad8-b9c4-446b-bcb9-b93662d6cb03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:27.219538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c9ad8-b9c4-446b-bcb9-b93662d6cb03 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:27.238153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-b62c9ad8-b9c4-446b-bcb9-b93662d6cb03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:27.238153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:27.238153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:27.238153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:27.238153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:27.238153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:27.238153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:27.238153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:27.238153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:27.238153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:27.238153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:27.238153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:27.238153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:55:27.238153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:55:27.238153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:55:27.239252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:55:27.239252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:27.239252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:27.239252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:27.239252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:27.239252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:27.239252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:27.239252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:27.239252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:27.239252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:27.239252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:27.239252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:27.239252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:27.239252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:27.239252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:27.239252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:27.239252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:27.240159 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:55:27.240159 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:55:27.240159 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:27.240159 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:55:27.240159 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 600/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:55:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:55:27.245896 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139602d-fe3a-40a9-981a-91454859ee68 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:27.352086 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139602d-fe3a-40a9-981a-91454859ee68 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:27.361437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:27.386846 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580afd6-7599-4972-a028-4a0abbc7e6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:27.387637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580afd6-7599-4972-a028-4a0abbc7e6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:27.387863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580afd6-7599-4972-a028-4a0abbc7e6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:27.388132 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580afd6-7599-4972-a028-4a0abbc7e6c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:27.388906 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580afd6-7599-4972-a028-4a0abbc7e6c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:27.389214 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580afd6-7599-4972-a028-4a0abbc7e6c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:27.390673 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580afd6-7599-4972-a028-4a0abbc7e6c4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:27.404923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 638/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:27.410891 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c9ad8-b9c4-446b-bcb9-b93662d6cb03 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:27.527676 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c9ad8-b9c4-446b-bcb9-b93662d6cb03 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:27.567764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f0f0c-ac50-49eb-ac4f-7d71eacff1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:27.568592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f0f0c-ac50-49eb-ac4f-7d71eacff1df None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:27.568899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f0f0c-ac50-49eb-ac4f-7d71eacff1df None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:27.569170 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f0f0c-ac50-49eb-ac4f-7d71eacff1df None admin] PATH_INFO: `/v3/users/placement` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:27.572286 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:27.578240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f0f0c-ac50-49eb-ac4f-7d71eacff1df None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:27.579927 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f0f0c-ac50-49eb-ac4f-7d71eacff1df None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:27.595110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-7e3f0f0c-ac50-49eb-ac4f-7d71eacff1df None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:55:27.595110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:27.595110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:27.595110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:27.595110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:27.595110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:27.595110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:27.595110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:27.595110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:27.595110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:27.595110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:27.595110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:27.595110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:55:27.595110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:55:27.595110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:55:27.595110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:55:27.596397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:27.596397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:27.596397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:55:27.596397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:55:27.596397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:55:27.596397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:55:27.596397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:27.596397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:27.596397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:27.596397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:27.596397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:27.596397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:27.596397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:27.596397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:27.596397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:27.596397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:27.596397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:27.596397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:27.597389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:27.597389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:27.597389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:55:27.597389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:55:27.597389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:55:27.597389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:55:27.597389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:55:27.597389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:55:27.597389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:55:27.597389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:55:27.597389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 601/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:55:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:27.602344 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580afd6-7599-4972-a028-4a0abbc7e6c4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:27.706964 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580afd6-7599-4972-a028-4a0abbc7e6c4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:27.744310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a9e6e-2819-4578-a369-c2e6605206ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:27.745070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a9e6e-2819-4578-a369-c2e6605206ba None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:27.745306 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a9e6e-2819-4578-a369-c2e6605206ba None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:27.745599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a9e6e-2819-4578-a369-c2e6605206ba None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:27.746414 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a9e6e-2819-4578-a369-c2e6605206ba None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:27.746715 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a9e6e-2819-4578-a369-c2e6605206ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:27.748201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a9e6e-2819-4578-a369-c2e6605206ba None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:27.767664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 639/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jul 19 10:55:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:27.773672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f0f0c-ac50-49eb-ac4f-7d71eacff1df None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:27.878858 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f0f0c-ac50-49eb-ac4f-7d71eacff1df None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:27.916848 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cba9d8-65e2-413b-96e5-86f7d3391faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:27.917493 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cba9d8-65e2-413b-96e5-86f7d3391faf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:27.917762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cba9d8-65e2-413b-96e5-86f7d3391faf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:27.918039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cba9d8-65e2-413b-96e5-86f7d3391faf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:27.990842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:27.998260 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cba9d8-65e2-413b-96e5-86f7d3391faf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:27.999733 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cba9d8-65e2-413b-96e5-86f7d3391faf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:28.121137 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 602/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:55:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:55:28.127923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a9e6e-2819-4578-a369-c2e6605206ba None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:28.161117 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:28.241915 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a9e6e-2819-4578-a369-c2e6605206ba None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:28.277201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f72ee-ee6c-4948-af65-714b31a8d970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:28.278011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f72ee-ee6c-4948-af65-714b31a8d970 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:28.278294 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f72ee-ee6c-4948-af65-714b31a8d970 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:28.278590 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f72ee-ee6c-4948-af65-714b31a8d970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:28.290053 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f72ee-ee6c-4948-af65-714b31a8d970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:28.291907 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f72ee-ee6c-4948-af65-714b31a8d970 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:28.315172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-240f72ee-ee6c-4948-af65-714b31a8d970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:28.315172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:28.315172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:28.315172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:28.315172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:28.315172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:28.315172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:28.315172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:28.315172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:28.315172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:28.315172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:28.315172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:28.315172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:55:28.315172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:55:28.315172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:55:28.316349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:55:28.316349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:28.316349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:28.316349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:28.316349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:28.316349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:28.316349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:28.316349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:28.316349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:28.316349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:28.316349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:28.316349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:28.316349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:28.316349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:28.316349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:28.316349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:28.316349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:28.317474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:55:28.317474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:55:28.317474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:28.317474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:28.321450 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 640/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:55:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:28.322938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cba9d8-65e2-413b-96e5-86f7d3391faf None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:28.424825 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:28.431867 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cba9d8-65e2-413b-96e5-86f7d3391faf None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:28.470783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c42d6-7a9d-4b57-baf1-db9f655ed7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:28.471435 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c42d6-7a9d-4b57-baf1-db9f655ed7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:28.471715 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c42d6-7a9d-4b57-baf1-db9f655ed7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:28.472087 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c42d6-7a9d-4b57-baf1-db9f655ed7c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:28.473045 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c42d6-7a9d-4b57-baf1-db9f655ed7c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:28.473478 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c42d6-7a9d-4b57-baf1-db9f655ed7c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:28.474894 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c42d6-7a9d-4b57-baf1-db9f655ed7c0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:28.489194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 603/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:28.495504 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f72ee-ee6c-4948-af65-714b31a8d970 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:28.583826 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:28.607911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f72ee-ee6c-4948-af65-714b31a8d970 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:28.647877 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d3a0a-f787-4b03-a1e5-5204e801e1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:28.648772 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d3a0a-f787-4b03-a1e5-5204e801e1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:28.649049 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d3a0a-f787-4b03-a1e5-5204e801e1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:28.649431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d3a0a-f787-4b03-a1e5-5204e801e1a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:28.656871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d3a0a-f787-4b03-a1e5-5204e801e1a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:28.658424 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d3a0a-f787-4b03-a1e5-5204e801e1a0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:28.672692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-4b9d3a0a-f787-4b03-a1e5-5204e801e1a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:55:28.672692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:28.672692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:28.672692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:28.672692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:28.672692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:28.672692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:28.672692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:28.672692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:28.672692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:28.672692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:28.672692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:28.672692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:55:28.672692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:55:28.672692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:55:28.673917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:55:28.673917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:28.673917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:28.673917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:28.673917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:28.673917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:28.673917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:28.673917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:28.673917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:28.673917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:28.673917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:28.673917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:28.673917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:28.673917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:28.673917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:28.673917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:28.673917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:28.675060 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:55:28.675060 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:55:28.675060 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:55:28.675060 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:55:28.675060 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:55:28.675060 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:55:28.675060 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:55:28.675060 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:28.675060 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 641/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:55:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:28.680485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c42d6-7a9d-4b57-baf1-db9f655ed7c0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:28.786084 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c42d6-7a9d-4b57-baf1-db9f655ed7c0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:28.819456 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2df4a-4ef0-4a7b-9736-d48c0e289493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:28.820136 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2df4a-4ef0-4a7b-9736-d48c0e289493 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:28.820414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2df4a-4ef0-4a7b-9736-d48c0e289493 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:28.820686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2df4a-4ef0-4a7b-9736-d48c0e289493 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:28.821492 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2df4a-4ef0-4a7b-9736-d48c0e289493 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:28.821800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2df4a-4ef0-4a7b-9736-d48c0e289493 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:28.823214 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2df4a-4ef0-4a7b-9736-d48c0e289493 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:28.835828 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 604/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:55:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:28.842617 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d3a0a-f787-4b03-a1e5-5204e801e1a0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:28.955794 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d3a0a-f787-4b03-a1e5-5204e801e1a0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:28.995961 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad54f3-f17d-44dd-8066-4cbd793fdd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:28.996623 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad54f3-f17d-44dd-8066-4cbd793fdd56 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:28.996930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad54f3-f17d-44dd-8066-4cbd793fdd56 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:28.997203 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad54f3-f17d-44dd-8066-4cbd793fdd56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:28.998029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad54f3-f17d-44dd-8066-4cbd793fdd56 None admin] RBAC: Adding query filter params (role.id=669088b4ca4644f4bb586dfeaf427fb0, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=cc3d4e645a3349e78452f67cbe79f052) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:28.998337 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad54f3-f17d-44dd-8066-4cbd793fdd56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:28.999773 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad54f3-f17d-44dd-8066-4cbd793fdd56 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:29.006256 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 642/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:55:28 2022] GET /identity/v3/role_assignments?user.id=cc3d4e645a3349e78452f67cbe79f052&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=669088b4ca4644f4bb586dfeaf427fb0 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:31.281962 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68663e29-de5d-4057-895b-34c0d1033328 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:31.282538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68663e29-de5d-4057-895b-34c0d1033328 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:31.282538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68663e29-de5d-4057-895b-34c0d1033328 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:31.283945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 605/1247] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:55:31.289903 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd49bca-a546-4c9e-8aa3-157d9bbf8e11 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:31.290398 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd49bca-a546-4c9e-8aa3-157d9bbf8e11 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:31.290507 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd49bca-a546-4c9e-8aa3-157d9bbf8e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:31.296311 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:31.313551 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9fd49bca-a546-4c9e-8aa3-157d9bbf8e11 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:55:31.314871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9fd49bca-a546-4c9e-8aa3-157d9bbf8e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:55:31.393101 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 643/1248] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:55:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:55:31.422505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68663e29-de5d-4057-895b-34c0d1033328 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:31.444900 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:31.548632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68663e29-de5d-4057-895b-34c0d1033328 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:31.586931 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f2e3f-ef27-4d92-a0ae-ce64288327a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:31.587761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f2e3f-ef27-4d92-a0ae-ce64288327a6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:31.588115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f2e3f-ef27-4d92-a0ae-ce64288327a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:31.588395 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f2e3f-ef27-4d92-a0ae-ce64288327a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:31.600346 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f2e3f-ef27-4d92-a0ae-ce64288327a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:55:31.609973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-cf5f2e3f-ef27-4d92-a0ae-ce64288327a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:55:31.609973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:31.609973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:31.609973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:31.609973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:31.609973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:31.609973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:31.609973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:31.609973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:31.609973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:31.609973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:31.609973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:31.609973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:55:31.609973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:55:31.609973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:55:31.609973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:55:31.611107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:55:31.611107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:55:31.611107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:55:31.611107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:55:31.611107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:31.611107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:31.611107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:31.611107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:31.611107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:31.611107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:31.611107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:31.611107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:31.611107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:31.611107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:31.611107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:31.611107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:31.612125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:31.612125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:31.612125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:31.612125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:31.612125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:55:31.612125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:55:31.612125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:55:31.612125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:55:31.612125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:55:31.612125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:55:31.612125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:55:31.612125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:55:31.612125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 606/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:55:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:31.618443 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd49bca-a546-4c9e-8aa3-157d9bbf8e11 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:31.731361 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd49bca-a546-4c9e-8aa3-157d9bbf8e11 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:31.763851 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:31.770183 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b1953-9326-46ae-b6a8-3fd34fd7aa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:31.771071 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b1953-9326-46ae-b6a8-3fd34fd7aa1a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:31.771422 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b1953-9326-46ae-b6a8-3fd34fd7aa1a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:31.771811 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b1953-9326-46ae-b6a8-3fd34fd7aa1a None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:31.772853 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b1953-9326-46ae-b6a8-3fd34fd7aa1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:31.773278 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b1953-9326-46ae-b6a8-3fd34fd7aa1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:31.775130 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b1953-9326-46ae-b6a8-3fd34fd7aa1a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:31.785974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 644/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:55:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:55:31.792305 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f2e3f-ef27-4d92-a0ae-ce64288327a6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:31.882377 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:31.912190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f2e3f-ef27-4d92-a0ae-ce64288327a6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:31.949626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd801b29-485d-44ce-9aed-ebce2b7e46d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:31.950648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd801b29-485d-44ce-9aed-ebce2b7e46d0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:31.950932 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd801b29-485d-44ce-9aed-ebce2b7e46d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:31.951200 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd801b29-485d-44ce-9aed-ebce2b7e46d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:31.963786 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd801b29-485d-44ce-9aed-ebce2b7e46d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:31.965388 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd801b29-485d-44ce-9aed-ebce2b7e46d0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:31.984680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-bd801b29-485d-44ce-9aed-ebce2b7e46d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:31.984680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:31.984680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:31.984680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:31.984680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:31.984680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:31.984680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:31.984680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:31.984680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:31.984680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:31.984680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:31.984680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:31.984680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:55:31.984680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:55:31.984680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:55:31.985722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:55:31.985722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:31.985722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:31.985722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:31.985722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:31.985722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:31.985722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:31.985722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:31.985722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:31.985722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:31.985722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:31.985722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:31.985722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:31.985722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:31.985722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:31.985722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:31.985722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:31.986778 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:55:31.986778 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:55:31.986778 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:31.986778 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:55:31.986778 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 607/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:31.992143 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b1953-9326-46ae-b6a8-3fd34fd7aa1a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:32.110293 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b1953-9326-46ae-b6a8-3fd34fd7aa1a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:32.166853 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a8527-f622-4b2e-891d-9dce3a1d37b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:32.167660 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a8527-f622-4b2e-891d-9dce3a1d37b4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:32.168008 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a8527-f622-4b2e-891d-9dce3a1d37b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:32.168248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a8527-f622-4b2e-891d-9dce3a1d37b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:32.169155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a8527-f622-4b2e-891d-9dce3a1d37b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:32.169558 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a8527-f622-4b2e-891d-9dce3a1d37b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:32.171081 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a8527-f622-4b2e-891d-9dce3a1d37b4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:32.186289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 645/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:32.193504 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd801b29-485d-44ce-9aed-ebce2b7e46d0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:32.310053 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd801b29-485d-44ce-9aed-ebce2b7e46d0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:32.342589 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:32.353455 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1415baf-d3ed-4751-ba49-186fc1cb546b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:32.354346 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1415baf-d3ed-4751-ba49-186fc1cb546b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:32.354656 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1415baf-d3ed-4751-ba49-186fc1cb546b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:32.354982 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1415baf-d3ed-4751-ba49-186fc1cb546b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:32.365745 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1415baf-d3ed-4751-ba49-186fc1cb546b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:32.367540 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1415baf-d3ed-4751-ba49-186fc1cb546b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:32.386625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d1415baf-d3ed-4751-ba49-186fc1cb546b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:55:32.386625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:32.386625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:32.386625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:32.386625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:32.386625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:32.386625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:32.386625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:32.386625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:32.386625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:32.386625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:32.386625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:32.386625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:55:32.386625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:55:32.386625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:55:32.386625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:55:32.387839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:32.387839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:32.387839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:55:32.387839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:55:32.387839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:55:32.387839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:55:32.387839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:32.387839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:32.387839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:32.387839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:32.387839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:32.387839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:32.387839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:32.387839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:32.387839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:32.387839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:32.387839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:32.387839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:32.388849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:32.388849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:32.388849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:55:32.388849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:55:32.388849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:55:32.388849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:55:32.388849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:55:32.388849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:55:32.388849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:55:32.388849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:55:32.388849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 608/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:55:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:32.394342 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a8527-f622-4b2e-891d-9dce3a1d37b4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:32.455348 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:32.506912 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a8527-f622-4b2e-891d-9dce3a1d37b4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:32.547744 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6bffd-e43f-4a9c-8eb7-fdcd58620298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:32.548441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6bffd-e43f-4a9c-8eb7-fdcd58620298 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:32.548742 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6bffd-e43f-4a9c-8eb7-fdcd58620298 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:32.549019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6bffd-e43f-4a9c-8eb7-fdcd58620298 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:32.549865 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6bffd-e43f-4a9c-8eb7-fdcd58620298 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:32.550170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6bffd-e43f-4a9c-8eb7-fdcd58620298 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:32.551671 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6bffd-e43f-4a9c-8eb7-fdcd58620298 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:32.571491 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 646/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jul 19 10:55:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:32.577559 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1415baf-d3ed-4751-ba49-186fc1cb546b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:32.703923 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1415baf-d3ed-4751-ba49-186fc1cb546b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:32.741059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd91306-6b71-4916-852b-79878b60f6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:32.741717 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd91306-6b71-4916-852b-79878b60f6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:32.741993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd91306-6b71-4916-852b-79878b60f6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:32.742266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd91306-6b71-4916-852b-79878b60f6a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:32.807477 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:32.822769 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd91306-6b71-4916-852b-79878b60f6a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:32.824278 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd91306-6b71-4916-852b-79878b60f6a0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:32.935216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 609/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:55:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:55:32.941982 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6bffd-e43f-4a9c-8eb7-fdcd58620298 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:33.058174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6bffd-e43f-4a9c-8eb7-fdcd58620298 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:33.072235 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:33.098857 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40447980-8027-47d0-b074-5fea32a5b66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:33.099688 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40447980-8027-47d0-b074-5fea32a5b66c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:33.099961 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40447980-8027-47d0-b074-5fea32a5b66c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:33.100228 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40447980-8027-47d0-b074-5fea32a5b66c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:33.113565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40447980-8027-47d0-b074-5fea32a5b66c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:33.115621 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40447980-8027-47d0-b074-5fea32a5b66c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:33.142026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-40447980-8027-47d0-b074-5fea32a5b66c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:33.142026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:33.142026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:33.142026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:33.142026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:33.142026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:33.142026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:33.142026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:33.142026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:33.142026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:33.142026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:33.142026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:33.142026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:55:33.142026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:55:33.142026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:55:33.143322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:55:33.143322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:33.143322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:33.143322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:33.143322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:33.143322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:33.143322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:33.143322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:33.143322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:33.143322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:33.143322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:33.143322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:33.143322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:33.143322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:33.143322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:33.143322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:33.143322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:33.144423 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:55:33.144423 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:55:33.144423 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:33.144423 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:33.144423 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 647/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:55:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:33.150049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd91306-6b71-4916-852b-79878b60f6a0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:33.263332 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:33.280839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd91306-6b71-4916-852b-79878b60f6a0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:33.330092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00138a5b-c8eb-43f4-b17d-9041e1982abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:33.330880 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00138a5b-c8eb-43f4-b17d-9041e1982abc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:33.331054 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00138a5b-c8eb-43f4-b17d-9041e1982abc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:33.331324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00138a5b-c8eb-43f4-b17d-9041e1982abc None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:33.332079 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00138a5b-c8eb-43f4-b17d-9041e1982abc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:33.332421 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00138a5b-c8eb-43f4-b17d-9041e1982abc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:33.333861 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00138a5b-c8eb-43f4-b17d-9041e1982abc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:33.347610 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 610/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:55:33.353867 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40447980-8027-47d0-b074-5fea32a5b66c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:33.484692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40447980-8027-47d0-b074-5fea32a5b66c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:33.532809 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439e35e-6058-4b7c-92a7-4ef07debac0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:33.533833 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439e35e-6058-4b7c-92a7-4ef07debac0d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:33.534145 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439e35e-6058-4b7c-92a7-4ef07debac0d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:33.534439 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439e35e-6058-4b7c-92a7-4ef07debac0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:33.549247 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439e35e-6058-4b7c-92a7-4ef07debac0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:33.550770 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439e35e-6058-4b7c-92a7-4ef07debac0d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:33.566381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-7439e35e-6058-4b7c-92a7-4ef07debac0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:55:33.566381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:33.566381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:33.566381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:33.566381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:33.566381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:33.566381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:33.566381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:33.566381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:33.566381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:33.566381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:33.566381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:33.566381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:55:33.566381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:55:33.566381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:55:33.567467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:55:33.567467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:33.567467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:33.567467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:33.567467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:33.567467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:33.567467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:33.567467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:33.567467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:33.567467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:33.567467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:33.567467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:33.567467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:33.567467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:33.567467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:33.567467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:33.567467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:33.568611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:55:33.568611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:55:33.568611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:55:33.568611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:55:33.568611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:55:33.568611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:55:33.568611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:55:33.568611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:33.568611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 648/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:55:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:33.573909 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00138a5b-c8eb-43f4-b17d-9041e1982abc None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:33.687678 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00138a5b-c8eb-43f4-b17d-9041e1982abc None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:33.726005 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf9305-9a4c-48a7-98c2-ca069cf08618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:33.726687 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf9305-9a4c-48a7-98c2-ca069cf08618 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:33.726971 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf9305-9a4c-48a7-98c2-ca069cf08618 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:33.727289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf9305-9a4c-48a7-98c2-ca069cf08618 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:33.728206 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf9305-9a4c-48a7-98c2-ca069cf08618 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:33.728524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf9305-9a4c-48a7-98c2-ca069cf08618 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:33.730267 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf9305-9a4c-48a7-98c2-ca069cf08618 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:33.744228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 611/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:55:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:33.750897 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439e35e-6058-4b7c-92a7-4ef07debac0d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:33.780418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:33.874527 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439e35e-6058-4b7c-92a7-4ef07debac0d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:33.910598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd507be-a581-4f4c-864b-769aabab2045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:33.911324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd507be-a581-4f4c-864b-769aabab2045 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:33.911601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd507be-a581-4f4c-864b-769aabab2045 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:33.911872 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd507be-a581-4f4c-864b-769aabab2045 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:33.912742 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd507be-a581-4f4c-864b-769aabab2045 None admin] RBAC: Adding query filter params (role.id=3f9528e7a7914797a4635aa6b536b7ff, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=cc3d4e645a3349e78452f67cbe79f052) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:33.913061 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd507be-a581-4f4c-864b-769aabab2045 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:33.914490 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd507be-a581-4f4c-864b-769aabab2045 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:33.920735 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 649/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:55:33 2022] GET /identity/v3/role_assignments?user.id=cc3d4e645a3349e78452f67cbe79f052&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=3f9528e7a7914797a4635aa6b536b7ff => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:55:35.953118 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf3f3d-9dc0-4f9e-a0bd-7ba0cb26df6b None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:35.953671 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf3f3d-9dc0-4f9e-a0bd-7ba0cb26df6b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:35.953671 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf3f3d-9dc0-4f9e-a0bd-7ba0cb26df6b None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:35.955026 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 612/1261] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:55:35.960366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db680d-b26d-4872-b211-05c1d0c933bd None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:35.960828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db680d-b26d-4872-b211-05c1d0c933bd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:35.960947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db680d-b26d-4872-b211-05c1d0c933bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:35.979907 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-29db680d-b26d-4872-b211-05c1d0c933bd None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:55:35.981161 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-29db680d-b26d-4872-b211-05c1d0c933bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:55:36.052120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 650/1262] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:55:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:55:36.075288 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf3f3d-9dc0-4f9e-a0bd-7ba0cb26df6b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:36.086710 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:36.188208 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf3f3d-9dc0-4f9e-a0bd-7ba0cb26df6b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:36.226308 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869e1e0-5214-4e33-b087-b00fec7578bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:36.227016 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869e1e0-5214-4e33-b087-b00fec7578bd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:36.227298 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869e1e0-5214-4e33-b087-b00fec7578bd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:36.227571 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869e1e0-5214-4e33-b087-b00fec7578bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:36.238355 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869e1e0-5214-4e33-b087-b00fec7578bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:55:36.245849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-4869e1e0-5214-4e33-b087-b00fec7578bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:55:36.245849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:36.245849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:36.245849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:36.245849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:36.245849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:36.245849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:36.245849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:36.245849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:36.245849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:36.245849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:36.245849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:36.245849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:55:36.245849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:55:36.245849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:55:36.245849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:55:36.246963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:55:36.246963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:55:36.246963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:55:36.246963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:55:36.246963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:36.246963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:36.246963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:36.246963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:36.246963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:36.246963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:36.246963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:36.246963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:36.246963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:36.246963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:36.246963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:36.246963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:36.247955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:36.247955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:36.247955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:36.247955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:36.247955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:55:36.247955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:55:36.247955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:55:36.247955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:55:36.247955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:55:36.247955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:55:36.247955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:55:36.247955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:55:36.247955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 613/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:55:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:36.253382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db680d-b26d-4872-b211-05c1d0c933bd None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:36.273601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:36.359014 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db680d-b26d-4872-b211-05c1d0c933bd None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:36.395350 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9b40c-ef77-4198-a7f1-88701e44baeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:36.396010 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b40c-ef77-4198-a7f1-88701e44baeb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:36.396288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b40c-ef77-4198-a7f1-88701e44baeb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:36.396566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b40c-ef77-4198-a7f1-88701e44baeb None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:36.397351 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9b40c-ef77-4198-a7f1-88701e44baeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:36.397655 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9b40c-ef77-4198-a7f1-88701e44baeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:36.399043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9b40c-ef77-4198-a7f1-88701e44baeb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:36.407335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 651/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:55:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:36.413383 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869e1e0-5214-4e33-b087-b00fec7578bd None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:36.482809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:36.517541 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869e1e0-5214-4e33-b087-b00fec7578bd None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:36.551474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47627fea-9113-46f5-af97-385379208f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:36.552253 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47627fea-9113-46f5-af97-385379208f98 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:36.552534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47627fea-9113-46f5-af97-385379208f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:36.552833 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47627fea-9113-46f5-af97-385379208f98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:36.563831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47627fea-9113-46f5-af97-385379208f98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:36.565310 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47627fea-9113-46f5-af97-385379208f98 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:36.582474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-47627fea-9113-46f5-af97-385379208f98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:36.582474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:36.582474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:36.582474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:36.582474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:36.582474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:36.582474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:36.582474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:36.582474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:36.582474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:36.582474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:36.582474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:36.582474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:55:36.582474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:55:36.582474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:55:36.583505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:55:36.583505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:36.583505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:36.583505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:36.583505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:36.583505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:36.583505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:36.583505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:36.583505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:36.583505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:36.583505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:36.583505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:36.583505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:36.583505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:36.583505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:36.583505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:36.583505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:36.589458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:55:36.589458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:55:36.589458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:36.589458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:55:36.589458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 614/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:55:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:36.589873 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9b40c-ef77-4198-a7f1-88701e44baeb None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:36.675504 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:36.696473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9b40c-ef77-4198-a7f1-88701e44baeb None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:36.735224 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb114d-ce7c-4609-aae4-3f93fa21a79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:36.735802 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb114d-ce7c-4609-aae4-3f93fa21a79d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:36.736080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb114d-ce7c-4609-aae4-3f93fa21a79d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:36.736350 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb114d-ce7c-4609-aae4-3f93fa21a79d None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:36.737119 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb114d-ce7c-4609-aae4-3f93fa21a79d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:36.737425 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb114d-ce7c-4609-aae4-3f93fa21a79d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:36.738841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb114d-ce7c-4609-aae4-3f93fa21a79d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:36.752701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 652/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:36.758854 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47627fea-9113-46f5-af97-385379208f98 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:36.864201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47627fea-9113-46f5-af97-385379208f98 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:36.884299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:36.899524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9765d-b819-4e80-8e33-5385e32200fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:36.900320 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9765d-b819-4e80-8e33-5385e32200fb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:36.900597 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9765d-b819-4e80-8e33-5385e32200fb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:36.900904 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9765d-b819-4e80-8e33-5385e32200fb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:36.908953 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9765d-b819-4e80-8e33-5385e32200fb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:36.910384 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9765d-b819-4e80-8e33-5385e32200fb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:36.924646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d0d9765d-b819-4e80-8e33-5385e32200fb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:55:36.924646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:36.924646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:36.924646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:36.924646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:36.924646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:36.924646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:36.924646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:36.924646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:36.924646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:36.924646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:36.924646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:36.924646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:55:36.924646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:55:36.924646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:55:36.924646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:55:36.925750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:36.925750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:36.925750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:55:36.925750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:55:36.925750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:55:36.925750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:55:36.925750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:36.925750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:36.925750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:36.925750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:36.925750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:36.925750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:36.925750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:36.925750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:36.925750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:36.925750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:36.925750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:36.925750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:36.926826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:36.926826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:36.926826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:55:36.926826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:55:36.926826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:55:36.926826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:55:36.926826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:55:36.926826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:55:36.926826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:55:36.926826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:55:36.926826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 615/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:55:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:36.932093 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb114d-ce7c-4609-aae4-3f93fa21a79d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:37.037980 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb114d-ce7c-4609-aae4-3f93fa21a79d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:37.074595 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08eaeb7-1f08-4b79-b094-a1016c31c833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:37.075276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eaeb7-1f08-4b79-b094-a1016c31c833 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:37.075554 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eaeb7-1f08-4b79-b094-a1016c31c833 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:37.075820 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eaeb7-1f08-4b79-b094-a1016c31c833 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:37.076667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08eaeb7-1f08-4b79-b094-a1016c31c833 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:37.077009 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08eaeb7-1f08-4b79-b094-a1016c31c833 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:37.078458 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08eaeb7-1f08-4b79-b094-a1016c31c833 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:37.087552 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:37.097019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 653/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jul 19 10:55:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:37.103083 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9765d-b819-4e80-8e33-5385e32200fb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:37.225465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9765d-b819-4e80-8e33-5385e32200fb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:37.261691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccf604-cd57-44cc-8295-4ae5ce9e12d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:37.262569 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccf604-cd57-44cc-8295-4ae5ce9e12d8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:37.262835 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccf604-cd57-44cc-8295-4ae5ce9e12d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:37.263101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccf604-cd57-44cc-8295-4ae5ce9e12d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:37.273785 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ccf604-cd57-44cc-8295-4ae5ce9e12d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:37.275226 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ccf604-cd57-44cc-8295-4ae5ce9e12d8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:37.292487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-68ccf604-cd57-44cc-8295-4ae5ce9e12d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:37.292487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:37.292487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:37.292487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:37.292487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:37.292487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:37.292487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:37.292487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:37.292487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:37.292487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:37.292487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:37.292487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:37.292487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:55:37.292487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:55:37.292487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:55:37.293693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:55:37.293693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:37.293693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:37.293693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:37.293693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:37.293693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:37.293693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:37.293693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:37.293693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:37.293693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:37.293693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:37.293693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:37.293693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:37.293693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:37.293693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:37.293693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:37.293693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:37.294952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:55:37.294952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:55:37.294952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:37.294952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:55:37.294952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 616/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:55:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:37.299634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08eaeb7-1f08-4b79-b094-a1016c31c833 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:37.411979 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08eaeb7-1f08-4b79-b094-a1016c31c833 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:37.452208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841cf652-b50b-4573-b021-d3248717361c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:37.453061 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cf652-b50b-4573-b021-d3248717361c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:37.453343 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cf652-b50b-4573-b021-d3248717361c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:37.453618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cf652-b50b-4573-b021-d3248717361c None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:37.454360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841cf652-b50b-4573-b021-d3248717361c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:37.454663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841cf652-b50b-4573-b021-d3248717361c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:37.456108 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841cf652-b50b-4573-b021-d3248717361c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:37.469645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 654/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:37.475741 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccf604-cd57-44cc-8295-4ae5ce9e12d8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:37.513269 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:37.589182 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccf604-cd57-44cc-8295-4ae5ce9e12d8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:37.627389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea9bea-d339-4d28-b617-e6fb75953849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:37.628214 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea9bea-d339-4d28-b617-e6fb75953849 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:37.628499 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea9bea-d339-4d28-b617-e6fb75953849 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:37.628816 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea9bea-d339-4d28-b617-e6fb75953849 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:37.636453 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea9bea-d339-4d28-b617-e6fb75953849 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:37.638117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea9bea-d339-4d28-b617-e6fb75953849 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:37.659606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-68ea9bea-d339-4d28-b617-e6fb75953849 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:55:37.659606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:37.659606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:37.659606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:37.659606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:37.659606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:37.659606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:37.659606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:37.659606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:37.659606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:37.659606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:37.659606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:37.659606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:55:37.659606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:55:37.659606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:55:37.660809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:55:37.660809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:37.660809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:37.660809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:37.660809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:37.660809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:37.660809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:37.660809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:37.660809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:37.660809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:37.660809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:37.660809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:37.660809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:37.660809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:37.660809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:37.660809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:37.660809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:37.661703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:55:37.661703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:55:37.661703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:55:37.661703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:55:37.661703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:55:37.661703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:55:37.661703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:55:37.661703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:55:37.661703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 617/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:55:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:37.666880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841cf652-b50b-4573-b021-d3248717361c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:37.726361 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:37.770063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841cf652-b50b-4573-b021-d3248717361c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:37.804854 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114b1ce-15fc-4ced-b707-f13d799dc98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:37.805535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114b1ce-15fc-4ced-b707-f13d799dc98d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:37.805815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114b1ce-15fc-4ced-b707-f13d799dc98d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:37.806084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114b1ce-15fc-4ced-b707-f13d799dc98d None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:37.806864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114b1ce-15fc-4ced-b707-f13d799dc98d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:37.807171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114b1ce-15fc-4ced-b707-f13d799dc98d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:37.808603 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114b1ce-15fc-4ced-b707-f13d799dc98d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:37.821713 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 655/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:55:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:55:37.828285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea9bea-d339-4d28-b617-e6fb75953849 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:37.926256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:37.935929 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea9bea-d339-4d28-b617-e6fb75953849 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:37.972200 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e37f24-e2ca-4902-ab95-5ed20e3a98a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:37.973126 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e37f24-e2ca-4902-ab95-5ed20e3a98a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:37.973414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e37f24-e2ca-4902-ab95-5ed20e3a98a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:37.973688 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e37f24-e2ca-4902-ab95-5ed20e3a98a1 None admin] PATH_INFO: `/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/cc3d4e645a3349e78452f67cbe79f052/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:37.975700 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e37f24-e2ca-4902-ab95-5ed20e3a98a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=789e54670f7c40ffb67f20478aba00f2, user_id=cc3d4e645a3349e78452f67cbe79f052, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:37.977173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e37f24-e2ca-4902-ab95-5ed20e3a98a1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:37.992704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 618/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 19 10:55:37 2022] PUT /identity/v3/projects/789e54670f7c40ffb67f20478aba00f2/users/cc3d4e645a3349e78452f67cbe79f052/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:55:39.980841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef9dc6-8e84-47d0-a791-d83295b7ee43 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:39.981521 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef9dc6-8e84-47d0-a791-d83295b7ee43 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:39.981521 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef9dc6-8e84-47d0-a791-d83295b7ee43 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:39.982753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 656/1274] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:55:39.988536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f4a8b-673d-497d-9712-a22a62517c3b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:39.989053 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f4a8b-673d-497d-9712-a22a62517c3b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:39.989147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f4a8b-673d-497d-9712-a22a62517c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:40.007037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fd1f4a8b-673d-497d-9712-a22a62517c3b None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:55:40.008232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fd1f4a8b-673d-497d-9712-a22a62517c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:55:40.080391 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 619/1275] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:55:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:55:40.104136 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef9dc6-8e84-47d0-a791-d83295b7ee43 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:40.210992 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef9dc6-8e84-47d0-a791-d83295b7ee43 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:40.229822 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:40.248291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be22fbc-5106-4aa9-95d4-70ce968dfa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:40.249045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be22fbc-5106-4aa9-95d4-70ce968dfa2a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:40.249317 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be22fbc-5106-4aa9-95d4-70ce968dfa2a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:40.249587 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be22fbc-5106-4aa9-95d4-70ce968dfa2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:40.260206 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be22fbc-5106-4aa9-95d4-70ce968dfa2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:55:40.267909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-9be22fbc-5106-4aa9-95d4-70ce968dfa2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:55:40.267909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:40.267909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:40.267909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:40.267909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:40.267909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:40.267909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:40.267909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:40.267909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:40.267909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:40.267909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:40.267909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:40.267909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:55:40.267909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:55:40.267909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:55:40.267909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:55:40.269025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:55:40.269025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:55:40.269025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:55:40.269025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:55:40.269025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:40.269025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:40.269025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:40.269025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:40.269025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:40.269025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:40.269025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:40.269025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:40.269025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:40.269025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:40.269025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:40.269025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:40.269868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:40.269868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:40.269868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:40.269868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:40.269868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:55:40.269868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:55:40.269868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:55:40.269868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:55:40.269868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:55:40.269868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:55:40.269868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:55:40.269868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:40.269868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 657/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 19 10:55:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:40.275397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f4a8b-673d-497d-9712-a22a62517c3b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:40.362658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:40.381414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f4a8b-673d-497d-9712-a22a62517c3b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:40.417098 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa11bf-611a-4f07-bddd-47df672052d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:40.417769 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa11bf-611a-4f07-bddd-47df672052d5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:40.418110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa11bf-611a-4f07-bddd-47df672052d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:40.418380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa11bf-611a-4f07-bddd-47df672052d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:40.419122 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa11bf-611a-4f07-bddd-47df672052d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:40.419430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa11bf-611a-4f07-bddd-47df672052d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:40.420824 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa11bf-611a-4f07-bddd-47df672052d5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:40.429234 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 620/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 19 10:55:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:40.435332 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be22fbc-5106-4aa9-95d4-70ce968dfa2a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:40.536997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be22fbc-5106-4aa9-95d4-70ce968dfa2a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:40.570707 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164ffa0-b1d8-4065-a1c2-a0836b8cd6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:40.571484 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164ffa0-b1d8-4065-a1c2-a0836b8cd6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:40.571761 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164ffa0-b1d8-4065-a1c2-a0836b8cd6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:40.572031 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164ffa0-b1d8-4065-a1c2-a0836b8cd6e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:40.583488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164ffa0-b1d8-4065-a1c2-a0836b8cd6e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:40.584983 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164ffa0-b1d8-4065-a1c2-a0836b8cd6e0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:40.603333 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d164ffa0-b1d8-4065-a1c2-a0836b8cd6e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:40.603333 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:40.603333 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:40.603333 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:40.603333 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:40.603333 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:40.603333 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:40.603333 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:40.603333 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:40.603333 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:40.603333 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:40.603333 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:40.603333 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:55:40.603333 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:55:40.603333 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:55:40.604379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:55:40.604379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:40.604379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:40.604379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:40.604379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:40.604379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:40.604379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:40.604379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:40.604379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:40.604379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:40.604379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:40.604379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:40.604379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:40.604379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:40.604379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:40.604379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:40.604379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:40.605761 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:55:40.605761 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:55:40.605761 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:40.605761 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:40.605761 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 658/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:55:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:40.610522 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa11bf-611a-4f07-bddd-47df672052d5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:40.722986 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa11bf-611a-4f07-bddd-47df672052d5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:40.760965 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc86a66-0724-4514-b565-8ea3f394e36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:40.761651 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc86a66-0724-4514-b565-8ea3f394e36c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:40.761928 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc86a66-0724-4514-b565-8ea3f394e36c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:40.762196 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc86a66-0724-4514-b565-8ea3f394e36c None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:40.762915 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc86a66-0724-4514-b565-8ea3f394e36c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:40.763219 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc86a66-0724-4514-b565-8ea3f394e36c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:40.764576 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc86a66-0724-4514-b565-8ea3f394e36c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:40.776741 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 621/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:55:40.782781 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164ffa0-b1d8-4065-a1c2-a0836b8cd6e0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:40.816366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:40.887653 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164ffa0-b1d8-4065-a1c2-a0836b8cd6e0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:40.922702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035c0e0-7b3a-46a6-8c21-5dbaa874b81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:40.923509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035c0e0-7b3a-46a6-8c21-5dbaa874b81e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:40.923794 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035c0e0-7b3a-46a6-8c21-5dbaa874b81e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:40.924065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035c0e0-7b3a-46a6-8c21-5dbaa874b81e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:40.931876 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035c0e0-7b3a-46a6-8c21-5dbaa874b81e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:40.933369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035c0e0-7b3a-46a6-8c21-5dbaa874b81e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:40.947757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-2035c0e0-7b3a-46a6-8c21-5dbaa874b81e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:55:40.947757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:40.947757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:40.947757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:40.947757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:40.947757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:40.947757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:40.947757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:40.947757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:40.947757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:40.947757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:40.947757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:40.947757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:55:40.947757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:55:40.947757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:55:40.947757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:55:40.948862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:40.948862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:40.948862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:55:40.948862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:55:40.948862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:55:40.948862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:55:40.948862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:40.948862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:40.948862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:40.948862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:40.948862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:40.948862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:40.948862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:40.948862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:40.948862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:40.948862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:40.948862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:40.948862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:40.950096 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:40.950096 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:40.950096 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:55:40.950096 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:55:40.950096 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:55:40.950096 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:55:40.950096 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:55:40.950096 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:55:40.950096 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:55:40.950096 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:40.950096 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 659/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:55:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:40.955458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc86a66-0724-4514-b565-8ea3f394e36c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:40.959620 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:41.068474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc86a66-0724-4514-b565-8ea3f394e36c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:41.103367 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ac803-f79a-4168-8e5d-aa891acd7de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:41.104026 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ac803-f79a-4168-8e5d-aa891acd7de7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:41.104304 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ac803-f79a-4168-8e5d-aa891acd7de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:41.104573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ac803-f79a-4168-8e5d-aa891acd7de7 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:41.105536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ac803-f79a-4168-8e5d-aa891acd7de7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:41.105846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ac803-f79a-4168-8e5d-aa891acd7de7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:41.107271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ac803-f79a-4168-8e5d-aa891acd7de7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:41.127200 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 622/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jul 19 10:55:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:41.134494 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035c0e0-7b3a-46a6-8c21-5dbaa874b81e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:41.236339 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:41.247231 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035c0e0-7b3a-46a6-8c21-5dbaa874b81e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:41.283210 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80087887-40d4-49a1-8764-d502420a51a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:41.283854 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80087887-40d4-49a1-8764-d502420a51a3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:41.284138 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80087887-40d4-49a1-8764-d502420a51a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:41.284410 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80087887-40d4-49a1-8764-d502420a51a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:41.353745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80087887-40d4-49a1-8764-d502420a51a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:41.355114 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80087887-40d4-49a1-8764-d502420a51a3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:41.445689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:41.456696 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 660/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 19 10:55:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:55:41.462687 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ac803-f79a-4168-8e5d-aa891acd7de7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:41.526663 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:41.567861 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ac803-f79a-4168-8e5d-aa891acd7de7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:41.603713 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f0ed3-5c4f-4450-8c6d-e39156ff6e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:41.604566 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f0ed3-5c4f-4450-8c6d-e39156ff6e14 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:41.604819 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f0ed3-5c4f-4450-8c6d-e39156ff6e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:41.605094 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f0ed3-5c4f-4450-8c6d-e39156ff6e14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:41.615503 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f0ed3-5c4f-4450-8c6d-e39156ff6e14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:41.617003 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f0ed3-5c4f-4450-8c6d-e39156ff6e14 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:41.634777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-af8f0ed3-5c4f-4450-8c6d-e39156ff6e14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:41.634777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:41.634777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:41.634777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:41.634777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:41.634777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:41.634777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:41.634777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:41.634777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:41.634777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:41.634777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:41.634777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:41.634777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:55:41.634777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:55:41.634777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:55:41.635920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:55:41.635920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:41.635920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:41.635920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:41.635920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:41.635920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:41.635920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:41.635920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:41.635920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:41.635920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:41.635920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:41.635920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:41.635920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:41.635920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:41.635920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:41.635920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:41.635920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:41.637225 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:55:41.637225 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:55:41.637225 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:55:41.637225 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:55:41.637225 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 623/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 10:55:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:41.642106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80087887-40d4-49a1-8764-d502420a51a3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:41.752489 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80087887-40d4-49a1-8764-d502420a51a3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:41.791056 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389ff7a-8f9b-4726-b6a1-e952ede52888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:41.792080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389ff7a-8f9b-4726-b6a1-e952ede52888 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:41.792478 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389ff7a-8f9b-4726-b6a1-e952ede52888 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:41.792903 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389ff7a-8f9b-4726-b6a1-e952ede52888 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:41.793733 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389ff7a-8f9b-4726-b6a1-e952ede52888 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:41.794042 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389ff7a-8f9b-4726-b6a1-e952ede52888 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:41.795605 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389ff7a-8f9b-4726-b6a1-e952ede52888 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:41.807740 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 661/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 19 10:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:41.813686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f0ed3-5c4f-4450-8c6d-e39156ff6e14 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:41.917631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f0ed3-5c4f-4450-8c6d-e39156ff6e14 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:41.932377 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:41.954633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09181c-2b8a-4c94-a7fe-f98c281c8037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:41.955431 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09181c-2b8a-4c94-a7fe-f98c281c8037 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:41.955710 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09181c-2b8a-4c94-a7fe-f98c281c8037 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:41.955977 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09181c-2b8a-4c94-a7fe-f98c281c8037 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:41.963100 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09181c-2b8a-4c94-a7fe-f98c281c8037 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:41.964535 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09181c-2b8a-4c94-a7fe-f98c281c8037 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:41.979078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-2b09181c-2b8a-4c94-a7fe-f98c281c8037 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:55:41.979078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:41.979078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:41.979078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:41.979078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:41.979078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:41.979078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:41.979078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:41.979078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:41.979078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:41.979078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:41.979078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:41.979078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:55:41.979078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:55:41.979078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:55:41.980156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:55:41.980156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:41.980156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:41.980156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:41.980156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:41.980156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:41.980156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:41.980156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:41.980156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:41.980156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:41.980156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:41.980156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:41.980156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:41.980156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:41.980156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:41.980156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:41.980156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:41.981129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:55:41.981129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:55:41.981129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:55:41.981129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:55:41.981129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:55:41.981129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:55:41.981129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:55:41.981129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 19 10:55:41.981129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 624/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 19 10:55:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:41.986528 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389ff7a-8f9b-4726-b6a1-e952ede52888 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:42.039513 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:42.091888 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389ff7a-8f9b-4726-b6a1-e952ede52888 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:42.129660 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb888e-5d16-418c-b611-80ea64185df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:42.130436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb888e-5d16-418c-b611-80ea64185df3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:42.130620 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb888e-5d16-418c-b611-80ea64185df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:42.130870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb888e-5d16-418c-b611-80ea64185df3 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:42.131715 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb888e-5d16-418c-b611-80ea64185df3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:42.132019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb888e-5d16-418c-b611-80ea64185df3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:42.133613 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb888e-5d16-418c-b611-80ea64185df3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:42.148804 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 662/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 19 10:55:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:42.156208 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09181c-2b8a-4c94-a7fe-f98c281c8037 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:42.257001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09181c-2b8a-4c94-a7fe-f98c281c8037 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:42.293558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682a81b-59b8-434f-8627-77c806065c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:42.294237 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682a81b-59b8-434f-8627-77c806065c42 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:42.294520 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682a81b-59b8-434f-8627-77c806065c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:42.294794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682a81b-59b8-434f-8627-77c806065c42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:42.295650 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682a81b-59b8-434f-8627-77c806065c42 None admin] RBAC: Adding query filter params (role.id=3f9528e7a7914797a4635aa6b536b7ff, scope.project.id=789e54670f7c40ffb67f20478aba00f2, user.id=cc3d4e645a3349e78452f67cbe79f052) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:42.295959 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682a81b-59b8-434f-8627-77c806065c42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:42.297474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682a81b-59b8-434f-8627-77c806065c42 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:42.304621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 625/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 19 10:55:42 2022] GET /identity/v3/role_assignments?user.id=cc3d4e645a3349e78452f67cbe79f052&scope.project.id=789e54670f7c40ffb67f20478aba00f2&role.id=3f9528e7a7914797a4635aa6b536b7ff => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:44.365960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fcf3b-b68f-4816-9ba7-cff7cc2c0051 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:44.366592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fcf3b-b68f-4816-9ba7-cff7cc2c0051 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:44.366592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fcf3b-b68f-4816-9ba7-cff7cc2c0051 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:44.367913 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 663/1288] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:55:44.373627 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a275f66-b216-424a-9f10-89074e489f8c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:44.374093 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a275f66-b216-424a-9f10-89074e489f8c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:44.374183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a275f66-b216-424a-9f10-89074e489f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:44.392956 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5a275f66-b216-424a-9f10-89074e489f8c None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:55:44.394189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5a275f66-b216-424a-9f10-89074e489f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:55:44.426977 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:44.472822 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 626/1289] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:55:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:55:44.495307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fcf3b-b68f-4816-9ba7-cff7cc2c0051 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:44.602688 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fcf3b-b68f-4816-9ba7-cff7cc2c0051 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:44.614128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:44.640255 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de26cb-6adf-4c38-8d0c-116744c6d0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:44.641007 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de26cb-6adf-4c38-8d0c-116744c6d0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:44.641288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de26cb-6adf-4c38-8d0c-116744c6d0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:44.641563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de26cb-6adf-4c38-8d0c-116744c6d0c4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:44.642232 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de26cb-6adf-4c38-8d0c-116744c6d0c4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:44.643627 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de26cb-6adf-4c38-8d0c-116744c6d0c4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:44.658407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-32de26cb-6adf-4c38-8d0c-116744c6d0c4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 10:55:44.658407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:44.658407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:55:44.658407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:55:44.658407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:55:44.658407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:55:44.658407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:55:44.658407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:55:44.658407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 10:55:44.658407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:44.658407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:55:44.658407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:44.658407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:44.658407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:44.658407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:44.658407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:44.658407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:44.659701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:44.659701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:44.659701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:44.659701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:44.659701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:44.659701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:44.659701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:55:44.659701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:55:44.659701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:55:44.659701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:55:44.659701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:44.659701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:44.659701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:44.659701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:44.659701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:44.659701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:44.661067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:44.661067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:44.661067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:44.661067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:44.661067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:44.661067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:44.661067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:44.661067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:44.661067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:44.661067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:44.661067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:55:44.661067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:55:44.661067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 10:55:44.661067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:44.661067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 664/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jul 19 10:55:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:44.665917 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a275f66-b216-424a-9f10-89074e489f8c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:44.779458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a275f66-b216-424a-9f10-89074e489f8c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:44.814601 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f280e-5d8e-4ded-9251-c9bf77624e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:44.815295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f280e-5d8e-4ded-9251-c9bf77624e75 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:44.815577 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f280e-5d8e-4ded-9251-c9bf77624e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:44.815848 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f280e-5d8e-4ded-9251-c9bf77624e75 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:44.816560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f280e-5d8e-4ded-9251-c9bf77624e75 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:44.816898 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f280e-5d8e-4ded-9251-c9bf77624e75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:44.818290 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f280e-5d8e-4ded-9251-c9bf77624e75 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:44.823352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 627/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Jul 19 10:55:44 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:44.829786 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de26cb-6adf-4c38-8d0c-116744c6d0c4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:44.941444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de26cb-6adf-4c38-8d0c-116744c6d0c4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:44.980566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8e501-a692-4718-ac39-9a327e22dd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:44.981269 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8e501-a692-4718-ac39-9a327e22dd3f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:44.981547 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8e501-a692-4718-ac39-9a327e22dd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:44.981818 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8e501-a692-4718-ac39-9a327e22dd3f None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:44.982548 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8e501-a692-4718-ac39-9a327e22dd3f None admin] RBAC: Adding query filter params (type=placement) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:44.982852 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8e501-a692-4718-ac39-9a327e22dd3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:44.984208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8e501-a692-4718-ac39-9a327e22dd3f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:44.989280 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 665/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Jul 19 10:55:44 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:47.168365 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14399a9-d009-4135-98ad-d7150cc629f1 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:47.168970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14399a9-d009-4135-98ad-d7150cc629f1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:47.169220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14399a9-d009-4135-98ad-d7150cc629f1 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:47.171135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 628/1293] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:55:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:55:47.178130 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecfa31-a296-49f6-9a1f-4c4edbc096e6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:47.178704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecfa31-a296-49f6-9a1f-4c4edbc096e6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:47.178704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecfa31-a296-49f6-9a1f-4c4edbc096e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:47.200226 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-96ecfa31-a296-49f6-9a1f-4c4edbc096e6 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:55:47.202053 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-96ecfa31-a296-49f6-9a1f-4c4edbc096e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:55:47.237703 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:47.279389 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 666/1294] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:55:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:55:47.302632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14399a9-d009-4135-98ad-d7150cc629f1 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:47.335383 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:47.409711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14399a9-d009-4135-98ad-d7150cc629f1 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:47.444576 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3db31-f899-4da8-a25c-143b1ab11def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:47.445281 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3db31-f899-4da8-a25c-143b1ab11def None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:47.445563 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3db31-f899-4da8-a25c-143b1ab11def None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:47.445832 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3db31-f899-4da8-a25c-143b1ab11def None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:47.446556 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3db31-f899-4da8-a25c-143b1ab11def None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:47.447952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3db31-f899-4da8-a25c-143b1ab11def None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:47.461928 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 629/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 19 10:55:47 2022] POST /identity/v3/services => generated 246 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:55:49.473277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d608891-38f5-47d8-b55d-17c7d668ec9e None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:49.473866 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d608891-38f5-47d8-b55d-17c7d668ec9e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:49.473866 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d608891-38f5-47d8-b55d-17c7d668ec9e None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:49.475187 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 667/1296] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:55:49.481472 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba838cc-73c3-451b-9caf-8cddb77b83de None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:49.481942 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba838cc-73c3-451b-9caf-8cddb77b83de None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:49.482047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba838cc-73c3-451b-9caf-8cddb77b83de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:49.499498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-dba838cc-73c3-451b-9caf-8cddb77b83de None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:55:49.500753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dba838cc-73c3-451b-9caf-8cddb77b83de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:55:49.577880 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 630/1297] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:55:49 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:55:49.601802 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d608891-38f5-47d8-b55d-17c7d668ec9e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:49.716768 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d608891-38f5-47d8-b55d-17c7d668ec9e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:49.754504 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3e014-946a-44ee-8ba1-4bfc3cc2027d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:49.755320 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3e014-946a-44ee-8ba1-4bfc3cc2027d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:49.755592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3e014-946a-44ee-8ba1-4bfc3cc2027d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:49.755860 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3e014-946a-44ee-8ba1-4bfc3cc2027d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:49.756514 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df3e014-946a-44ee-8ba1-4bfc3cc2027d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:49.757940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df3e014-946a-44ee-8ba1-4bfc3cc2027d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:49.770636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-4df3e014-946a-44ee-8ba1-4bfc3cc2027d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 10:55:49.770636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:49.770636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:55:49.770636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:55:49.770636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:55:49.770636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:55:49.770636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:55:49.770636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:55:49.770636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 10:55:49.770636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:49.770636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:55:49.770636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:49.770636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:49.770636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:49.770636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:49.770636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:49.770636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:49.771887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:49.771887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:49.771887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:49.771887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:49.771887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:49.771887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:49.771887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:55:49.771887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:55:49.771887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:55:49.771887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:55:49.771887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:49.771887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:49.771887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:49.771887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:49.771887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:49.771887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:49.772757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:49.772757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:49.772757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:49.772757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:49.772757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:49.772757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:49.772757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:49.772757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:49.772757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:49.772757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:49.772757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:55:49.772757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:55:49.772757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 10:55:49.772757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:49.772757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 668/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jul 19 10:55:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:49.778747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba838cc-73c3-451b-9caf-8cddb77b83de None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:49.799196 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:49.888910 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba838cc-73c3-451b-9caf-8cddb77b83de None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:49.926477 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08987dea-beea-463e-845c-736983ef4521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:49.927153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08987dea-beea-463e-845c-736983ef4521 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:49.927431 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08987dea-beea-463e-845c-736983ef4521 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:49.927699 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08987dea-beea-463e-845c-736983ef4521 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:49.928409 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08987dea-beea-463e-845c-736983ef4521 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:49.928740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08987dea-beea-463e-845c-736983ef4521 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:49.930141 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08987dea-beea-463e-845c-736983ef4521 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:49.936116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 631/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Jul 19 10:55:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:49.942413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3e014-946a-44ee-8ba1-4bfc3cc2027d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:49.980053 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:50.059425 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3e014-946a-44ee-8ba1-4bfc3cc2027d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:50.094268 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bff00-d455-4ac9-b7c7-b7f31f403321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:50.094922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bff00-d455-4ac9-b7c7-b7f31f403321 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:50.095203 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bff00-d455-4ac9-b7c7-b7f31f403321 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:50.095477 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bff00-d455-4ac9-b7c7-b7f31f403321 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:50.096264 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bff00-d455-4ac9-b7c7-b7f31f403321 None admin] RBAC: Adding query filter params (interface=public, service_id=f9a77336a2c94be2b98b931f477c3397, region_id=RegionOne) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:50.096579 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bff00-d455-4ac9-b7c7-b7f31f403321 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:50.097981 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bff00-d455-4ac9-b7c7-b7f31f403321 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:50.104294 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 669/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jul 19 10:55:49 2022] GET /identity/v3/endpoints?service_id=f9a77336a2c94be2b98b931f477c3397&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:50.110173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08987dea-beea-463e-845c-736983ef4521 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:50.210911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:50.231952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08987dea-beea-463e-845c-736983ef4521 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:50.272238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55397f-8913-4db4-95fb-9f7e7e0094d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:50.272932 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55397f-8913-4db4-95fb-9f7e7e0094d6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:50.273216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55397f-8913-4db4-95fb-9f7e7e0094d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:50.273491 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55397f-8913-4db4-95fb-9f7e7e0094d6 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:50.274178 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55397f-8913-4db4-95fb-9f7e7e0094d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:50.275554 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55397f-8913-4db4-95fb-9f7e7e0094d6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:50.282942 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 632/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 19 10:55:50 2022] GET /identity/v3/services => generated 2191 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 10:55:52.300398 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4e79f-c338-49b5-ae37-c040c7ba177b None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:52.301104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4e79f-c338-49b5-ae37-c040c7ba177b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:52.301104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4e79f-c338-49b5-ae37-c040c7ba177b None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:52.302358 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 670/1302] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:55:52.307787 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f063c81-aa22-42d5-8508-6e96a865885f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:52.308256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f063c81-aa22-42d5-8508-6e96a865885f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:52.308365 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f063c81-aa22-42d5-8508-6e96a865885f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:52.326505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3f063c81-aa22-42d5-8508-6e96a865885f None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:55:52.327698 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3f063c81-aa22-42d5-8508-6e96a865885f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:55:52.397676 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 633/1303] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:55:52 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:55:52.420835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4e79f-c338-49b5-ae37-c040c7ba177b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:52.523675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:52.531096 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4e79f-c338-49b5-ae37-c040c7ba177b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:52.566066 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7d923-42e9-4392-a21c-21b92035825d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:52.566788 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7d923-42e9-4392-a21c-21b92035825d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:52.567066 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7d923-42e9-4392-a21c-21b92035825d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:52.567339 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7d923-42e9-4392-a21c-21b92035825d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:52.567985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7d923-42e9-4392-a21c-21b92035825d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:52.569393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7d923-42e9-4392-a21c-21b92035825d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:52.581367 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-94f7d923-42e9-4392-a21c-21b92035825d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 10:55:52.581367 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:52.581367 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:55:52.581367 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:55:52.581367 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:55:52.581367 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:55:52.581367 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:55:52.581367 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:55:52.581367 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 10:55:52.581367 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:52.581367 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:55:52.581367 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:52.581367 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:52.581367 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:52.581367 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:52.581367 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:52.581367 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:52.582502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:52.582502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:52.582502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:52.582502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:52.582502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:52.582502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:52.582502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:55:52.582502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:55:52.582502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:55:52.582502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:55:52.582502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:52.582502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:52.582502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:52.582502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:52.582502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:52.582502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:52.583634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:52.583634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:52.583634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:52.583634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:52.583634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:52.583634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:52.583634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:52.583634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:52.583634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:52.583634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:52.583634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:55:52.583634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:55:52.583634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 10:55:52.583634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 19 10:55:52.583634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 671/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jul 19 10:55:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:52.588991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f063c81-aa22-42d5-8508-6e96a865885f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:52.667299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:52.694014 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f063c81-aa22-42d5-8508-6e96a865885f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:52.733233 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ddbb0-bd53-42b2-b5b8-d6519c057c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:52.733910 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ddbb0-bd53-42b2-b5b8-d6519c057c7e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:52.734191 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ddbb0-bd53-42b2-b5b8-d6519c057c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:52.734461 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ddbb0-bd53-42b2-b5b8-d6519c057c7e None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:52.735173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ddbb0-bd53-42b2-b5b8-d6519c057c7e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:52.735479 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ddbb0-bd53-42b2-b5b8-d6519c057c7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:52.736886 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ddbb0-bd53-42b2-b5b8-d6519c057c7e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:52.742591 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 634/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Jul 19 10:55:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:52.748869 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7d923-42e9-4392-a21c-21b92035825d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:52.854711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7d923-42e9-4392-a21c-21b92035825d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:52.889859 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301304d-01f9-4280-aa89-a98c4c4ee78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:52.890520 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301304d-01f9-4280-aa89-a98c4c4ee78f None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:52.890800 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301304d-01f9-4280-aa89-a98c4c4ee78f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:52.891070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301304d-01f9-4280-aa89-a98c4c4ee78f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:52.891804 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301304d-01f9-4280-aa89-a98c4c4ee78f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:52.893211 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301304d-01f9-4280-aa89-a98c4c4ee78f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:52.913240 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 672/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 19 10:55:52 2022] POST /identity/v3/endpoints => generated 331 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:56:02.740295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=30 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:02.908637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:01.288367 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4619d-8846-4c77-8aa6-0e97c393e840 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:01.289369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4619d-8846-4c77-8aa6-0e97c393e840 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:01.289799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4619d-8846-4c77-8aa6-0e97c393e840 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:01.297332 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e17728-400d-484e-b564-664dbf089e92 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:01.298165 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e17728-400d-484e-b564-664dbf089e92 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:01.298604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e17728-400d-484e-b564-664dbf089e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:01.301045 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 635/1307] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:57:01 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:57:01.428515 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-33e17728-400d-484e-b564-664dbf089e92 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:01.430333 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-33e17728-400d-484e-b564-664dbf089e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:01.626440 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 673/1308] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:57:01.680501 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8209c95-25c0-4f05-96ff-cfed95f61d32 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:01.681144 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8209c95-25c0-4f05-96ff-cfed95f61d32 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:01.681428 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8209c95-25c0-4f05-96ff-cfed95f61d32 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:01.683177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 636/1309] 10.222.0.18 () {54 vars in 965 bytes} [Tue Jul 19 10:57:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:57:01.690984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97677791-4a23-4390-8b5c-d39c8e4d124f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:01.691382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97677791-4a23-4390-8b5c-d39c8e4d124f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:01.691861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97677791-4a23-4390-8b5c-d39c8e4d124f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:01.793463 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-97677791-4a23-4390-8b5c-d39c8e4d124f None None] MFA Rules not processed for user `07eaacc831ae481d99e8ab03ee295e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:01.794801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-97677791-4a23-4390-8b5c-d39c8e4d124f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:01.817799 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:01.878927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 674/1310] 10.222.0.18 () {58 vars in 1062 bytes} [Tue Jul 19 10:57:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:57:01.887951 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8209c95-25c0-4f05-96ff-cfed95f61d32 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:57:01.889762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e8209c95-25c0-4f05-96ff-cfed95f61d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:02.017376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8209c95-25c0-4f05-96ff-cfed95f61d32 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:57:02.099604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80904a-3026-4725-ab99-9e880cfb8e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:57:02.100160 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80904a-3026-4725-ab99-9e880cfb8e0d service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:02.100672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80904a-3026-4725-ab99-9e880cfb8e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:02.100983 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80904a-3026-4725-ab99-9e880cfb8e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:02.102757 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dc80904a-3026-4725-ab99-9e880cfb8e0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:02.164758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:02.224730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80904a-3026-4725-ab99-9e880cfb8e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:57:02.226424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80904a-3026-4725-ab99-9e880cfb8e0d service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:57:02.249633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 637/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:57:04.622088 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2216da-4977-496e-8679-554e2fc5ce07 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:04.622552 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2216da-4977-496e-8679-554e2fc5ce07 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:04.622727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2216da-4977-496e-8679-554e2fc5ce07 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:04.625210 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 675/1312] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:57:04.629653 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da57fb1-82d5-4a66-b9c1-5136d5bdb729 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:04.630092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da57fb1-82d5-4a66-b9c1-5136d5bdb729 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:04.630203 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da57fb1-82d5-4a66-b9c1-5136d5bdb729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:04.720679 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4da57fb1-82d5-4a66-b9c1-5136d5bdb729 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:04.721934 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4da57fb1-82d5-4a66-b9c1-5136d5bdb729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:04.824390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 638/1313] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:57:04.863169 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2216da-4977-496e-8679-554e2fc5ce07 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:57:04.864699 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fc2216da-4977-496e-8679-554e2fc5ce07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:04.971814 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2216da-4977-496e-8679-554e2fc5ce07 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:57:05.047193 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:05.050134 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a904f0e-66e1-4501-a2b9-8f3bec43a678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:57:05.050801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a904f0e-66e1-4501-a2b9-8f3bec43a678 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:05.051079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a904f0e-66e1-4501-a2b9-8f3bec43a678 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:05.051354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a904f0e-66e1-4501-a2b9-8f3bec43a678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:05.053940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6a904f0e-66e1-4501-a2b9-8f3bec43a678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:05.166575 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a904f0e-66e1-4501-a2b9-8f3bec43a678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:57:05.168018 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a904f0e-66e1-4501-a2b9-8f3bec43a678 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:57:05.186801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 676/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:57:07.583563 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecdc29-af2f-4396-8d2c-06acd4456f39 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:07.584116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecdc29-af2f-4396-8d2c-06acd4456f39 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:07.584116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecdc29-af2f-4396-8d2c-06acd4456f39 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:07.585638 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 639/1315] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:57:07.591464 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3143ab-11b2-4f17-ad32-fec8f045cb72 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:07.591942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3143ab-11b2-4f17-ad32-fec8f045cb72 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:07.592020 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3143ab-11b2-4f17-ad32-fec8f045cb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:07.658576 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ef3143ab-11b2-4f17-ad32-fec8f045cb72 None None] MFA Rules not processed for user `a4e1397234b748429b5677746ccbc985`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:07.659803 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ef3143ab-11b2-4f17-ad32-fec8f045cb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:07.721874 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:07.790572 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 677/1316] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:57:07 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:57:07.830360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecdc29-af2f-4396-8d2c-06acd4456f39 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:57:07.831893 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fbecdc29-af2f-4396-8d2c-06acd4456f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:07.842249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:07.952082 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecdc29-af2f-4396-8d2c-06acd4456f39 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:57:08.031205 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4b5c0-1846-4879-8167-07806cf8d11d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:57:08.031765 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4b5c0-1846-4879-8167-07806cf8d11d service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:08.032050 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4b5c0-1846-4879-8167-07806cf8d11d service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:08.032330 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4b5c0-1846-4879-8167-07806cf8d11d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:08.034091 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4ed4b5c0-1846-4879-8167-07806cf8d11d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:08.107171 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:08.160157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4b5c0-1846-4879-8167-07806cf8d11d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:57:08.161659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4b5c0-1846-4879-8167-07806cf8d11d service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:57:08.180832 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 640/1317] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:57:07 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:57:10.856774 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857ff04-7827-42b2-bc73-f13b6b6b1f18 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:10.857334 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857ff04-7827-42b2-bc73-f13b6b6b1f18 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:10.857334 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857ff04-7827-42b2-bc73-f13b6b6b1f18 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:10.858596 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 678/1318] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:57:10.863846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f0900-6183-4757-9885-a8571659678b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:10.864273 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f0900-6183-4757-9885-a8571659678b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:10.864391 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f0900-6183-4757-9885-a8571659678b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:10.929489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-220f0900-6183-4757-9885-a8571659678b None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:10.930670 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-220f0900-6183-4757-9885-a8571659678b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:11.032378 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 641/1319] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:57:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:57:11.073092 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857ff04-7827-42b2-bc73-f13b6b6b1f18 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:57:11.074776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f857ff04-7827-42b2-bc73-f13b6b6b1f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:11.185715 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857ff04-7827-42b2-bc73-f13b6b6b1f18 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:57:11.265368 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6645b-8917-48f3-94ea-0d83901d9af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:57:11.265995 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6645b-8917-48f3-94ea-0d83901d9af3 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:11.266268 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6645b-8917-48f3-94ea-0d83901d9af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:11.266537 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6645b-8917-48f3-94ea-0d83901d9af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:11.268203 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bed6645b-8917-48f3-94ea-0d83901d9af3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:11.276209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:11.385673 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6645b-8917-48f3-94ea-0d83901d9af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:57:11.387131 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6645b-8917-48f3-94ea-0d83901d9af3 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:57:11.405874 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 679/1320] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:57:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:57:14.249747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe83911-9650-47aa-9462-57c53a341075 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:14.250579 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe83911-9650-47aa-9462-57c53a341075 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:14.250579 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe83911-9650-47aa-9462-57c53a341075 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:14.251693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 642/1321] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:57:14.258931 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9a3da-8df2-4dd5-9249-457dbeb9d172 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:14.260451 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9a3da-8df2-4dd5-9249-457dbeb9d172 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:14.262303 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9a3da-8df2-4dd5-9249-457dbeb9d172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:14.343855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-caf9a3da-8df2-4dd5-9249-457dbeb9d172 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:14.345122 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-caf9a3da-8df2-4dd5-9249-457dbeb9d172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:14.410413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:14.461914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 680/1322] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:57:14.514316 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517d46c-8199-453c-8c4b-ffa50fa7757d None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:14.514661 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517d46c-8199-453c-8c4b-ffa50fa7757d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:14.515020 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517d46c-8199-453c-8c4b-ffa50fa7757d None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:14.516474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 643/1323] 10.222.0.18 () {54 vars in 965 bytes} [Tue Jul 19 10:57:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:57:14.524897 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9adcc-e628-49c7-8f08-cfd1701aaaaf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:14.525820 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9adcc-e628-49c7-8f08-cfd1701aaaaf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:14.526099 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9adcc-e628-49c7-8f08-cfd1701aaaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:14.625262 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a3d9adcc-e628-49c7-8f08-cfd1701aaaaf None None] MFA Rules not processed for user `07eaacc831ae481d99e8ab03ee295e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:14.626568 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a3d9adcc-e628-49c7-8f08-cfd1701aaaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:14.723003 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 681/1324] 10.222.0.18 () {58 vars in 1062 bytes} [Tue Jul 19 10:57:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 10:57:14.732094 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517d46c-8199-453c-8c4b-ffa50fa7757d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:57:14.733707 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b517d46c-8199-453c-8c4b-ffa50fa7757d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:14.754355 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:14.899355 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517d46c-8199-453c-8c4b-ffa50fa7757d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:57:14.991688 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06905c-a15d-42ea-84df-54970b436e69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:57:14.992332 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06905c-a15d-42ea-84df-54970b436e69 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:14.992647 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06905c-a15d-42ea-84df-54970b436e69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:14.992958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06905c-a15d-42ea-84df-54970b436e69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:14.994673 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7c06905c-a15d-42ea-84df-54970b436e69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:15.077499 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:15.139155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06905c-a15d-42ea-84df-54970b436e69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:57:15.142429 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06905c-a15d-42ea-84df-54970b436e69 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:57:15.177485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 644/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:57:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:57:17.491594 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fdf2c-def2-4deb-979a-b9d4df33aaac None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:17.492174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fdf2c-def2-4deb-979a-b9d4df33aaac None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:17.492174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fdf2c-def2-4deb-979a-b9d4df33aaac None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:17.493505 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 682/1326] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:57:17.498861 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfd7d5-a33d-4da7-8559-130d275c8638 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:17.499331 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfd7d5-a33d-4da7-8559-130d275c8638 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:17.499422 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfd7d5-a33d-4da7-8559-130d275c8638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:17.572547 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-becfd7d5-a33d-4da7-8559-130d275c8638 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:17.574470 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-becfd7d5-a33d-4da7-8559-130d275c8638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:17.704979 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 645/1327] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:57:17.717087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fdf2c-def2-4deb-979a-b9d4df33aaac None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:57:17.718710 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8a7fdf2c-def2-4deb-979a-b9d4df33aaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:17.787128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:17.833694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fdf2c-def2-4deb-979a-b9d4df33aaac None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:57:17.916555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67dbf15-7192-439d-8042-a8d5b9934604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:57:17.917255 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dbf15-7192-439d-8042-a8d5b9934604 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:17.917531 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dbf15-7192-439d-8042-a8d5b9934604 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:17.917800 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dbf15-7192-439d-8042-a8d5b9934604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:17.919475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d67dbf15-7192-439d-8042-a8d5b9934604 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:18.038022 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:18.040300 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67dbf15-7192-439d-8042-a8d5b9934604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:57:18.042151 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67dbf15-7192-439d-8042-a8d5b9934604 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:57:18.060567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 683/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:57:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:57:20.168684 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bcf30-5e5a-4f9d-9f0e-050f15129e32 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:20.169268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bcf30-5e5a-4f9d-9f0e-050f15129e32 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:20.169268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bcf30-5e5a-4f9d-9f0e-050f15129e32 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:20.175041 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 646/1329] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:57:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:57:20.176777 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa75a0-21c9-4263-ada1-80a9f12b8525 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:20.177232 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa75a0-21c9-4263-ada1-80a9f12b8525 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:20.177430 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa75a0-21c9-4263-ada1-80a9f12b8525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:20.256737 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4eaa75a0-21c9-4263-ada1-80a9f12b8525 None None] MFA Rules not processed for user `a4e1397234b748429b5677746ccbc985`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:20.257971 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4eaa75a0-21c9-4263-ada1-80a9f12b8525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:20.371620 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 684/1330] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:57:20 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:57:20.410830 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bcf30-5e5a-4f9d-9f0e-050f15129e32 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:57:20.412409 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-974bcf30-5e5a-4f9d-9f0e-050f15129e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:20.451139 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:20.533117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bcf30-5e5a-4f9d-9f0e-050f15129e32 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:57:20.612606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab549bc9-3cc5-4832-aa48-ec4336f8cc82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:57:20.613306 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab549bc9-3cc5-4832-aa48-ec4336f8cc82 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:20.613578 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab549bc9-3cc5-4832-aa48-ec4336f8cc82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:20.613857 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab549bc9-3cc5-4832-aa48-ec4336f8cc82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:20.615631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ab549bc9-3cc5-4832-aa48-ec4336f8cc82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:20.723238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:20.769788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab549bc9-3cc5-4832-aa48-ec4336f8cc82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:57:20.771750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab549bc9-3cc5-4832-aa48-ec4336f8cc82 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:57:20.793461 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 647/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:57:20 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:57:23.168154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093499d1-e772-4c02-8940-d0f947055163 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:23.168695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093499d1-e772-4c02-8940-d0f947055163 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:23.168695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093499d1-e772-4c02-8940-d0f947055163 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:23.170126 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 685/1332] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:57:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:57:23.175608 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde248b-7da1-4779-a52b-fc1f53ba1955 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:23.176173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde248b-7da1-4779-a52b-fc1f53ba1955 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:23.176173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde248b-7da1-4779-a52b-fc1f53ba1955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:23.244404 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7cde248b-7da1-4779-a52b-fc1f53ba1955 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:23.245642 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7cde248b-7da1-4779-a52b-fc1f53ba1955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:23.343743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 648/1333] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:57:23.380952 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093499d1-e772-4c02-8940-d0f947055163 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:57:23.382537 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-093499d1-e772-4c02-8940-d0f947055163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:23.456602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:23.493621 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093499d1-e772-4c02-8940-d0f947055163 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:57:23.571555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63fadc-5e89-4dba-bd93-32e4f13e3c20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:57:23.572215 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63fadc-5e89-4dba-bd93-32e4f13e3c20 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:23.572495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63fadc-5e89-4dba-bd93-32e4f13e3c20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:23.572795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63fadc-5e89-4dba-bd93-32e4f13e3c20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:23.574475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1a63fadc-5e89-4dba-bd93-32e4f13e3c20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:23.690026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63fadc-5e89-4dba-bd93-32e4f13e3c20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:57:23.691506 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63fadc-5e89-4dba-bd93-32e4f13e3c20 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:57:23.702482 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:23.711817 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 686/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:57:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:57:25.797841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9775e87-c59c-4808-8e0b-e14175db8b4e None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:25.798386 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9775e87-c59c-4808-8e0b-e14175db8b4e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:25.798386 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9775e87-c59c-4808-8e0b-e14175db8b4e None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:25.799729 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 649/1335] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:57:25.805036 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa5538-d7d1-4c44-ab5f-7fff35670cac None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:25.805500 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa5538-d7d1-4c44-ab5f-7fff35670cac None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:25.805596 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa5538-d7d1-4c44-ab5f-7fff35670cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:25.874501 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2baa5538-d7d1-4c44-ab5f-7fff35670cac None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:25.875723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2baa5538-d7d1-4c44-ab5f-7fff35670cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:25.975652 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 687/1336] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:57:26.016386 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9775e87-c59c-4808-8e0b-e14175db8b4e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:57:26.018012 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f9775e87-c59c-4808-8e0b-e14175db8b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:26.060410 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:26.132651 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9775e87-c59c-4808-8e0b-e14175db8b4e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:57:26.212059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f25f76-4ba7-4491-bc2f-5a40d9bd2476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:57:26.212744 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f25f76-4ba7-4491-bc2f-5a40d9bd2476 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:26.213040 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f25f76-4ba7-4491-bc2f-5a40d9bd2476 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:26.213312 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f25f76-4ba7-4491-bc2f-5a40d9bd2476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:26.214982 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c6f25f76-4ba7-4491-bc2f-5a40d9bd2476 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:26.304707 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:26.331864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f25f76-4ba7-4491-bc2f-5a40d9bd2476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:57:26.333299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f25f76-4ba7-4491-bc2f-5a40d9bd2476 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:57:26.352552 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 650/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:57:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:57:29.033221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffed69-327d-4bb1-bd97-b64e18417e89 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:29.033815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffed69-327d-4bb1-bd97-b64e18417e89 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:29.033815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffed69-327d-4bb1-bd97-b64e18417e89 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:29.035130 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 688/1338] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:57:29.040498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24dca3-f337-45dd-a74e-a84f16fe0076 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:29.040989 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24dca3-f337-45dd-a74e-a84f16fe0076 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:29.041092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24dca3-f337-45dd-a74e-a84f16fe0076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:29.106814 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ab24dca3-f337-45dd-a74e-a84f16fe0076 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:29.108055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ab24dca3-f337-45dd-a74e-a84f16fe0076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:29.213792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 651/1339] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:57:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:57:29.252583 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffed69-327d-4bb1-bd97-b64e18417e89 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:57:29.254174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-60ffed69-327d-4bb1-bd97-b64e18417e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:29.347915 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:29.376048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffed69-327d-4bb1-bd97-b64e18417e89 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:57:29.455181 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacc66e-69ee-4410-bfd7-0e84bc1596f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:57:29.455849 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacc66e-69ee-4410-bfd7-0e84bc1596f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:29.456121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacc66e-69ee-4410-bfd7-0e84bc1596f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:29.456393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacc66e-69ee-4410-bfd7-0e84bc1596f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:29.458046 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dcacc66e-69ee-4410-bfd7-0e84bc1596f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:29.570115 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcacc66e-69ee-4410-bfd7-0e84bc1596f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:57:29.571565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcacc66e-69ee-4410-bfd7-0e84bc1596f4 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:57:29.590388 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 689/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:57:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:57:33.730571 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf8d6a-931c-4538-ba7e-167dbb8932f1 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:33.731116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf8d6a-931c-4538-ba7e-167dbb8932f1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:33.731116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf8d6a-931c-4538-ba7e-167dbb8932f1 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:33.732415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 652/1341] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:57:33.738058 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca22a7-c79e-48b1-a6e3-8f385c5ebfd4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:33.738515 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca22a7-c79e-48b1-a6e3-8f385c5ebfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:33.738696 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca22a7-c79e-48b1-a6e3-8f385c5ebfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:33.743511 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:33.814647 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e5ca22a7-c79e-48b1-a6e3-8f385c5ebfd4 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:33.815850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e5ca22a7-c79e-48b1-a6e3-8f385c5ebfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:33.920009 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 690/1342] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:57:33.959089 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf8d6a-931c-4538-ba7e-167dbb8932f1 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:57:33.960626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4bcf8d6a-931c-4538-ba7e-167dbb8932f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:34.013743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:34.080458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf8d6a-931c-4538-ba7e-167dbb8932f1 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:57:34.167858 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a40694-3e5b-4a1b-99a9-a2ec59d22883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:57:34.168529 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a40694-3e5b-4a1b-99a9-a2ec59d22883 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:34.168844 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a40694-3e5b-4a1b-99a9-a2ec59d22883 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:34.169124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a40694-3e5b-4a1b-99a9-a2ec59d22883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:34.170855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e6a40694-3e5b-4a1b-99a9-a2ec59d22883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:34.273194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:34.290670 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a40694-3e5b-4a1b-99a9-a2ec59d22883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:57:34.292136 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a40694-3e5b-4a1b-99a9-a2ec59d22883 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:57:34.311662 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 653/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:57:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:57:37.038253 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd16eff-1794-4253-9078-bb6faa64f529 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:37.038827 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd16eff-1794-4253-9078-bb6faa64f529 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:37.038827 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd16eff-1794-4253-9078-bb6faa64f529 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:37.040234 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 691/1344] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:57:37.046158 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084eb66-a4e0-4054-a605-fcdc8bea0965 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:37.046792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084eb66-a4e0-4054-a605-fcdc8bea0965 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:37.046792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084eb66-a4e0-4054-a605-fcdc8bea0965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:37.134212 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1084eb66-a4e0-4054-a605-fcdc8bea0965 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:37.135630 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1084eb66-a4e0-4054-a605-fcdc8bea0965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:37.251799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 654/1345] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:57:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:57:37.289889 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd16eff-1794-4253-9078-bb6faa64f529 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:57:37.291428 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ecd16eff-1794-4253-9078-bb6faa64f529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:37.394552 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:37.413777 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd16eff-1794-4253-9078-bb6faa64f529 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:57:37.493999 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabff8de-81b4-426c-b112-6f886a656c8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:57:37.494662 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabff8de-81b4-426c-b112-6f886a656c8e service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:37.494944 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabff8de-81b4-426c-b112-6f886a656c8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:37.495215 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabff8de-81b4-426c-b112-6f886a656c8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:37.496919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cabff8de-81b4-426c-b112-6f886a656c8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:37.609483 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabff8de-81b4-426c-b112-6f886a656c8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:57:37.610829 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabff8de-81b4-426c-b112-6f886a656c8e service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:57:37.630281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 692/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:57:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:57:41.708436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fed8e-c30d-430b-b762-c2298f4e2226 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:41.709014 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fed8e-c30d-430b-b762-c2298f4e2226 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:41.709014 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fed8e-c30d-430b-b762-c2298f4e2226 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:41.711030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 655/1347] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:57:41.716687 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580327ef-565d-499d-af1d-d396b33ce4cf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:41.717423 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580327ef-565d-499d-af1d-d396b33ce4cf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:41.717423 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580327ef-565d-499d-af1d-d396b33ce4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:41.739933 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:41.812626 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-580327ef-565d-499d-af1d-d396b33ce4cf None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:41.813902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-580327ef-565d-499d-af1d-d396b33ce4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:41.944984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 693/1348] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:57:41.984864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fed8e-c30d-430b-b762-c2298f4e2226 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:57:41.987667 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-717fed8e-c30d-430b-b762-c2298f4e2226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:42.067076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:42.122107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fed8e-c30d-430b-b762-c2298f4e2226 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:57:42.202198 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099549f2-f26e-48ae-bfe2-250eecb8790d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:57:42.202872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099549f2-f26e-48ae-bfe2-250eecb8790d service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:42.203156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099549f2-f26e-48ae-bfe2-250eecb8790d service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:42.203429 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099549f2-f26e-48ae-bfe2-250eecb8790d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:42.205176 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-099549f2-f26e-48ae-bfe2-250eecb8790d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:42.324402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:42.329694 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099549f2-f26e-48ae-bfe2-250eecb8790d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:57:42.331172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099549f2-f26e-48ae-bfe2-250eecb8790d service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:57:42.351805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 656/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:57:48.083760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6175790-21bc-4759-af97-e3f0e3f87807 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:48.085390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6175790-21bc-4759-af97-e3f0e3f87807 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:48.086060 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6175790-21bc-4759-af97-e3f0e3f87807 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:48.089852 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 694/1350] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 19 10:57:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:57:48.098915 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105e1bd-fee7-4c8a-ab8d-00d214b0fe0a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:48.099359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105e1bd-fee7-4c8a-ab8d-00d214b0fe0a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:48.101013 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105e1bd-fee7-4c8a-ab8d-00d214b0fe0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:48.220747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5105e1bd-fee7-4c8a-ab8d-00d214b0fe0a None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:48.227717 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5105e1bd-fee7-4c8a-ab8d-00d214b0fe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:48.480732 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 657/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 10:57:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:57:51.942779 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=59 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:52.963571 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fce088-f1dc-4772-8427-1159b3103038 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:52.965414 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fce088-f1dc-4772-8427-1159b3103038 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:52.966124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fce088-f1dc-4772-8427-1159b3103038 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:52.968931 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 695/1352] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 19 10:57:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:57:52.978336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331240a5-013c-4887-b713-b2fffa676b9e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:52.979794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331240a5-013c-4887-b713-b2fffa676b9e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:52.980575 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331240a5-013c-4887-b713-b2fffa676b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:53.081031 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:53.134944 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-331240a5-013c-4887-b713-b2fffa676b9e None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:53.137460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-331240a5-013c-4887-b713-b2fffa676b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:53.341308 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 658/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 10:57:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:57:54.908155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64a058-458d-48c1-abbe-334b4ac2f942 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:54.908657 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64a058-458d-48c1-abbe-334b4ac2f942 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:54.908657 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64a058-458d-48c1-abbe-334b4ac2f942 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:54.910381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 696/1354] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 19 10:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:57:54.915804 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb2a71-2dd4-43c6-903f-67e01c7d3dff None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:54.916339 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb2a71-2dd4-43c6-903f-67e01c7d3dff None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:54.916438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb2a71-2dd4-43c6-903f-67e01c7d3dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:55.001588 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-64fb2a71-2dd4-43c6-903f-67e01c7d3dff None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:55.002838 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-64fb2a71-2dd4-43c6-903f-67e01c7d3dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:55.047356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:55.127291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 659/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 10:57:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:57:58.954858 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc48f79-5b63-4696-b1cf-c8b1bb523b1f None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:58.955842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc48f79-5b63-4696-b1cf-c8b1bb523b1f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:58.956401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc48f79-5b63-4696-b1cf-c8b1bb523b1f None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:58.958495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 697/1356] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:57:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:57:58.964767 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5b821-bebf-40fa-8b25-7018313662d6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:58.965297 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5b821-bebf-40fa-8b25-7018313662d6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:58.965297 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5b821-bebf-40fa-8b25-7018313662d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:59.066606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-09d5b821-bebf-40fa-8b25-7018313662d6 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:59.067663 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-09d5b821-bebf-40fa-8b25-7018313662d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:59.172760 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 660/1357] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 10:57:59.240192 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eedcf-7088-450b-ad4f-0eb40aa81817 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:59.240948 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eedcf-7088-450b-ad4f-0eb40aa81817 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:59.241406 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eedcf-7088-450b-ad4f-0eb40aa81817 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:59.243580 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 698/1358] 10.222.0.18 () {54 vars in 962 bytes} [Tue Jul 19 10:57:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:57:59.250976 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46efde8-edd7-4dce-852c-ecfe6f8fa273 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:59.251910 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46efde8-edd7-4dce-852c-ecfe6f8fa273 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:59.251910 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46efde8-edd7-4dce-852c-ecfe6f8fa273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:59.271583 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:59.340843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c46efde8-edd7-4dce-852c-ecfe6f8fa273 None None] MFA Rules not processed for user `3c50a821e9ef44cb9fccd49ee4af7dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:59.341983 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c46efde8-edd7-4dce-852c-ecfe6f8fa273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:59.474855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 661/1359] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Jul 19 10:57:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:57:59.483345 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696eedcf-7088-450b-ad4f-0eb40aa81817 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:57:59.485011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-696eedcf-7088-450b-ad4f-0eb40aa81817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:59.642432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696eedcf-7088-450b-ad4f-0eb40aa81817 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:57:59.726220 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:59.773657 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0355cc6-5a74-4ec9-916d-6afe5f4a4367 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:57:59.774485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0355cc6-5a74-4ec9-916d-6afe5f4a4367 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:59.774864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0355cc6-5a74-4ec9-916d-6afe5f4a4367 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:59.775240 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0355cc6-5a74-4ec9-916d-6afe5f4a4367 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:59.777186 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d0355cc6-5a74-4ec9-916d-6afe5f4a4367 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:59.876860 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0355cc6-5a74-4ec9-916d-6afe5f4a4367 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:57:59.878712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0355cc6-5a74-4ec9-916d-6afe5f4a4367 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:57:59.898869 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 699/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:57:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:02.164568 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0b7a4-8a08-4ad8-aeee-523461664f7d None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:02.165143 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0b7a4-8a08-4ad8-aeee-523461664f7d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:02.165143 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0b7a4-8a08-4ad8-aeee-523461664f7d None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:02.166620 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 662/1361] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:02.171997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff631267-f729-4763-bb30-ec08997fb471 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:02.172546 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff631267-f729-4763-bb30-ec08997fb471 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:02.172546 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff631267-f729-4763-bb30-ec08997fb471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:02.245891 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ff631267-f729-4763-bb30-ec08997fb471 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:02.247159 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ff631267-f729-4763-bb30-ec08997fb471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:02.296426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:02.379445 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 700/1362] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 10:58:02.424660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0b7a4-8a08-4ad8-aeee-523461664f7d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:02.426523 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-75c0b7a4-8a08-4ad8-aeee-523461664f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:02.501664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:02.655032 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0b7a4-8a08-4ad8-aeee-523461664f7d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:02.818687 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91a61b-d9f2-4544-bf03-9111e44071c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:02.819353 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91a61b-d9f2-4544-bf03-9111e44071c8 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:02.819630 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91a61b-d9f2-4544-bf03-9111e44071c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:02.819893 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91a61b-d9f2-4544-bf03-9111e44071c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:02.821867 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2c91a61b-d9f2-4544-bf03-9111e44071c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:02.866301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:02.940882 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91a61b-d9f2-4544-bf03-9111e44071c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:02.942574 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91a61b-d9f2-4544-bf03-9111e44071c8 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:02.978656 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 663/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:05.370092 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfe1a1-a1a6-4a0a-9483-75c3b05a3b5f None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:05.370982 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfe1a1-a1a6-4a0a-9483-75c3b05a3b5f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:05.371425 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfe1a1-a1a6-4a0a-9483-75c3b05a3b5f None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:05.375358 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 701/1364] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:58:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:05.379449 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f3a9e-b689-4c83-a5c1-3c206dc67ff2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:05.380005 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f3a9e-b689-4c83-a5c1-3c206dc67ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:05.380236 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f3a9e-b689-4c83-a5c1-3c206dc67ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:05.474115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d02f3a9e-b689-4c83-a5c1-3c206dc67ff2 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:05.474874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d02f3a9e-b689-4c83-a5c1-3c206dc67ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:05.621552 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:05.629626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 664/1365] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 10:58:05.679869 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa87c3-6547-41bf-bcb8-e9b8c3149eb2 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:05.680154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa87c3-6547-41bf-bcb8-e9b8c3149eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:05.680435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa87c3-6547-41bf-bcb8-e9b8c3149eb2 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:05.684439 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 702/1366] 10.222.0.18 () {54 vars in 962 bytes} [Tue Jul 19 10:58:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:05.692608 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2be35-43b6-4469-881e-e2c76813d7a2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:05.692964 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2be35-43b6-4469-881e-e2c76813d7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:05.693199 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2be35-43b6-4469-881e-e2c76813d7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:05.796101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-42f2be35-43b6-4469-881e-e2c76813d7a2 None None] MFA Rules not processed for user `3c50a821e9ef44cb9fccd49ee4af7dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:05.797355 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-42f2be35-43b6-4469-881e-e2c76813d7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:05.982898 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 665/1367] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Jul 19 10:58:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:05.991059 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa87c3-6547-41bf-bcb8-e9b8c3149eb2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:05.992814 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bfaa87c3-6547-41bf-bcb8-e9b8c3149eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:06.226793 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa87c3-6547-41bf-bcb8-e9b8c3149eb2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:06.251784 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:06.416321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef4ea3-34f7-451d-a8c8-34ef2d02eb3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:06.417549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef4ea3-34f7-451d-a8c8-34ef2d02eb3b service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:06.417863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef4ea3-34f7-451d-a8c8-34ef2d02eb3b service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:06.418138 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef4ea3-34f7-451d-a8c8-34ef2d02eb3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:06.419842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b8ef4ea3-34f7-451d-a8c8-34ef2d02eb3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:06.530444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef4ea3-34f7-451d-a8c8-34ef2d02eb3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:06.532017 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef4ea3-34f7-451d-a8c8-34ef2d02eb3b service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:06.557001 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 703/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:08.865112 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923e884-533e-494c-825f-41cfa02ede96 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:08.865563 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923e884-533e-494c-825f-41cfa02ede96 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:08.865653 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923e884-533e-494c-825f-41cfa02ede96 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:08.872774 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca69604-25ed-4920-acf9-15380dfffe88 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:08.873183 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca69604-25ed-4920-acf9-15380dfffe88 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:08.873336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca69604-25ed-4920-acf9-15380dfffe88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:08.876202 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 666/1369] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:58:08 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:08.926318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:09.014912 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4ca69604-25ed-4920-acf9-15380dfffe88 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:09.016179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4ca69604-25ed-4920-acf9-15380dfffe88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:09.169130 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 704/1370] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:09.216248 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923e884-533e-494c-825f-41cfa02ede96 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:09.218973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a923e884-533e-494c-825f-41cfa02ede96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:09.343384 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:09.535652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923e884-533e-494c-825f-41cfa02ede96 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:09.692874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbc442-a84c-449c-84d6-f5707164a57a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:09.694015 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbc442-a84c-449c-84d6-f5707164a57a service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:09.694484 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbc442-a84c-449c-84d6-f5707164a57a service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:09.694997 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbc442-a84c-449c-84d6-f5707164a57a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:09.696896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0edbc442-a84c-449c-84d6-f5707164a57a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:09.707192 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:09.798135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbc442-a84c-449c-84d6-f5707164a57a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:09.800372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbc442-a84c-449c-84d6-f5707164a57a service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:09.821281 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 667/1371] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:11.165962 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8827c2-c82d-4efc-8088-ed0dc3b7ea19 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:11.166400 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8827c2-c82d-4efc-8088-ed0dc3b7ea19 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:11.166477 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8827c2-c82d-4efc-8088-ed0dc3b7ea19 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:11.172234 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 705/1372] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:58:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:11.174733 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95735db1-146c-4df5-a04b-6d7619d66c25 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:11.175299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95735db1-146c-4df5-a04b-6d7619d66c25 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:11.175666 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95735db1-146c-4df5-a04b-6d7619d66c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:11.329339 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-95735db1-146c-4df5-a04b-6d7619d66c25 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:11.331929 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-95735db1-146c-4df5-a04b-6d7619d66c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:11.455127 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:11.482036 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 668/1373] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:11.837365 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821d52d-6977-42fd-86ab-337bc89bf826 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:11.837365 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821d52d-6977-42fd-86ab-337bc89bf826 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:11.838574 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821d52d-6977-42fd-86ab-337bc89bf826 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:11.839171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 706/1374] 10.222.0.18 () {54 vars in 964 bytes} [Tue Jul 19 10:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:11.846611 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17bb16-434e-42a2-b2eb-772f01b523b6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:11.847052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17bb16-434e-42a2-b2eb-772f01b523b6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:11.847424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17bb16-434e-42a2-b2eb-772f01b523b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:11.935650 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-bf17bb16-434e-42a2-b2eb-772f01b523b6 None None] MFA Rules not processed for user `8112def59003484483552fc76f14e281`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:11.937056 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bf17bb16-434e-42a2-b2eb-772f01b523b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:12.048985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 669/1375] 10.222.0.18 () {58 vars in 1061 bytes} [Tue Jul 19 10:58:11 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:12.057009 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821d52d-6977-42fd-86ab-337bc89bf826 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:12.058537 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2821d52d-6977-42fd-86ab-337bc89bf826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:12.201666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821d52d-6977-42fd-86ab-337bc89bf826 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:12.205707 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:12.263323 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142357d-affc-4130-897e-ec230ffd490c None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:12.263843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142357d-affc-4130-897e-ec230ffd490c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:12.263924 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142357d-affc-4130-897e-ec230ffd490c None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:12.265447 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 670/1376] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:58:12.270420 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2eb7b0-62fc-43b0-84a1-7fb5bc08f59a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:12.270714 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2eb7b0-62fc-43b0-84a1-7fb5bc08f59a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:12.270996 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2eb7b0-62fc-43b0-84a1-7fb5bc08f59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:12.293050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d7434-e576-435f-8233-0ed074595f5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8112def59003484483552fc76f14e281', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:12.294006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d7434-e576-435f-8233-0ed074595f5b service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:12.294267 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d7434-e576-435f-8233-0ed074595f5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:12.294542 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d7434-e576-435f-8233-0ed074595f5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:12.296672 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-716d7434-e576-435f-8233-0ed074595f5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:12.348501 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9a2eb7b0-62fc-43b0-84a1-7fb5bc08f59a None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:12.349647 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9a2eb7b0-62fc-43b0-84a1-7fb5bc08f59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:12.385020 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:12.437190 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d7434-e576-435f-8233-0ed074595f5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:12.438455 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d7434-e576-435f-8233-0ed074595f5b service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:12.462954 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 707/1377] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:12.479786 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 671/1378] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 10:58:12.524376 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d7434-e576-435f-8233-0ed074595f5b service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:12.525822 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-716d7434-e576-435f-8233-0ed074595f5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:12.574473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:12.649031 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d7434-e576-435f-8233-0ed074595f5b service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:12.825438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a09a4a-97a8-47fa-b597-55c9f734207f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:12.826108 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a09a4a-97a8-47fa-b597-55c9f734207f service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:12.826461 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a09a4a-97a8-47fa-b597-55c9f734207f service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:12.826747 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a09a4a-97a8-47fa-b597-55c9f734207f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:12.828353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-53a09a4a-97a8-47fa-b597-55c9f734207f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:12.899131 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:12.998380 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a09a4a-97a8-47fa-b597-55c9f734207f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:13.001135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a09a4a-97a8-47fa-b597-55c9f734207f service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:13.050857 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 708/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:15.235273 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f7520-319f-43f9-8113-d102d0f97142 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:15.235874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f7520-319f-43f9-8113-d102d0f97142 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:15.235874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f7520-319f-43f9-8113-d102d0f97142 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:15.237370 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 672/1380] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:15.243105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34953348-b325-4680-a0dc-8a013812e548 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:15.243634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34953348-b325-4680-a0dc-8a013812e548 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:15.243634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34953348-b325-4680-a0dc-8a013812e548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:15.332148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-34953348-b325-4680-a0dc-8a013812e548 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:15.333394 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-34953348-b325-4680-a0dc-8a013812e548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:15.451666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 709/1381] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:15.495464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f7520-319f-43f9-8113-d102d0f97142 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:15.497014 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b60f7520-319f-43f9-8113-d102d0f97142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:15.679908 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f7520-319f-43f9-8113-d102d0f97142 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:15.693556 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:15.824429 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e689d55-d877-481d-a69d-38a0e1de0a67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:15.825243 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e689d55-d877-481d-a69d-38a0e1de0a67 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:15.825625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e689d55-d877-481d-a69d-38a0e1de0a67 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:15.826005 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e689d55-d877-481d-a69d-38a0e1de0a67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:15.827945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2e689d55-d877-481d-a69d-38a0e1de0a67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:15.922813 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e689d55-d877-481d-a69d-38a0e1de0a67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:15.924819 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e689d55-d877-481d-a69d-38a0e1de0a67 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:15.944989 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 673/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:18.134777 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d12ab4-4dbd-4fe5-a711-40f1d7d0f860 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:18.135358 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d12ab4-4dbd-4fe5-a711-40f1d7d0f860 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:18.135358 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d12ab4-4dbd-4fe5-a711-40f1d7d0f860 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:18.142444 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ea192-bf89-46f3-a295-1a0cef1fc5d2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:18.143083 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ea192-bf89-46f3-a295-1a0cef1fc5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:18.143083 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ea192-bf89-46f3-a295-1a0cef1fc5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:18.144881 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 710/1383] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:58:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:18.165480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:18.228104 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8c4ea192-bf89-46f3-a295-1a0cef1fc5d2 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:18.231041 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8c4ea192-bf89-46f3-a295-1a0cef1fc5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:18.411828 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 674/1384] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 10:58:18.458654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d12ab4-4dbd-4fe5-a711-40f1d7d0f860 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:18.460154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-60d12ab4-4dbd-4fe5-a711-40f1d7d0f860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:18.486179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:18.623380 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d12ab4-4dbd-4fe5-a711-40f1d7d0f860 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:18.729983 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:18.751657 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae7dac-68dd-4513-bd3a-2ec34a652587 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:18.752523 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae7dac-68dd-4513-bd3a-2ec34a652587 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:18.752917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae7dac-68dd-4513-bd3a-2ec34a652587 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:18.753280 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae7dac-68dd-4513-bd3a-2ec34a652587 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:18.755040 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7fae7dac-68dd-4513-bd3a-2ec34a652587 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:18.849323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae7dac-68dd-4513-bd3a-2ec34a652587 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:18.851047 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae7dac-68dd-4513-bd3a-2ec34a652587 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:18.869699 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 711/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:20.995986 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1b09e-cfcc-438b-9229-a259924442b2 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:20.997276 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1b09e-cfcc-438b-9229-a259924442b2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:20.997276 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1b09e-cfcc-438b-9229-a259924442b2 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:20.997940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 675/1386] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:21.003382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ed9ee-e27a-4f9a-ae62-1b624820f9ca None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:21.003856 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ed9ee-e27a-4f9a-ae62-1b624820f9ca None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:21.004057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ed9ee-e27a-4f9a-ae62-1b624820f9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:21.075282 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-627ed9ee-e27a-4f9a-ae62-1b624820f9ca None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:21.076499 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-627ed9ee-e27a-4f9a-ae62-1b624820f9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:21.138980 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:21.182594 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 712/1387] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:21.227487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1b09e-cfcc-438b-9229-a259924442b2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:21.229042 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-31a1b09e-cfcc-438b-9229-a259924442b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:21.352908 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:21.463553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1b09e-cfcc-438b-9229-a259924442b2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:21.615621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912060a-299c-4d0a-aa01-0a26d0c80349 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:21.616550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912060a-299c-4d0a-aa01-0a26d0c80349 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:21.617135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912060a-299c-4d0a-aa01-0a26d0c80349 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:21.617576 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912060a-299c-4d0a-aa01-0a26d0c80349 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:21.620317 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9912060a-299c-4d0a-aa01-0a26d0c80349 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:21.722727 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:21.759142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912060a-299c-4d0a-aa01-0a26d0c80349 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:21.760775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912060a-299c-4d0a-aa01-0a26d0c80349 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:21.780358 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 676/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:24.070825 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e7bfd-9da3-464a-b8f5-ea5f3baa9d14 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:24.071661 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e7bfd-9da3-464a-b8f5-ea5f3baa9d14 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:24.071661 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e7bfd-9da3-464a-b8f5-ea5f3baa9d14 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:24.074290 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 713/1389] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:24.081173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae19a3c-8fbe-4969-88d8-d14a01659817 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:24.081976 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae19a3c-8fbe-4969-88d8-d14a01659817 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:24.082142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae19a3c-8fbe-4969-88d8-d14a01659817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:24.184292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-dae19a3c-8fbe-4969-88d8-d14a01659817 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:24.185795 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dae19a3c-8fbe-4969-88d8-d14a01659817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:24.327172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 677/1390] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:24.383422 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e7bfd-9da3-464a-b8f5-ea5f3baa9d14 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:24.385020 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b45e7bfd-9da3-464a-b8f5-ea5f3baa9d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:24.586308 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e7bfd-9da3-464a-b8f5-ea5f3baa9d14 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:24.643875 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:24.735783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16167551-1496-43c9-be28-1f8d5a62c318 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:24.736550 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16167551-1496-43c9-be28-1f8d5a62c318 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:24.736919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16167551-1496-43c9-be28-1f8d5a62c318 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:24.737180 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16167551-1496-43c9-be28-1f8d5a62c318 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:24.738899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-16167551-1496-43c9-be28-1f8d5a62c318 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:24.868030 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16167551-1496-43c9-be28-1f8d5a62c318 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:24.869616 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16167551-1496-43c9-be28-1f8d5a62c318 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:24.889421 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 714/1391] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:26.999707 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18563bb0-422d-4fe9-a645-a411dca8efd6 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:27.000364 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18563bb0-422d-4fe9-a645-a411dca8efd6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:27.000364 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18563bb0-422d-4fe9-a645-a411dca8efd6 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:27.001714 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 678/1392] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:27.007398 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfdbc1-97b3-4d05-b6f8-180b045748c5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:27.007917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfdbc1-97b3-4d05-b6f8-180b045748c5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:27.008068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfdbc1-97b3-4d05-b6f8-180b045748c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:27.072906 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:27.081589 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-81dfdbc1-97b3-4d05-b6f8-180b045748c5 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:27.082818 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-81dfdbc1-97b3-4d05-b6f8-180b045748c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:27.187692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 715/1393] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:27.234108 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18563bb0-422d-4fe9-a645-a411dca8efd6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:27.236828 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-18563bb0-422d-4fe9-a645-a411dca8efd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:27.284555 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:27.403668 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18563bb0-422d-4fe9-a645-a411dca8efd6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:27.527068 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:27.530162 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a1865-eb95-4465-b619-f65b8c2decb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:27.530830 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a1865-eb95-4465-b619-f65b8c2decb8 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:27.531118 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a1865-eb95-4465-b619-f65b8c2decb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:27.531390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a1865-eb95-4465-b619-f65b8c2decb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:27.533524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b10a1865-eb95-4465-b619-f65b8c2decb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:27.625986 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a1865-eb95-4465-b619-f65b8c2decb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:27.627632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a1865-eb95-4465-b619-f65b8c2decb8 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:27.646708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 679/1394] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:28.271530 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7af071-7e44-4f5d-bb50-d438afcc98f1 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:28.272073 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7af071-7e44-4f5d-bb50-d438afcc98f1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:28.272073 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7af071-7e44-4f5d-bb50-d438afcc98f1 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:28.273508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 716/1395] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:28.279459 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd151fa-cf04-4e31-942f-cbfb4fbf3f30 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:28.280011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd151fa-cf04-4e31-942f-cbfb4fbf3f30 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:28.280011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd151fa-cf04-4e31-942f-cbfb4fbf3f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:28.362454 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7cd151fa-cf04-4e31-942f-cbfb4fbf3f30 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:28.364879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7cd151fa-cf04-4e31-942f-cbfb4fbf3f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:28.459507 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:28.493638 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 680/1396] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 10:58:28.554696 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b3737-2201-4a32-a5bf-e5cfdf68a562 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:28.555051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b3737-2201-4a32-a5bf-e5cfdf68a562 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:28.555252 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b3737-2201-4a32-a5bf-e5cfdf68a562 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:28.557864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 717/1397] 10.222.0.18 () {54 vars in 961 bytes} [Tue Jul 19 10:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:28.563130 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228ecb6-1e24-4068-bced-78a527eeefbe None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:28.563428 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228ecb6-1e24-4068-bced-78a527eeefbe None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:28.563689 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228ecb6-1e24-4068-bced-78a527eeefbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:28.649392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6228ecb6-1e24-4068-bced-78a527eeefbe None None] MFA Rules not processed for user `d1bcfbee5a5e4016a77901d0a637da63`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:28.650621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6228ecb6-1e24-4068-bced-78a527eeefbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:28.737436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 681/1398] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Jul 19 10:58:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:28.745866 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b3737-2201-4a32-a5bf-e5cfdf68a562 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:28.747731 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e01b3737-2201-4a32-a5bf-e5cfdf68a562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:28.871628 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b3737-2201-4a32-a5bf-e5cfdf68a562 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:28.901384 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:28.968173 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b3d3b-4a16-4057-a20e-3774283fa0ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bcfbee5a5e4016a77901d0a637da63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:28.969057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b3d3b-4a16-4057-a20e-3774283fa0ed service glance] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:28.969420 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b3d3b-4a16-4057-a20e-3774283fa0ed service glance] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:28.969948 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b3d3b-4a16-4057-a20e-3774283fa0ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:28.972873 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7f6b3d3b-4a16-4057-a20e-3774283fa0ed service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:29.109464 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b3d3b-4a16-4057-a20e-3774283fa0ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:29.110944 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b3d3b-4a16-4057-a20e-3774283fa0ed service glance] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:29.130764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 718/1399] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:29.773128 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a574c9-23fe-4e14-8c59-852c34f275b8 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:29.773882 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a574c9-23fe-4e14-8c59-852c34f275b8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:29.774048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a574c9-23fe-4e14-8c59-852c34f275b8 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:29.776299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 682/1400] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:58:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:29.785084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d7289-150e-42eb-989a-c812a324843e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:29.785930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d7289-150e-42eb-989a-c812a324843e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:29.785930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d7289-150e-42eb-989a-c812a324843e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:29.869619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e13d7289-150e-42eb-989a-c812a324843e None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:29.870905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e13d7289-150e-42eb-989a-c812a324843e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:29.879656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:29.916532 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84fd5d-721e-4233-b88e-c3c8c8bb92f8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:29.916858 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84fd5d-721e-4233-b88e-c3c8c8bb92f8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:29.917139 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84fd5d-721e-4233-b88e-c3c8c8bb92f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:29.988810 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 719/1401] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:29.993978 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5a84fd5d-721e-4233-b88e-c3c8c8bb92f8 None None] MFA Rules not processed for user `654631b067b94b269f93ea7b3977609d`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:29.995225 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5a84fd5d-721e-4233-b88e-c3c8c8bb92f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:30.015453 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:30.031258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d7289-150e-42eb-989a-c812a324843e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:30.032519 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e13d7289-150e-42eb-989a-c812a324843e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:30.096424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 683/1402] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 19 10:58:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 10:58:30.147315 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7d327-6b0d-4091-a315-20245173831d None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:30.147604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7d327-6b0d-4091-a315-20245173831d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:30.147880 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7d327-6b0d-4091-a315-20245173831d None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:30.149299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 684/1403] 10.222.0.18 () {54 vars in 943 bytes} [Tue Jul 19 10:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:58:30.155849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79f63e-d35f-4cfd-88c5-2c7914a68176 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:30.156223 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79f63e-d35f-4cfd-88c5-2c7914a68176 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:30.156510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79f63e-d35f-4cfd-88c5-2c7914a68176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:30.159927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d7289-150e-42eb-989a-c812a324843e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:30.186510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:30.236605 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1d79f63e-d35f-4cfd-88c5-2c7914a68176 None None] MFA Rules not processed for user `4fa6a9aa611640f893b5e717a094acf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:30.237867 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1d79f63e-d35f-4cfd-88c5-2c7914a68176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:30.290775 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030829eb-2def-4576-ad3e-e46d26146012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:30.291712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030829eb-2def-4576-ad3e-e46d26146012 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:30.292183 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030829eb-2def-4576-ad3e-e46d26146012 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:30.292669 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030829eb-2def-4576-ad3e-e46d26146012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:30.296007 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-030829eb-2def-4576-ad3e-e46d26146012 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:30.356607 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:30.371372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 685/1404] 10.222.0.18 () {58 vars in 1040 bytes} [Tue Jul 19 10:58:30 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 10:58:30.381534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79f63e-d35f-4cfd-88c5-2c7914a68176 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:30.391680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79f63e-d35f-4cfd-88c5-2c7914a68176 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:30.411108 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030829eb-2def-4576-ad3e-e46d26146012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:30.412767 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030829eb-2def-4576-ad3e-e46d26146012 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:30.443274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 720/1405] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 10:58:30.523169 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cecd7-8bbc-4df7-ba52-05e0afa5000d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa6a9aa611640f893b5e717a094acf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:30.523869 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cecd7-8bbc-4df7-ba52-05e0afa5000d service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:30.524153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cecd7-8bbc-4df7-ba52-05e0afa5000d service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:30.524432 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cecd7-8bbc-4df7-ba52-05e0afa5000d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:30.533640 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-236cecd7-8bbc-4df7-ba52-05e0afa5000d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:30.648670 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236cecd7-8bbc-4df7-ba52-05e0afa5000d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:30.650397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236cecd7-8bbc-4df7-ba52-05e0afa5000d service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:30.660817 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 686/1406] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 19 10:58:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 10:58:32.562715 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672122b3-3755-4855-a838-96aba73665f6 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:32.562715 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672122b3-3755-4855-a838-96aba73665f6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:32.562715 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672122b3-3755-4855-a838-96aba73665f6 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:32.564629 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 721/1407] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:32.570978 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857cbdb-9e5b-4dc4-a259-388ed4fb3479 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:32.571498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857cbdb-9e5b-4dc4-a259-388ed4fb3479 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:32.571754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857cbdb-9e5b-4dc4-a259-388ed4fb3479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:32.599576 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:32.662289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7857cbdb-9e5b-4dc4-a259-388ed4fb3479 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:32.663629 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7857cbdb-9e5b-4dc4-a259-388ed4fb3479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:32.812163 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 687/1408] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:32.861395 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672122b3-3755-4855-a838-96aba73665f6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:32.863968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-672122b3-3755-4855-a838-96aba73665f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:32.902025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:33.079810 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672122b3-3755-4855-a838-96aba73665f6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:33.245816 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:33.267056 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc711d-10bb-46af-806a-724555bfe663 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:33.267838 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc711d-10bb-46af-806a-724555bfe663 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:33.268311 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc711d-10bb-46af-806a-724555bfe663 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:33.268785 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc711d-10bb-46af-806a-724555bfe663 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:33.272087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-08fc711d-10bb-46af-806a-724555bfe663 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:33.407946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc711d-10bb-46af-806a-724555bfe663 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:33.409538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc711d-10bb-46af-806a-724555bfe663 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:33.437134 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 722/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 10:58:42.810099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=57 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:43.434025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=49 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:54.076544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d7b55-e5e7-4141-a943-ee00c890c251 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:54.077266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d7b55-e5e7-4141-a943-ee00c890c251 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:54.077266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d7b55-e5e7-4141-a943-ee00c890c251 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:54.078780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 688/1410] 10.222.0.18 () {54 vars in 918 bytes} [Tue Jul 19 10:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:54.085034 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e56c9-f978-4928-b2e7-d4799f421057 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:54.085732 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e56c9-f978-4928-b2e7-d4799f421057 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:54.085732 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e56c9-f978-4928-b2e7-d4799f421057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:54.183087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-548e56c9-f978-4928-b2e7-d4799f421057 None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:54.184324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-548e56c9-f978-4928-b2e7-d4799f421057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:54.300780 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 723/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Jul 19 10:58:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:54.317708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c13239-5730-4950-8d51-e825a5a0fe83 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:54.317955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c13239-5730-4950-8d51-e825a5a0fe83 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:54.318264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c13239-5730-4950-8d51-e825a5a0fe83 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:54.319652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 689/1412] 10.222.0.18 () {54 vars in 918 bytes} [Tue Jul 19 10:58:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:54.324938 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d177fb2-26a8-4724-b6fb-ccac207d783f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:54.324938 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d177fb2-26a8-4724-b6fb-ccac207d783f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:54.324938 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d177fb2-26a8-4724-b6fb-ccac207d783f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:54.407394 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:54.410998 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3d177fb2-26a8-4724-b6fb-ccac207d783f None None] MFA Rules not processed for user `3c50a821e9ef44cb9fccd49ee4af7dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:54.412501 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3d177fb2-26a8-4724-b6fb-ccac207d783f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:54.539657 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 724/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Jul 19 10:58:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:57.108846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb601385-8f53-48bf-89ed-b13f34ad2635 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:57.109487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb601385-8f53-48bf-89ed-b13f34ad2635 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:57.109697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb601385-8f53-48bf-89ed-b13f34ad2635 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:57.111607 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 690/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 10:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:57.119822 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff54ee0-81ea-4446-8cf5-78ea4b4f45bb None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:57.120468 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff54ee0-81ea-4446-8cf5-78ea4b4f45bb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:57.120468 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff54ee0-81ea-4446-8cf5-78ea4b4f45bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:57.215308 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4ff54ee0-81ea-4446-8cf5-78ea4b4f45bb None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:57.216556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4ff54ee0-81ea-4446-8cf5-78ea4b4f45bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:57.283279 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:57.337490 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 725/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 10:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:57.382362 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb601385-8f53-48bf-89ed-b13f34ad2635 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:57.384884 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bb601385-8f53-48bf-89ed-b13f34ad2635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:57.552277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb601385-8f53-48bf-89ed-b13f34ad2635 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:57.632014 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:57.678439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583e192-efce-4622-bcd9-6144739d42de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:57.679117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583e192-efce-4622-bcd9-6144739d42de service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:57.679433 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583e192-efce-4622-bcd9-6144739d42de service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:57.679715 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583e192-efce-4622-bcd9-6144739d42de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:57.681490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d583e192-efce-4622-bcd9-6144739d42de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:57.810721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583e192-efce-4622-bcd9-6144739d42de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:57.812424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583e192-efce-4622-bcd9-6144739d42de service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:57.833902 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 691/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:58.763718 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc5895-e773-4c45-9415-e964647e78f9 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:58.764747 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc5895-e773-4c45-9415-e964647e78f9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:58.764747 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc5895-e773-4c45-9415-e964647e78f9 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:58.765752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 726/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 10:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:58.771268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d47c73-67dc-4d72-bea4-14dcb7b1b27d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:58.771773 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d47c73-67dc-4d72-bea4-14dcb7b1b27d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:58.771773 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d47c73-67dc-4d72-bea4-14dcb7b1b27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:58.860137 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-75d47c73-67dc-4d72-bea4-14dcb7b1b27d None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:58.861681 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-75d47c73-67dc-4d72-bea4-14dcb7b1b27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:58.892490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:58.981004 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 692/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 10:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:59.147328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc5895-e773-4c45-9415-e964647e78f9 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:59.149058 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9abc5895-e773-4c45-9415-e964647e78f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:59.312605 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc5895-e773-4c45-9415-e964647e78f9 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:59.357370 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:59.455186 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1823d3-3531-4fe6-8bba-44aa95c731d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:59.455890 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1823d3-3531-4fe6-8bba-44aa95c731d9 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:59.456178 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1823d3-3531-4fe6-8bba-44aa95c731d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:59.456446 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1823d3-3531-4fe6-8bba-44aa95c731d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:59.458225 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cb1823d3-3531-4fe6-8bba-44aa95c731d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:59.560025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1823d3-3531-4fe6-8bba-44aa95c731d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:59.561821 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1823d3-3531-4fe6-8bba-44aa95c731d9 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:59.583100 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 727/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:00.531795 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20766510-db0c-4802-a8c3-ab5519db88a9 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:00.532628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20766510-db0c-4802-a8c3-ab5519db88a9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:00.532628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20766510-db0c-4802-a8c3-ab5519db88a9 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:00.533780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 693/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 10:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:00.539321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05705ffe-0713-4d31-9c9c-59e9fd9c661e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:00.539904 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05705ffe-0713-4d31-9c9c-59e9fd9c661e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:00.539904 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05705ffe-0713-4d31-9c9c-59e9fd9c661e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:00.597405 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:00.637551 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-05705ffe-0713-4d31-9c9c-59e9fd9c661e None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:00.639547 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-05705ffe-0713-4d31-9c9c-59e9fd9c661e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:00.776088 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 728/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 10:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 10:59:00.926840 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20766510-db0c-4802-a8c3-ab5519db88a9 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:00.928280 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-20766510-db0c-4802-a8c3-ab5519db88a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:01.089726 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20766510-db0c-4802-a8c3-ab5519db88a9 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:01.103280 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:01.242465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb1e5f-cdd2-436d-8ecb-b173293308c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:01.243559 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb1e5f-cdd2-436d-8ecb-b173293308c9 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:01.244037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb1e5f-cdd2-436d-8ecb-b173293308c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:01.244510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb1e5f-cdd2-436d-8ecb-b173293308c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:01.247568 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4edb1e5f-cdd2-436d-8ecb-b173293308c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:01.395979 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb1e5f-cdd2-436d-8ecb-b173293308c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:01.398979 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb1e5f-cdd2-436d-8ecb-b173293308c9 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:01.431224 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 694/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 10:59:02.316145 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061e993-7273-41e9-99e5-14b138561cea None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:02.316807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061e993-7273-41e9-99e5-14b138561cea None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:02.316807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061e993-7273-41e9-99e5-14b138561cea None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:02.318198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 729/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 10:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:02.324625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5cb20-50c6-4340-bf49-92c23f2ffc5d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:02.325155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5cb20-50c6-4340-bf49-92c23f2ffc5d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:02.325291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5cb20-50c6-4340-bf49-92c23f2ffc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:02.346255 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:02.413161 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5fe5cb20-50c6-4340-bf49-92c23f2ffc5d None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:02.414432 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5fe5cb20-50c6-4340-bf49-92c23f2ffc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:02.527364 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 695/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 10:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:02.675229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061e993-7273-41e9-99e5-14b138561cea None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:02.676697 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0061e993-7273-41e9-99e5-14b138561cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:02.809245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:02.852915 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061e993-7273-41e9-99e5-14b138561cea None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:03.059812 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48785d-5697-4396-af46-a6b5d36fb74d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:03.060979 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48785d-5697-4396-af46-a6b5d36fb74d service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:03.061518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48785d-5697-4396-af46-a6b5d36fb74d service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:03.062066 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48785d-5697-4396-af46-a6b5d36fb74d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:03.065281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5e48785d-5697-4396-af46-a6b5d36fb74d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:03.161464 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:03.178355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48785d-5697-4396-af46-a6b5d36fb74d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:03.180462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48785d-5697-4396-af46-a6b5d36fb74d service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:03.203269 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 730/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:04.126296 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed966ad-8e15-42f3-955f-5b890373fe04 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:04.126926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed966ad-8e15-42f3-955f-5b890373fe04 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:04.126926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed966ad-8e15-42f3-955f-5b890373fe04 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:04.128351 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 696/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 10:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:59:04.134497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36caef-78ee-43d1-9a67-e6f0d3d253ce None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:04.135085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36caef-78ee-43d1-9a67-e6f0d3d253ce None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:04.135085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36caef-78ee-43d1-9a67-e6f0d3d253ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:04.226684 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-eb36caef-78ee-43d1-9a67-e6f0d3d253ce None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:04.228051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-eb36caef-78ee-43d1-9a67-e6f0d3d253ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:04.351124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 731/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 10:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:04.501580 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed966ad-8e15-42f3-955f-5b890373fe04 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:04.503171 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fed966ad-8e15-42f3-955f-5b890373fe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:04.597096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:04.666845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed966ad-8e15-42f3-955f-5b890373fe04 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:04.798768 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756c383-7aeb-4c9b-966b-c8372f3be5ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:04.799464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756c383-7aeb-4c9b-966b-c8372f3be5ca service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:04.799740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756c383-7aeb-4c9b-966b-c8372f3be5ca service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:04.800021 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756c383-7aeb-4c9b-966b-c8372f3be5ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:04.802051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2756c383-7aeb-4c9b-966b-c8372f3be5ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:04.861158 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:04.909140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756c383-7aeb-4c9b-966b-c8372f3be5ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:04.910944 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756c383-7aeb-4c9b-966b-c8372f3be5ca service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:04.931759 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 697/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:05.750083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce30830-4f75-41ed-b92e-60db942e932b None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:05.750648 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce30830-4f75-41ed-b92e-60db942e932b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:05.750648 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce30830-4f75-41ed-b92e-60db942e932b None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:05.751919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 732/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 10:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:59:05.766352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57de77-84f0-438c-bcd3-67fdc0caf111 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:05.766893 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57de77-84f0-438c-bcd3-67fdc0caf111 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:05.766893 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57de77-84f0-438c-bcd3-67fdc0caf111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:05.854836 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7a57de77-84f0-438c-bcd3-67fdc0caf111 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:05.856059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7a57de77-84f0-438c-bcd3-67fdc0caf111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:05.988077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 698/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 10:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 10:59:06.143859 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce30830-4f75-41ed-b92e-60db942e932b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:06.145395 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fce30830-4f75-41ed-b92e-60db942e932b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:06.204430 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:06.316007 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce30830-4f75-41ed-b92e-60db942e932b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:06.445464 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6c7de-eb02-4c61-ba2b-c70274529ee6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:06.446545 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6c7de-eb02-4c61-ba2b-c70274529ee6 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:06.446545 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6c7de-eb02-4c61-ba2b-c70274529ee6 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:06.446790 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6c7de-eb02-4c61-ba2b-c70274529ee6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:06.448372 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e0e6c7de-eb02-4c61-ba2b-c70274529ee6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:06.456759 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:06.559637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6c7de-eb02-4c61-ba2b-c70274529ee6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:06.561623 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6c7de-eb02-4c61-ba2b-c70274529ee6 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:06.582674 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 733/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:07.446454 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f24cc0-9167-4276-8a4f-44c01871ba33 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:07.446944 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f24cc0-9167-4276-8a4f-44c01871ba33 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:07.447096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f24cc0-9167-4276-8a4f-44c01871ba33 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:07.448669 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 699/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 10:59:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:07.454744 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a1a59-a8d2-48a3-86ec-0aff5cd10ef4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:07.455303 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a1a59-a8d2-48a3-86ec-0aff5cd10ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:07.455303 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a1a59-a8d2-48a3-86ec-0aff5cd10ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:07.541128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-196a1a59-a8d2-48a3-86ec-0aff5cd10ef4 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:07.542373 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-196a1a59-a8d2-48a3-86ec-0aff5cd10ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:07.615805 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:07.649143 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 734/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 10:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:07.918390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f24cc0-9167-4276-8a4f-44c01871ba33 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:07.919867 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-09f24cc0-9167-4276-8a4f-44c01871ba33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:07.939448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:08.097306 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f24cc0-9167-4276-8a4f-44c01871ba33 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:08.226691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:08.255572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cae4ea-7fb7-4d47-8261-b97212b967f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:08.256392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cae4ea-7fb7-4d47-8261-b97212b967f6 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:08.256859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cae4ea-7fb7-4d47-8261-b97212b967f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:08.257180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cae4ea-7fb7-4d47-8261-b97212b967f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:08.259467 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-52cae4ea-7fb7-4d47-8261-b97212b967f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:08.380627 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cae4ea-7fb7-4d47-8261-b97212b967f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:08.382432 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cae4ea-7fb7-4d47-8261-b97212b967f6 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:08.403012 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 700/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:09.281895 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7da458-3178-43b7-b522-e79a05228ba4 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:09.282752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7da458-3178-43b7-b522-e79a05228ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:09.282950 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7da458-3178-43b7-b522-e79a05228ba4 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:09.284587 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 735/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 10:59:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:09.290373 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7f8e6-b247-4941-b2bc-85dc2c126925 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:09.290883 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7f8e6-b247-4941-b2bc-85dc2c126925 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:09.291042 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7f8e6-b247-4941-b2bc-85dc2c126925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:09.379554 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b9f7f8e6-b247-4941-b2bc-85dc2c126925 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:09.380829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b9f7f8e6-b247-4941-b2bc-85dc2c126925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:09.427017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:09.498506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 701/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 10:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:09.650280 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7da458-3178-43b7-b522-e79a05228ba4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:09.651715 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dd7da458-3178-43b7-b522-e79a05228ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:09.832070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7da458-3178-43b7-b522-e79a05228ba4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:09.890827 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:09.954495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61236c9-d46f-48c8-a393-ff981d713dd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:09.955154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61236c9-d46f-48c8-a393-ff981d713dd2 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:09.955407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61236c9-d46f-48c8-a393-ff981d713dd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:09.955677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61236c9-d46f-48c8-a393-ff981d713dd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:09.957377 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a61236c9-d46f-48c8-a393-ff981d713dd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:10.059797 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61236c9-d46f-48c8-a393-ff981d713dd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:10.061600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61236c9-d46f-48c8-a393-ff981d713dd2 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:10.083155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 736/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 10:59:10.894095 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25efee3-fbad-4efd-8b85-d6293b76ec1a None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:10.894686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25efee3-fbad-4efd-8b85-d6293b76ec1a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:10.894686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25efee3-fbad-4efd-8b85-d6293b76ec1a None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:10.896082 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 702/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 10:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:10.902615 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3486fe-765e-4709-87c5-c0951a4dc239 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:10.903240 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3486fe-765e-4709-87c5-c0951a4dc239 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:10.903611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3486fe-765e-4709-87c5-c0951a4dc239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:10.994109 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0d3486fe-765e-4709-87c5-c0951a4dc239 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:10.995261 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0d3486fe-765e-4709-87c5-c0951a4dc239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:10.997543 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:11.106594 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 737/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 10:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:11.255320 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25efee3-fbad-4efd-8b85-d6293b76ec1a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:11.257013 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d25efee3-fbad-4efd-8b85-d6293b76ec1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:11.423375 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25efee3-fbad-4efd-8b85-d6293b76ec1a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:11.456702 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:11.566741 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7edc99-bfd6-4b2a-97e7-0a9abd4f7462 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:11.567321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7edc99-bfd6-4b2a-97e7-0a9abd4f7462 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:11.567602 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7edc99-bfd6-4b2a-97e7-0a9abd4f7462 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:11.567874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7edc99-bfd6-4b2a-97e7-0a9abd4f7462 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:11.569627 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1f7edc99-bfd6-4b2a-97e7-0a9abd4f7462 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:11.671766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7edc99-bfd6-4b2a-97e7-0a9abd4f7462 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:11.673518 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7edc99-bfd6-4b2a-97e7-0a9abd4f7462 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:11.692807 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 703/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:13.636807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfe075-7524-4e47-bf4a-8b9a8600d03d None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:13.637362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfe075-7524-4e47-bf4a-8b9a8600d03d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:13.637362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfe075-7524-4e47-bf4a-8b9a8600d03d None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:13.638623 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 738/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 10:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:13.644343 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5107f70-028b-4bb4-a42a-7af7e5d2acd0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:13.644837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5107f70-028b-4bb4-a42a-7af7e5d2acd0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:13.644951 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5107f70-028b-4bb4-a42a-7af7e5d2acd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:13.689116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:13.718065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e5107f70-028b-4bb4-a42a-7af7e5d2acd0 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:13.719352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e5107f70-028b-4bb4-a42a-7af7e5d2acd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:13.820366 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 704/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 10:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:13.861027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfe075-7524-4e47-bf4a-8b9a8600d03d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:13.864669 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2cdfe075-7524-4e47-bf4a-8b9a8600d03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:13.984100 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfe075-7524-4e47-bf4a-8b9a8600d03d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:14.018158 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:14.066694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e9e85-f299-4a6f-be1e-c9a3408a22a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:14.067398 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e9e85-f299-4a6f-be1e-c9a3408a22a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:14.067648 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e9e85-f299-4a6f-be1e-c9a3408a22a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:14.067923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e9e85-f299-4a6f-be1e-c9a3408a22a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:14.069783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a24e9e85-f299-4a6f-be1e-c9a3408a22a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:14.203325 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e9e85-f299-4a6f-be1e-c9a3408a22a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:14.204947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e9e85-f299-4a6f-be1e-c9a3408a22a0 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:14.226833 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 739/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:16.423288 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9ed33-967c-47c9-8774-298b54a7d886 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:16.424072 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9ed33-967c-47c9-8774-298b54a7d886 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:16.424072 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9ed33-967c-47c9-8774-298b54a7d886 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:16.425229 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 705/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 10:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:16.431011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fcbcf-ae2b-47a4-b6d6-5429c96e56bf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:16.431536 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fcbcf-ae2b-47a4-b6d6-5429c96e56bf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:16.431536 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fcbcf-ae2b-47a4-b6d6-5429c96e56bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:16.505679 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-257fcbcf-ae2b-47a4-b6d6-5429c96e56bf None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:16.506943 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-257fcbcf-ae2b-47a4-b6d6-5429c96e56bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:16.521024 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:16.613430 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 740/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 10:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 10:59:16.653260 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9ed33-967c-47c9-8774-298b54a7d886 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:16.654809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-69a9ed33-967c-47c9-8774-298b54a7d886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:16.772277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9ed33-967c-47c9-8774-298b54a7d886 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:16.786179 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:16.850026 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fb232-ccb5-4410-8058-f5342377e9eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:16.850686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fb232-ccb5-4410-8058-f5342377e9eb service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:16.850963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fb232-ccb5-4410-8058-f5342377e9eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:16.851231 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fb232-ccb5-4410-8058-f5342377e9eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:16.852918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fb8fb232-ccb5-4410-8058-f5342377e9eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:16.967843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fb232-ccb5-4410-8058-f5342377e9eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:16.969237 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fb232-ccb5-4410-8058-f5342377e9eb service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:16.990090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 706/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:19.503280 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2727e-07be-49e1-b2d5-dd8db87f5081 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:19.503868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2727e-07be-49e1-b2d5-dd8db87f5081 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:19.503868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2727e-07be-49e1-b2d5-dd8db87f5081 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:19.505332 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 741/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 10:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:19.511656 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabc84f-53ab-46d2-9238-2e8d1b54eb80 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:19.512245 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabc84f-53ab-46d2-9238-2e8d1b54eb80 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:19.512245 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabc84f-53ab-46d2-9238-2e8d1b54eb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:19.563796 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:19.584590 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-bdabc84f-53ab-46d2-9238-2e8d1b54eb80 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:19.586231 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bdabc84f-53ab-46d2-9238-2e8d1b54eb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:19.692220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 707/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 10:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:19.732620 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2727e-07be-49e1-b2d5-dd8db87f5081 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:19.734383 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c2f2727e-07be-49e1-b2d5-dd8db87f5081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:19.856918 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2727e-07be-49e1-b2d5-dd8db87f5081 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:19.901865 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:19.938534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e432e92-4467-46be-8d38-8cd1ae47359d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:19.939240 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e432e92-4467-46be-8d38-8cd1ae47359d service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:19.939592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e432e92-4467-46be-8d38-8cd1ae47359d service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:19.939855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e432e92-4467-46be-8d38-8cd1ae47359d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:19.941643 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5e432e92-4467-46be-8d38-8cd1ae47359d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:20.067307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e432e92-4467-46be-8d38-8cd1ae47359d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:20.068688 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e432e92-4467-46be-8d38-8cd1ae47359d service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:20.088574 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 742/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:22.286034 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2578fbe-71e7-4051-90bb-f56fdf4ab612 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:22.286703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2578fbe-71e7-4051-90bb-f56fdf4ab612 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:22.286905 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2578fbe-71e7-4051-90bb-f56fdf4ab612 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:22.289327 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 708/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 10:59:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:22.294903 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a82043-fe60-44c1-a686-8ca0150ea3a3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:22.295407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a82043-fe60-44c1-a686-8ca0150ea3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:22.295502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a82043-fe60-44c1-a686-8ca0150ea3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:22.369912 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-47a82043-fe60-44c1-a686-8ca0150ea3a3 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:22.371142 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-47a82043-fe60-44c1-a686-8ca0150ea3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:22.394102 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:22.481082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 743/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 10:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:22.520364 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2578fbe-71e7-4051-90bb-f56fdf4ab612 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:22.522132 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d2578fbe-71e7-4051-90bb-f56fdf4ab612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:22.667484 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2578fbe-71e7-4051-90bb-f56fdf4ab612 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:22.701415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:22.770155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00c1cf-3134-4f4b-9c4c-292ab68bc90c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:22.770824 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00c1cf-3134-4f4b-9c4c-292ab68bc90c service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:22.771108 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00c1cf-3134-4f4b-9c4c-292ab68bc90c service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:22.771385 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00c1cf-3134-4f4b-9c4c-292ab68bc90c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:22.773122 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6f00c1cf-3134-4f4b-9c4c-292ab68bc90c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:22.897914 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00c1cf-3134-4f4b-9c4c-292ab68bc90c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:22.899379 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00c1cf-3134-4f4b-9c4c-292ab68bc90c service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:22.921815 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 709/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:25.030879 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cf302-764c-48ea-b4e9-1bb661347e9f None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:25.031435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cf302-764c-48ea-b4e9-1bb661347e9f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:25.031435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cf302-764c-48ea-b4e9-1bb661347e9f None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:25.032695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 744/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 10:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:25.039590 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373c00f-5e09-4bc9-937a-3d9fb396840a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:25.040116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373c00f-5e09-4bc9-937a-3d9fb396840a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:25.040585 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373c00f-5e09-4bc9-937a-3d9fb396840a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:25.118959 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:25.122391 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f373c00f-5e09-4bc9-937a-3d9fb396840a None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:25.124641 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f373c00f-5e09-4bc9-937a-3d9fb396840a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:25.228245 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 710/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 10:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:25.266484 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262cf302-764c-48ea-b4e9-1bb661347e9f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:25.268036 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-262cf302-764c-48ea-b4e9-1bb661347e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:25.375871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262cf302-764c-48ea-b4e9-1bb661347e9f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:25.425474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:25.456572 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142099e7-0461-4b00-b6bc-210736e3be08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:25.457235 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142099e7-0461-4b00-b6bc-210736e3be08 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:25.457523 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142099e7-0461-4b00-b6bc-210736e3be08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:25.457794 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142099e7-0461-4b00-b6bc-210736e3be08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:25.459489 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-142099e7-0461-4b00-b6bc-210736e3be08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:25.576882 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142099e7-0461-4b00-b6bc-210736e3be08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:25.578341 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142099e7-0461-4b00-b6bc-210736e3be08 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:25.597057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 745/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 10:59:27.739975 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b8e45-4a32-41f3-bd27-a072ed784bfd None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:27.740531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b8e45-4a32-41f3-bd27-a072ed784bfd None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:27.740531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b8e45-4a32-41f3-bd27-a072ed784bfd None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:27.741838 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 711/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 10:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:27.747711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd3672-70a5-4e99-bad8-4968aaca6372 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:27.748253 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd3672-70a5-4e99-bad8-4968aaca6372 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:27.748369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd3672-70a5-4e99-bad8-4968aaca6372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:27.815607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-88bd3672-70a5-4e99-bad8-4968aaca6372 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:27.816888 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-88bd3672-70a5-4e99-bad8-4968aaca6372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:27.848450 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:27.920325 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 746/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 10:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:27.959062 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b8e45-4a32-41f3-bd27-a072ed784bfd None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:27.961072 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-481b8e45-4a32-41f3-bd27-a072ed784bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:28.076076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b8e45-4a32-41f3-bd27-a072ed784bfd None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:28.104688 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:28.153553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf2544-4ef1-48c0-a3d2-728830188d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:28.154277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf2544-4ef1-48c0-a3d2-728830188d06 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:28.154570 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf2544-4ef1-48c0-a3d2-728830188d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:28.154894 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf2544-4ef1-48c0-a3d2-728830188d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:28.156614 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7aaf2544-4ef1-48c0-a3d2-728830188d06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:28.283067 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf2544-4ef1-48c0-a3d2-728830188d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:28.284553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf2544-4ef1-48c0-a3d2-728830188d06 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:28.303383 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 712/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:30.427203 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88af5e-2744-4d96-a61d-e2cc1de8a6b8 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:30.427745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88af5e-2744-4d96-a61d-e2cc1de8a6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:30.427745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88af5e-2744-4d96-a61d-e2cc1de8a6b8 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:30.429337 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 747/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 10:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:30.435470 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affebdb-c094-4c69-a4ca-d27166974984 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:30.436132 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affebdb-c094-4c69-a4ca-d27166974984 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:30.436132 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affebdb-c094-4c69-a4ca-d27166974984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:30.511615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6affebdb-c094-4c69-a4ca-d27166974984 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:30.512896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6affebdb-c094-4c69-a4ca-d27166974984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:30.522745 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:30.621440 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 713/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 10:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:30.660677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88af5e-2744-4d96-a61d-e2cc1de8a6b8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:30.662298 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3b88af5e-2744-4d96-a61d-e2cc1de8a6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:30.771111 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88af5e-2744-4d96-a61d-e2cc1de8a6b8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:30.831778 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:30.854689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f9720-5931-4ebc-91e4-871ee56f438a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:30.855348 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f9720-5931-4ebc-91e4-871ee56f438a service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:30.855627 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f9720-5931-4ebc-91e4-871ee56f438a service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:30.855899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f9720-5931-4ebc-91e4-871ee56f438a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:30.857653 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f15f9720-5931-4ebc-91e4-871ee56f438a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:30.976418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f9720-5931-4ebc-91e4-871ee56f438a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:30.977917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f9720-5931-4ebc-91e4-871ee56f438a service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:30.997151 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 748/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:33.090569 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f807c-98c9-40b1-9232-70ee3889326a None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:33.091118 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f807c-98c9-40b1-9232-70ee3889326a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:33.091118 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f807c-98c9-40b1-9232-70ee3889326a None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:33.092460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 714/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 10:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:33.097918 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b5f1a-8579-4a7f-92b8-4af475bdcdeb None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:33.098465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b5f1a-8579-4a7f-92b8-4af475bdcdeb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:33.098465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b5f1a-8579-4a7f-92b8-4af475bdcdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:33.163669 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3c2b5f1a-8579-4a7f-92b8-4af475bdcdeb None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:33.164926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3c2b5f1a-8579-4a7f-92b8-4af475bdcdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:33.205227 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:33.266439 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 749/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 10:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:33.306212 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f807c-98c9-40b1-9232-70ee3889326a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:33.307802 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-407f807c-98c9-40b1-9232-70ee3889326a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:33.427240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f807c-98c9-40b1-9232-70ee3889326a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:33.476900 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:33.513913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3790b8-4ad1-411f-b045-b81653ec95e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:33.514580 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3790b8-4ad1-411f-b045-b81653ec95e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:33.514879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3790b8-4ad1-411f-b045-b81653ec95e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:33.515133 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3790b8-4ad1-411f-b045-b81653ec95e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:33.516808 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2e3790b8-4ad1-411f-b045-b81653ec95e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:33.639047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3790b8-4ad1-411f-b045-b81653ec95e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:33.640534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3790b8-4ad1-411f-b045-b81653ec95e6 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:33.661046 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 715/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:35.721083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf037bb5-61fc-418c-8c21-62ef6cdc98ed None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:35.721607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf037bb5-61fc-418c-8c21-62ef6cdc98ed None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:35.721607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf037bb5-61fc-418c-8c21-62ef6cdc98ed None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:35.722967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 750/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 10:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:35.728662 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50bd9b-06a3-4371-a19c-054ed45577a3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:35.729112 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50bd9b-06a3-4371-a19c-054ed45577a3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:35.729252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50bd9b-06a3-4371-a19c-054ed45577a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:35.798517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1a50bd9b-06a3-4371-a19c-054ed45577a3 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:35.799747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1a50bd9b-06a3-4371-a19c-054ed45577a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:35.818937 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:35.901381 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 716/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 10:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:35.938841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf037bb5-61fc-418c-8c21-62ef6cdc98ed None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:35.940363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cf037bb5-61fc-418c-8c21-62ef6cdc98ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:36.046302 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf037bb5-61fc-418c-8c21-62ef6cdc98ed None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:36.115538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:36.123948 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3523647-37d0-4fa6-a82c-f3d1961bb926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:36.124609 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3523647-37d0-4fa6-a82c-f3d1961bb926 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:36.124929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3523647-37d0-4fa6-a82c-f3d1961bb926 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:36.125197 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3523647-37d0-4fa6-a82c-f3d1961bb926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:36.127161 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f3523647-37d0-4fa6-a82c-f3d1961bb926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:36.252058 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3523647-37d0-4fa6-a82c-f3d1961bb926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:36.253535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3523647-37d0-4fa6-a82c-f3d1961bb926 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:36.272313 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 751/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:38.321239 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d7757-5d5e-4ddd-80b0-350e9a679cae None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:38.321796 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d7757-5d5e-4ddd-80b0-350e9a679cae None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:38.322180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d7757-5d5e-4ddd-80b0-350e9a679cae None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:38.324335 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 717/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 10:59:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:38.332283 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38d866-6c7e-4490-b0f9-e2630729e775 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:38.332844 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38d866-6c7e-4490-b0f9-e2630729e775 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:38.332844 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38d866-6c7e-4490-b0f9-e2630729e775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:38.405784 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1a38d866-6c7e-4490-b0f9-e2630729e775 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:38.407028 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1a38d866-6c7e-4490-b0f9-e2630729e775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:38.463997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:38.516159 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 752/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 10:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 10:59:38.554741 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d7757-5d5e-4ddd-80b0-350e9a679cae None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:38.556791 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d02d7757-5d5e-4ddd-80b0-350e9a679cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:38.682552 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d7757-5d5e-4ddd-80b0-350e9a679cae None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:38.737149 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:38.766241 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d617a-f9b4-4ee4-bbbe-32b7ae445592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:38.767157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d617a-f9b4-4ee4-bbbe-32b7ae445592 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:38.767434 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d617a-f9b4-4ee4-bbbe-32b7ae445592 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:38.767774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d617a-f9b4-4ee4-bbbe-32b7ae445592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:38.770139 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d73d617a-f9b4-4ee4-bbbe-32b7ae445592 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:38.900958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d617a-f9b4-4ee4-bbbe-32b7ae445592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:38.902405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d617a-f9b4-4ee4-bbbe-32b7ae445592 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:38.922168 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 718/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:48.514418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=22 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:48.919521 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=66 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:58.661845 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5d3ae-4493-4a36-a711-01261521fbb1 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:58.662461 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5d3ae-4493-4a36-a711-01261521fbb1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:58.662461 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5d3ae-4493-4a36-a711-01261521fbb1 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:58.663771 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 753/1471] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 10:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:58.669585 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecfdf0-4c12-4018-9574-7a97db0c45f8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:58.670120 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecfdf0-4c12-4018-9574-7a97db0c45f8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:58.670229 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecfdf0-4c12-4018-9574-7a97db0c45f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:58.764469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-86ecfdf0-4c12-4018-9574-7a97db0c45f8 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:58.766588 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-86ecfdf0-4c12-4018-9574-7a97db0c45f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:58.914551 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 719/1472] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 10:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:59.002280 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3369fb3-35e2-485e-97d7-19fd3f77ab23 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:59.002564 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3369fb3-35e2-485e-97d7-19fd3f77ab23 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:59.002838 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3369fb3-35e2-485e-97d7-19fd3f77ab23 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:59.004246 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 754/1473] 10.222.0.18 () {54 vars in 961 bytes} [Tue Jul 19 10:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:59.009480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c73d7-353d-4003-80f7-5b080cebdcb5 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:59.009764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c73d7-353d-4003-80f7-5b080cebdcb5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:59.010043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c73d7-353d-4003-80f7-5b080cebdcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:59.093425 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-383c73d7-353d-4003-80f7-5b080cebdcb5 None None] MFA Rules not processed for user `d1bcfbee5a5e4016a77901d0a637da63`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:59.094643 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-383c73d7-353d-4003-80f7-5b080cebdcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:59.117300 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:59.178866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 720/1474] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Jul 19 10:59:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:59.186431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3369fb3-35e2-485e-97d7-19fd3f77ab23 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:59.188345 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b3369fb3-35e2-485e-97d7-19fd3f77ab23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:59.312176 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3369fb3-35e2-485e-97d7-19fd3f77ab23 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:59.392785 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbd335-a16e-48aa-98b5-56f6c397f6e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bcfbee5a5e4016a77901d0a637da63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:59.393448 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbd335-a16e-48aa-98b5-56f6c397f6e8 service glance] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:59.393720 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbd335-a16e-48aa-98b5-56f6c397f6e8 service glance] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:59.393980 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbd335-a16e-48aa-98b5-56f6c397f6e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:59.395609 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-28cbd335-a16e-48aa-98b5-56f6c397f6e8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:59.456365 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:59.521853 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbd335-a16e-48aa-98b5-56f6c397f6e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:59.523328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbd335-a16e-48aa-98b5-56f6c397f6e8 service glance] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:59.546636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 755/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:00:01.662170 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61dfed-40ad-4708-9269-916628ea45fa None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:01.662733 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61dfed-40ad-4708-9269-916628ea45fa None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:01.662733 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61dfed-40ad-4708-9269-916628ea45fa None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:01.664107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 721/1476] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 11:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:00:01.670376 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9959671-9e62-471e-b69c-4d87e9b240a5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:01.671157 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9959671-9e62-471e-b69c-4d87e9b240a5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:01.671157 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9959671-9e62-471e-b69c-4d87e9b240a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:01.741692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d9959671-9e62-471e-b69c-4d87e9b240a5 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:00:01.742960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d9959671-9e62-471e-b69c-4d87e9b240a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:01.842564 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 756/1477] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 11:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:00:01.865880 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61dfed-40ad-4708-9269-916628ea45fa None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:00:01.867395 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1b61dfed-40ad-4708-9269-916628ea45fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:02.015978 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61dfed-40ad-4708-9269-916628ea45fa None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:00:02.072353 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:02.243569 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e65a7b-948e-409d-bd8c-0ab06ff378a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:00:02.244241 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e65a7b-948e-409d-bd8c-0ab06ff378a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:02.244494 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e65a7b-948e-409d-bd8c-0ab06ff378a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:02.244830 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e65a7b-948e-409d-bd8c-0ab06ff378a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:02.245611 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e65a7b-948e-409d-bd8c-0ab06ff378a4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:00:02.247439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: WARNING py.warnings [None req-97e65a7b-948e-409d-bd8c-0ab06ff378a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:00:02.247439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: warnings.warn(msg) Jul 19 11:00:02.247439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: Jul 19 11:00:02.248924 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e65a7b-948e-409d-bd8c-0ab06ff378a4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:00:02.270374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 722/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 19 11:00:01 2022] GET /identity/v3/projects => generated 2553 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:00:04.322185 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13465a10-3b11-46e7-9cd7-b23084de0332 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:04.322803 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13465a10-3b11-46e7-9cd7-b23084de0332 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:04.322803 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13465a10-3b11-46e7-9cd7-b23084de0332 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:04.324123 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 757/1479] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 11:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:00:04.329828 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08513e-2847-4050-a4a4-42bbc8f306bb None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:04.330566 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08513e-2847-4050-a4a4-42bbc8f306bb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:04.330794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08513e-2847-4050-a4a4-42bbc8f306bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:04.399920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-cb08513e-2847-4050-a4a4-42bbc8f306bb None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:00:04.401198 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cb08513e-2847-4050-a4a4-42bbc8f306bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:04.508555 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 723/1480] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 11:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:00:04.553488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13465a10-3b11-46e7-9cd7-b23084de0332 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:00:04.554994 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-13465a10-3b11-46e7-9cd7-b23084de0332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:04.565560 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:04.717936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13465a10-3b11-46e7-9cd7-b23084de0332 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:00:04.802415 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:04.838094 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf6f80-b457-41af-8b26-0a11c9c8365e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:00:04.838754 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf6f80-b457-41af-8b26-0a11c9c8365e service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:04.839034 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf6f80-b457-41af-8b26-0a11c9c8365e service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:04.839550 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf6f80-b457-41af-8b26-0a11c9c8365e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:04.841949 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1faf6f80-b457-41af-8b26-0a11c9c8365e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:04.936387 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf6f80-b457-41af-8b26-0a11c9c8365e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:00:04.938027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf6f80-b457-41af-8b26-0a11c9c8365e service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:00:04.957441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 758/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:00:07.204688 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac37526-858b-4bc9-a2b6-7e72445aa4b3 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:07.205309 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac37526-858b-4bc9-a2b6-7e72445aa4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:07.205309 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac37526-858b-4bc9-a2b6-7e72445aa4b3 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:07.206634 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 724/1482] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 11:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:00:07.212379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ade859-e0c2-4cd1-9c2f-7705a3a5c722 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:07.212876 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ade859-e0c2-4cd1-9c2f-7705a3a5c722 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:07.213008 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ade859-e0c2-4cd1-9c2f-7705a3a5c722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:07.290543 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-50ade859-e0c2-4cd1-9c2f-7705a3a5c722 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:00:07.291775 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-50ade859-e0c2-4cd1-9c2f-7705a3a5c722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:07.342324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:07.395552 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 759/1483] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 11:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:00:07.433369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac37526-858b-4bc9-a2b6-7e72445aa4b3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:00:07.434905 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6ac37526-858b-4bc9-a2b6-7e72445aa4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:07.460659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:07.547093 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac37526-858b-4bc9-a2b6-7e72445aa4b3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:00:07.624237 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7adf43a-ef4a-4025-a9ac-589db8fec05d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:00:07.624926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7adf43a-ef4a-4025-a9ac-589db8fec05d service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:07.625206 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7adf43a-ef4a-4025-a9ac-589db8fec05d service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:07.625480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7adf43a-ef4a-4025-a9ac-589db8fec05d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:07.627134 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a7adf43a-ef4a-4025-a9ac-589db8fec05d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:07.710540 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:07.748387 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7adf43a-ef4a-4025-a9ac-589db8fec05d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:00:07.749792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7adf43a-ef4a-4025-a9ac-589db8fec05d service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:00:07.771084 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 725/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:00:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:00:09.893553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bd485-b94a-4efb-a36b-7248360b6e62 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:09.894102 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bd485-b94a-4efb-a36b-7248360b6e62 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:09.894102 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bd485-b94a-4efb-a36b-7248360b6e62 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:09.895411 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 760/1485] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 11:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:00:09.900977 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dd48c-ac61-4724-bce0-cd0e85617d1f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:09.901457 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dd48c-ac61-4724-bce0-cd0e85617d1f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:09.901551 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dd48c-ac61-4724-bce0-cd0e85617d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:09.968995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a50dd48c-ac61-4724-bce0-cd0e85617d1f None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:00:09.970286 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a50dd48c-ac61-4724-bce0-cd0e85617d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:10.075326 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 726/1486] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 11:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:00:10.114022 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bd485-b94a-4efb-a36b-7248360b6e62 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:00:10.115682 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7c2bd485-b94a-4efb-a36b-7248360b6e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:10.234489 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bd485-b94a-4efb-a36b-7248360b6e62 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:00:10.314700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:10.316520 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227dbc17-0128-47cf-be3e-f4e72120aa7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:00:10.317215 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dbc17-0128-47cf-be3e-f4e72120aa7f service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:10.317498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dbc17-0128-47cf-be3e-f4e72120aa7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:10.317772 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dbc17-0128-47cf-be3e-f4e72120aa7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:10.320068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-227dbc17-0128-47cf-be3e-f4e72120aa7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:10.454331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227dbc17-0128-47cf-be3e-f4e72120aa7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:00:10.455793 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227dbc17-0128-47cf-be3e-f4e72120aa7f service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:00:10.476041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 761/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:00:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:00:12.701453 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fe003-7b82-4da0-833e-11be33226890 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:12.702006 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fe003-7b82-4da0-833e-11be33226890 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:12.702006 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fe003-7b82-4da0-833e-11be33226890 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:12.703271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 727/1488] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 11:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:00:12.709153 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b6704-8729-4487-bfba-a34b8692755a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:12.709616 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b6704-8729-4487-bfba-a34b8692755a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:12.709724 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b6704-8729-4487-bfba-a34b8692755a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:12.780107 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9f9b6704-8729-4487-bfba-a34b8692755a None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:00:12.781352 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9f9b6704-8729-4487-bfba-a34b8692755a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:12.840836 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:12.886829 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 762/1489] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 11:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:00:12.928176 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fe003-7b82-4da0-833e-11be33226890 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:00:12.929783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-012fe003-7b82-4da0-833e-11be33226890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:12.970525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:13.054813 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fe003-7b82-4da0-833e-11be33226890 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:00:13.134354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae71b8-ac1b-4de2-94e5-dea7755d4434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:00:13.134997 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae71b8-ac1b-4de2-94e5-dea7755d4434 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:13.135274 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae71b8-ac1b-4de2-94e5-dea7755d4434 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:13.135561 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae71b8-ac1b-4de2-94e5-dea7755d4434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:13.137219 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-59ae71b8-ac1b-4de2-94e5-dea7755d4434 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:13.229603 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:13.260974 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae71b8-ac1b-4de2-94e5-dea7755d4434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:00:13.262444 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae71b8-ac1b-4de2-94e5-dea7755d4434 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:00:13.282331 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 728/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:00:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:00:15.523838 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ab8d5-17e6-46cb-8217-5a3b6b606980 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:15.524653 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ab8d5-17e6-46cb-8217-5a3b6b606980 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:15.524653 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ab8d5-17e6-46cb-8217-5a3b6b606980 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:15.525808 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 763/1491] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 19 11:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:00:15.531462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afe887-90c1-4ad9-8e46-6d3c2343592f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:15.532007 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afe887-90c1-4ad9-8e46-6d3c2343592f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:15.532007 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afe887-90c1-4ad9-8e46-6d3c2343592f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:15.598817 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e8afe887-90c1-4ad9-8e46-6d3c2343592f None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:00:15.600054 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e8afe887-90c1-4ad9-8e46-6d3c2343592f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:15.703401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 729/1492] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 19 11:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:00:15.743856 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ab8d5-17e6-46cb-8217-5a3b6b606980 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:00:15.745980 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4f1ab8d5-17e6-46cb-8217-5a3b6b606980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:15.859647 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ab8d5-17e6-46cb-8217-5a3b6b606980 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:00:15.954964 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3873aa2-120c-4c78-ab97-dd39cbfbd94b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:00:15.955531 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3873aa2-120c-4c78-ab97-dd39cbfbd94b service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:15.955816 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3873aa2-120c-4c78-ab97-dd39cbfbd94b service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:15.956087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3873aa2-120c-4c78-ab97-dd39cbfbd94b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:15.957785 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d3873aa2-120c-4c78-ab97-dd39cbfbd94b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:15.968436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:16.074861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3873aa2-120c-4c78-ab97-dd39cbfbd94b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:00:16.076312 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3873aa2-120c-4c78-ab97-dd39cbfbd94b service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:00:16.096136 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 764/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:00:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:00:25.701648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=82 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:26.093726 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=50 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:01:42.446578 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c8f07-7c6b-489d-82cc-9c7bc7f36b15 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:01:42.447118 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c8f07-7c6b-489d-82cc-9c7bc7f36b15 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:01:42.447118 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c8f07-7c6b-489d-82cc-9c7bc7f36b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:01:42.535130 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a28c8f07-7c6b-489d-82cc-9c7bc7f36b15 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:01:42.536377 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a28c8f07-7c6b-489d-82cc-9c7bc7f36b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:01:42.637144 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 730/1494] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:01:42.645866 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512a480-20bc-4d94-8d85-2ae05a4ed722 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:01:42.646393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512a480-20bc-4d94-8d85-2ae05a4ed722 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:01:42.646393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512a480-20bc-4d94-8d85-2ae05a4ed722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:01:42.722936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d512a480-20bc-4d94-8d85-2ae05a4ed722 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:01:42.724188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d512a480-20bc-4d94-8d85-2ae05a4ed722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:01:42.830478 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 765/1495] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:01:42.835301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c8f07-7c6b-489d-82cc-9c7bc7f36b15 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:01:42.836535 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a28c8f07-7c6b-489d-82cc-9c7bc7f36b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:01:42.848951 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c8f07-7c6b-489d-82cc-9c7bc7f36b15 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:01:42.914368 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:01:42.953040 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d8c5e-d121-41e0-9b83-02c4d13d3973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:01:42.953746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d8c5e-d121-41e0-9b83-02c4d13d3973 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:01:42.954026 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d8c5e-d121-41e0-9b83-02c4d13d3973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:01:42.954294 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d8c5e-d121-41e0-9b83-02c4d13d3973 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:01:42.955368 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d8c5e-d121-41e0-9b83-02c4d13d3973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:01:42.955729 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d8c5e-d121-41e0-9b83-02c4d13d3973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:01:42.956781 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: WARNING py.warnings [None req-d53d8c5e-d121-41e0-9b83-02c4d13d3973 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:01:42.956781 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: warnings.warn(msg) Jul 19 11:01:42.956781 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: Jul 19 11:01:42.957702 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d8c5e-d121-41e0-9b83-02c4d13d3973 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:01:42.971016 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 731/1496] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:01:42.979862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512a480-20bc-4d94-8d85-2ae05a4ed722 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:01:42.990335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512a480-20bc-4d94-8d85-2ae05a4ed722 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:01:43.060767 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:01:43.098221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a29f8-7394-436c-b5a1-964f3693dd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:01:43.098941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a29f8-7394-436c-b5a1-964f3693dd36 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:01:43.099215 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a29f8-7394-436c-b5a1-964f3693dd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:01:43.099484 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a29f8-7394-436c-b5a1-964f3693dd36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:01:43.100175 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a29f8-7394-436c-b5a1-964f3693dd36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:01:43.102080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: WARNING py.warnings [None req-0f5a29f8-7394-436c-b5a1-964f3693dd36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:01:43.102080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: warnings.warn(msg) Jul 19 11:01:43.102080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: Jul 19 11:01:43.103279 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a29f8-7394-436c-b5a1-964f3693dd36 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:01:43.162772 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 766/1497] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:01:42 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:01:43.167405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d8c5e-d121-41e0-9b83-02c4d13d3973 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:01:43.168889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d53d8c5e-d121-41e0-9b83-02c4d13d3973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:01:43.205387 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d8c5e-d121-41e0-9b83-02c4d13d3973 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:01:43.310667 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64434554-299d-477e-8740-4c69d4d40d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:01:43.311340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64434554-299d-477e-8740-4c69d4d40d18 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:01:43.311624 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64434554-299d-477e-8740-4c69d4d40d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:01:43.311893 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64434554-299d-477e-8740-4c69d4d40d18 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:01:43.312594 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64434554-299d-477e-8740-4c69d4d40d18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:01:43.313658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: WARNING py.warnings [None req-64434554-299d-477e-8740-4c69d4d40d18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:01:43.313658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: warnings.warn(msg) Jul 19 11:01:43.313658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: Jul 19 11:01:43.314863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64434554-299d-477e-8740-4c69d4d40d18 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:01:43.358951 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 732/1498] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:01:43 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:01:43.363242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a29f8-7394-436c-b5a1-964f3693dd36 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:01:43.364972 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0f5a29f8-7394-436c-b5a1-964f3693dd36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:01:43.435517 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a29f8-7394-436c-b5a1-964f3693dd36 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:01:43.527205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:01:43.540075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78526212-62c0-4f4a-9806-a5be6bcdba1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:01:43.540779 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78526212-62c0-4f4a-9806-a5be6bcdba1a admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:01:43.541077 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78526212-62c0-4f4a-9806-a5be6bcdba1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:01:43.541342 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78526212-62c0-4f4a-9806-a5be6bcdba1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:01:43.542118 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78526212-62c0-4f4a-9806-a5be6bcdba1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:01:43.543142 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: WARNING py.warnings [None req-78526212-62c0-4f4a-9806-a5be6bcdba1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:01:43.543142 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: warnings.warn(msg) Jul 19 11:01:43.543142 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: Jul 19 11:01:43.544030 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78526212-62c0-4f4a-9806-a5be6bcdba1a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:01:43.557255 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 767/1499] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:01:43.561638 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64434554-299d-477e-8740-4c69d4d40d18 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:01:43.563160 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-64434554-299d-477e-8740-4c69d4d40d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:01:43.575234 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64434554-299d-477e-8740-4c69d4d40d18 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:01:43.601901 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:01:43.676390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fef0a-4024-449d-bb71-aa10159041de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:01:43.677171 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fef0a-4024-449d-bb71-aa10159041de admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:01:43.677446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fef0a-4024-449d-bb71-aa10159041de admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:01:43.677712 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fef0a-4024-449d-bb71-aa10159041de admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:01:43.678434 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fef0a-4024-449d-bb71-aa10159041de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:01:43.679461 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: WARNING py.warnings [None req-354fef0a-4024-449d-bb71-aa10159041de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:01:43.679461 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: warnings.warn(msg) Jul 19 11:01:43.679461 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: Jul 19 11:01:43.680340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fef0a-4024-449d-bb71-aa10159041de admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:01:43.693268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 733/1500] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:01:43.697836 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78526212-62c0-4f4a-9806-a5be6bcdba1a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:01:43.699375 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-78526212-62c0-4f4a-9806-a5be6bcdba1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:01:43.734485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78526212-62c0-4f4a-9806-a5be6bcdba1a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:01:43.833361 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2535f8d-7739-4c8a-aa3d-9a3b5cf6b1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:01:43.834261 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2535f8d-7739-4c8a-aa3d-9a3b5cf6b1d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:01:43.834538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2535f8d-7739-4c8a-aa3d-9a3b5cf6b1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:01:43.834809 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2535f8d-7739-4c8a-aa3d-9a3b5cf6b1d4 admin admin] PATH_INFO: `/v3/projects/4c969faad2004045a424c331dbfe5a6a/users/d320abe074154cfd9408dfab4e73b402/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:01:43.860994 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2535f8d-7739-4c8a-aa3d-9a3b5cf6b1d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c969faad2004045a424c331dbfe5a6a, user_id=d320abe074154cfd9408dfab4e73b402, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:01:43.862048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: WARNING py.warnings [None req-e2535f8d-7739-4c8a-aa3d-9a3b5cf6b1d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:01:43.862048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: warnings.warn(msg) Jul 19 11:01:43.862048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: Jul 19 11:01:43.864066 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2535f8d-7739-4c8a-aa3d-9a3b5cf6b1d4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:01:43.894581 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 768/1501] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:01:43 2022] PUT /identity/v3/projects/4c969faad2004045a424c331dbfe5a6a/users/d320abe074154cfd9408dfab4e73b402/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:01:43.907573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185493ae-f286-4474-b89f-7af25f0b5e47 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:01:43.907857 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185493ae-f286-4474-b89f-7af25f0b5e47 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:01:43.908133 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185493ae-f286-4474-b89f-7af25f0b5e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:01:43.966912 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-185493ae-f286-4474-b89f-7af25f0b5e47 None None] MFA Rules not processed for user `d320abe074154cfd9408dfab4e73b402`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:01:43.968039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-185493ae-f286-4474-b89f-7af25f0b5e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:01:44.059525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 734/1502] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:01:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:01:44.073194 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdc816-8cc3-4d08-84b2-5d54c114c290 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:01:44.073478 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdc816-8cc3-4d08-84b2-5d54c114c290 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:01:44.073754 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdc816-8cc3-4d08-84b2-5d54c114c290 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:01:44.075137 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 769/1503] 10.222.0.18 () {54 vars in 964 bytes} [Tue Jul 19 11:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:01:44.080862 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee385e-742c-403a-aae4-2443441282d2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:01:44.081185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee385e-742c-403a-aae4-2443441282d2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:01:44.081461 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee385e-742c-403a-aae4-2443441282d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:01:44.112173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:01:44.160785 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-90ee385e-742c-403a-aae4-2443441282d2 None None] MFA Rules not processed for user `8112def59003484483552fc76f14e281`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:01:44.162189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-90ee385e-742c-403a-aae4-2443441282d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:01:44.249415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 735/1504] 10.222.0.18 () {58 vars in 1061 bytes} [Tue Jul 19 11:01:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:01:44.257324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdc816-8cc3-4d08-84b2-5d54c114c290 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:01:44.258876 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-15bdc816-8cc3-4d08-84b2-5d54c114c290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:01:44.317089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:01:44.376190 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdc816-8cc3-4d08-84b2-5d54c114c290 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:01:44.454217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2523daa-4f47-4141-a2e3-112afa6f7956 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8112def59003484483552fc76f14e281', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:01:44.454898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2523daa-4f47-4141-a2e3-112afa6f7956 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:01:44.455558 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2523daa-4f47-4141-a2e3-112afa6f7956 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:01:44.455826 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2523daa-4f47-4141-a2e3-112afa6f7956 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:01:44.457559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a2523daa-4f47-4141-a2e3-112afa6f7956 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:01:44.562802 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2523daa-4f47-4141-a2e3-112afa6f7956 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:01:44.564142 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2523daa-4f47-4141-a2e3-112afa6f7956 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:01:44.567992 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:01:44.590139 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 770/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:01:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:01:44.634206 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ba631-468b-4b15-931d-90366751b01e None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:01:44.634666 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ba631-468b-4b15-931d-90366751b01e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:01:44.634762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ba631-468b-4b15-931d-90366751b01e None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:01:44.636071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 736/1506] 10.222.0.18 () {52 vars in 829 bytes} [Tue Jul 19 11:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:01:44.639995 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2523daa-4f47-4141-a2e3-112afa6f7956 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:01:44.641256 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a2523daa-4f47-4141-a2e3-112afa6f7956 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:01:44.750772 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2523daa-4f47-4141-a2e3-112afa6f7956 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:01:44.852429 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb812f1d-abb9-4c58-ba8b-1a20d3d6788d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:01:44.853234 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb812f1d-abb9-4c58-ba8b-1a20d3d6788d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:01:44.853506 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb812f1d-abb9-4c58-ba8b-1a20d3d6788d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:01:44.853755 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb812f1d-abb9-4c58-ba8b-1a20d3d6788d admin admin] PATH_INFO: `/v3/users/d320abe074154cfd9408dfab4e73b402` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:01:44.866432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb812f1d-abb9-4c58-ba8b-1a20d3d6788d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d320abe074154cfd9408dfab4e73b402)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:01:44.867472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: WARNING py.warnings [None req-fb812f1d-abb9-4c58-ba8b-1a20d3d6788d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:01:44.867472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: warnings.warn(msg) Jul 19 11:01:44.867472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: Jul 19 11:01:44.868691 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb812f1d-abb9-4c58-ba8b-1a20d3d6788d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:01:44.878650 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:01:44.935667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fb812f1d-abb9-4c58-ba8b-1a20d3d6788d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd320abe074154cfd9408dfab4e73b402'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:01:44.947137 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fb812f1d-abb9-4c58-ba8b-1a20d3d6788d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd320abe074154cfd9408dfab4e73b402'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:01:44.962353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fb812f1d-abb9-4c58-ba8b-1a20d3d6788d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd320abe074154cfd9408dfab4e73b402'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:01:44.962917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fb812f1d-abb9-4c58-ba8b-1a20d3d6788d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd320abe074154cfd9408dfab4e73b402'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:01:44.963331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fb812f1d-abb9-4c58-ba8b-1a20d3d6788d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd320abe074154cfd9408dfab4e73b402'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:01:45.113805 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 771/1507] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:01:44 2022] DELETE /identity/v3/users/d320abe074154cfd9408dfab4e73b402 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:01:45.118394 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ade23-5863-4ada-8826-688700c39b65 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:01:45.118686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ade23-5863-4ada-8826-688700c39b65 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:01:45.118964 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ade23-5863-4ada-8826-688700c39b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:01:45.179047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ee1ade23-5863-4ada-8826-688700c39b65 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:01:45.180291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ee1ade23-5863-4ada-8826-688700c39b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:01:45.263218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:01:45.278203 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 737/1508] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:01:45.288227 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb812f1d-abb9-4c58-ba8b-1a20d3d6788d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:01:45.289559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fb812f1d-abb9-4c58-ba8b-1a20d3d6788d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:01:45.398123 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb812f1d-abb9-4c58-ba8b-1a20d3d6788d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:01:45.457241 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:01:45.479188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb40de-cc32-44b7-be8e-44362a0f8e60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:01:45.479861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb40de-cc32-44b7-be8e-44362a0f8e60 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:01:45.480139 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb40de-cc32-44b7-be8e-44362a0f8e60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:01:45.480407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb40de-cc32-44b7-be8e-44362a0f8e60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:01:45.482134 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-95bb40de-cc32-44b7-be8e-44362a0f8e60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:01:45.596058 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb40de-cc32-44b7-be8e-44362a0f8e60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:01:45.597581 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb40de-cc32-44b7-be8e-44362a0f8e60 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:01:45.619515 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 772/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:01:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:01:45.951899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ade23-5863-4ada-8826-688700c39b65 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:01:45.953197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ee1ade23-5863-4ada-8826-688700c39b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:01:45.965833 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ade23-5863-4ada-8826-688700c39b65 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:01:46.067777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00173a-4943-48e1-99be-6c79e903db8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:01:46.068669 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00173a-4943-48e1-99be-6c79e903db8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:01:46.068969 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00173a-4943-48e1-99be-6c79e903db8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:01:46.069238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00173a-4943-48e1-99be-6c79e903db8b admin admin] PATH_INFO: `/v3/projects/4c969faad2004045a424c331dbfe5a6a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:01:46.079675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00173a-4943-48e1-99be-6c79e903db8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c969faad2004045a424c331dbfe5a6a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:01:46.081126 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: WARNING py.warnings [None req-6d00173a-4943-48e1-99be-6c79e903db8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:01:46.081126 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: warnings.warn(msg) Jul 19 11:01:46.081126 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: Jul 19 11:01:46.082317 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00173a-4943-48e1-99be-6c79e903db8b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:01:46.144782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6d00173a-4943-48e1-99be-6c79e903db8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c969faad2004045a424c331dbfe5a6a', 'request_id': 'req-6d00173a-4943-48e1-99be-6c79e903db8b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:01:46.154558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6d00173a-4943-48e1-99be-6c79e903db8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c969faad2004045a424c331dbfe5a6a', 'request_id': 'req-6d00173a-4943-48e1-99be-6c79e903db8b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:01:46.161864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6d00173a-4943-48e1-99be-6c79e903db8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c969faad2004045a424c331dbfe5a6a', 'request_id': 'req-6d00173a-4943-48e1-99be-6c79e903db8b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:01:46.194823 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6d00173a-4943-48e1-99be-6c79e903db8b admin admin] The token cache is being invalidate because project 4c969faad2004045a424c331dbfe5a6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:01:46.195098 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6d00173a-4943-48e1-99be-6c79e903db8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:01:46.195554 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6d00173a-4943-48e1-99be-6c79e903db8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:01:46.197059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 738/1510] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:01:45 2022] DELETE /identity/v3/projects/4c969faad2004045a424c331dbfe5a6a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:01:55.616680 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=62 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:01:56.192483 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:02:59.800663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430ad22-b3e9-41b1-ab79-62985a4ec4d5 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:02:59.801359 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430ad22-b3e9-41b1-ab79-62985a4ec4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:02:59.801359 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430ad22-b3e9-41b1-ab79-62985a4ec4d5 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:02:59.802659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 773/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 11:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:02:59.807948 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb23dc-dbc9-45ad-b4e4-430ce4cada7c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:02:59.808410 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb23dc-dbc9-45ad-b4e4-430ce4cada7c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:02:59.808530 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb23dc-dbc9-45ad-b4e4-430ce4cada7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:02:59.894480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-41bb23dc-dbc9-45ad-b4e4-430ce4cada7c None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:02:59.895723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-41bb23dc-dbc9-45ad-b4e4-430ce4cada7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:03:00.012580 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 739/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 11:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:03:00.171967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430ad22-b3e9-41b1-ab79-62985a4ec4d5 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:03:00.176305 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3430ad22-b3e9-41b1-ab79-62985a4ec4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:03:00.307471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430ad22-b3e9-41b1-ab79-62985a4ec4d5 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:03:00.313219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497cbbe-ad93-4646-bcd5-00521c82039b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:03:00.313887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497cbbe-ad93-4646-bcd5-00521c82039b service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:03:00.314162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497cbbe-ad93-4646-bcd5-00521c82039b service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:03:00.314433 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497cbbe-ad93-4646-bcd5-00521c82039b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:03:00.323126 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497cbbe-ad93-4646-bcd5-00521c82039b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:03:00.324742 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497cbbe-ad93-4646-bcd5-00521c82039b service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:03:00.335054 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 774/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:03:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:03:01.169403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a99114-1800-4fa4-9556-8ef50e6aa605 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:03:01.169985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a99114-1800-4fa4-9556-8ef50e6aa605 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:03:01.169985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a99114-1800-4fa4-9556-8ef50e6aa605 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:03:01.171259 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 740/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 11:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:03:01.177490 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8883066-c5e4-4b45-bff9-1e2d65c499b3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:03:01.177946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8883066-c5e4-4b45-bff9-1e2d65c499b3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:03:01.178049 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8883066-c5e4-4b45-bff9-1e2d65c499b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:03:01.204167 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c8883066-c5e4-4b45-bff9-1e2d65c499b3 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:03:01.205395 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c8883066-c5e4-4b45-bff9-1e2d65c499b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:03:01.213658 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 775/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 11:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:03:01.365627 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a99114-1800-4fa4-9556-8ef50e6aa605 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:03:01.387757 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a99114-1800-4fa4-9556-8ef50e6aa605 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:03:01.397861 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fe755-5a5f-4cb1-8564-53ce4bf2b5cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:03:01.398533 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fe755-5a5f-4cb1-8564-53ce4bf2b5cf service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:03:01.398814 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fe755-5a5f-4cb1-8564-53ce4bf2b5cf service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:03:01.399087 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fe755-5a5f-4cb1-8564-53ce4bf2b5cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:03:01.414491 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fe755-5a5f-4cb1-8564-53ce4bf2b5cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:03:01.416902 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fe755-5a5f-4cb1-8564-53ce4bf2b5cf service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:03:01.427982 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 741/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:03:05.841524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9efc8b-362a-4567-9046-d90d1846ae78 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:03:05.842133 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9efc8b-362a-4567-9046-d90d1846ae78 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:03:05.842133 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9efc8b-362a-4567-9046-d90d1846ae78 None None] PATH_INFO: `/v3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:03:05.844130 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 776/1517] 10.222.0.17 () {54 vars in 925 bytes} [Tue Jul 19 11:03:05 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:03:05.851609 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79af05f-af26-4276-823f-200d00b2208b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:03:05.852054 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79af05f-af26-4276-823f-200d00b2208b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:03:05.852166 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79af05f-af26-4276-823f-200d00b2208b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:03:05.919287 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c79af05f-af26-4276-823f-200d00b2208b None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:03:05.920576 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c79af05f-af26-4276-823f-200d00b2208b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:03:05.939274 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:03:06.004955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 742/1518] 10.222.0.17 () {58 vars in 1015 bytes} [Tue Jul 19 11:03:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:03:11.198291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=56 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:03:12.689558 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641d026-4bf3-44f0-b056-00692bc98762 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:03:12.690290 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641d026-4bf3-44f0-b056-00692bc98762 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:03:12.690290 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641d026-4bf3-44f0-b056-00692bc98762 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:03:12.691596 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 777/1519] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 11:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:03:12.697662 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367144e-e7f5-4c46-aba1-1fc1512c75ce None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:03:12.698145 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367144e-e7f5-4c46-aba1-1fc1512c75ce None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:03:12.698145 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367144e-e7f5-4c46-aba1-1fc1512c75ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:03:12.717897 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1367144e-e7f5-4c46-aba1-1fc1512c75ce None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:03:12.719111 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1367144e-e7f5-4c46-aba1-1fc1512c75ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:03:12.727502 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 743/1520] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 11:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:03:12.884441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641d026-4bf3-44f0-b056-00692bc98762 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:03:12.901542 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641d026-4bf3-44f0-b056-00692bc98762 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:03:12.909160 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785d765-0811-4660-9b6f-51d8cc9f3910 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:03:12.910310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785d765-0811-4660-9b6f-51d8cc9f3910 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:03:12.910619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785d765-0811-4660-9b6f-51d8cc9f3910 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:03:12.910875 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785d765-0811-4660-9b6f-51d8cc9f3910 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:03:12.920037 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785d765-0811-4660-9b6f-51d8cc9f3910 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:03:12.921655 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785d765-0811-4660-9b6f-51d8cc9f3910 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:03:12.931528 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 778/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:03:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:03:13.742557 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d51ab-3189-4669-a2a1-8d3b57ea301f None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:03:13.743114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d51ab-3189-4669-a2a1-8d3b57ea301f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:03:13.743114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d51ab-3189-4669-a2a1-8d3b57ea301f None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:03:13.744402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 744/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 11:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:03:13.750222 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2418f68-595c-4e87-8ec1-1de6fc66072d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:03:13.750877 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2418f68-595c-4e87-8ec1-1de6fc66072d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:03:13.751022 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2418f68-595c-4e87-8ec1-1de6fc66072d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:03:13.772555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b2418f68-595c-4e87-8ec1-1de6fc66072d None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:03:13.773882 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b2418f68-595c-4e87-8ec1-1de6fc66072d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:03:13.782268 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 779/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 11:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:03:13.935236 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d51ab-3189-4669-a2a1-8d3b57ea301f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:03:13.958963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d51ab-3189-4669-a2a1-8d3b57ea301f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:03:13.964913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf34aa8-c561-4979-aff4-8f69aaaa325f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:03:13.965719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf34aa8-c561-4979-aff4-8f69aaaa325f service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:03:13.965875 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf34aa8-c561-4979-aff4-8f69aaaa325f service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:03:13.966142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf34aa8-c561-4979-aff4-8f69aaaa325f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:03:13.975421 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf34aa8-c561-4979-aff4-8f69aaaa325f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:03:13.977057 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf34aa8-c561-4979-aff4-8f69aaaa325f service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:03:13.987263 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 745/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:03:14.679889 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0370d-7bac-46f6-8f23-217cd909600f None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:03:14.680234 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0370d-7bac-46f6-8f23-217cd909600f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:03:14.680552 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0370d-7bac-46f6-8f23-217cd909600f None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:03:14.682851 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 780/1525] 10.222.0.18 () {54 vars in 961 bytes} [Tue Jul 19 11:03:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:03:14.689016 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a8acc-c259-4dba-a15c-53973481c04b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:03:14.689493 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a8acc-c259-4dba-a15c-53973481c04b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:03:14.689992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a8acc-c259-4dba-a15c-53973481c04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:03:14.714957 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1c9a8acc-c259-4dba-a15c-53973481c04b None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:03:14.716160 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1c9a8acc-c259-4dba-a15c-53973481c04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:03:14.726417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 746/1526] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Jul 19 11:03:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:03:14.734639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0370d-7bac-46f6-8f23-217cd909600f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:03:14.751343 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0370d-7bac-46f6-8f23-217cd909600f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:03:14.757879 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fd19b-10f7-4c59-ab93-a60679787c94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:03:14.758558 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fd19b-10f7-4c59-ab93-a60679787c94 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:03:14.758810 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fd19b-10f7-4c59-ab93-a60679787c94 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:03:14.759105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fd19b-10f7-4c59-ab93-a60679787c94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:03:14.771817 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fd19b-10f7-4c59-ab93-a60679787c94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:03:14.773508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fd19b-10f7-4c59-ab93-a60679787c94 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:03:14.784111 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 781/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:03:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:03:18.617684 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d369cf2-78dd-4abb-b4df-689635780992 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:03:18.618326 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d369cf2-78dd-4abb-b4df-689635780992 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:03:18.618326 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d369cf2-78dd-4abb-b4df-689635780992 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:03:18.619612 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 747/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 11:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:03:18.625294 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501eba1-357d-4888-81f3-f1c90b5dcfd6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:03:18.625772 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501eba1-357d-4888-81f3-f1c90b5dcfd6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:03:18.625876 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501eba1-357d-4888-81f3-f1c90b5dcfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:03:18.644699 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6501eba1-357d-4888-81f3-f1c90b5dcfd6 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:03:18.645905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6501eba1-357d-4888-81f3-f1c90b5dcfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:03:18.654129 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 782/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 11:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:03:18.735570 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d369cf2-78dd-4abb-b4df-689635780992 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:03:18.738887 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6d369cf2-78dd-4abb-b4df-689635780992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:03:18.835123 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d369cf2-78dd-4abb-b4df-689635780992 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:03:18.840208 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63b37c-ee86-4a8f-a7c7-2f66aef0dca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:03:18.840924 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63b37c-ee86-4a8f-a7c7-2f66aef0dca3 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:03:18.841208 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63b37c-ee86-4a8f-a7c7-2f66aef0dca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:03:18.841477 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63b37c-ee86-4a8f-a7c7-2f66aef0dca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:03:18.851500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63b37c-ee86-4a8f-a7c7-2f66aef0dca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:03:18.853019 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63b37c-ee86-4a8f-a7c7-2f66aef0dca3 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:03:18.862559 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 748/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:03:20.903744 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaec2f5-a515-48be-8bf5-207dd06b0e5a None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:03:20.904342 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaec2f5-a515-48be-8bf5-207dd06b0e5a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:03:20.904342 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaec2f5-a515-48be-8bf5-207dd06b0e5a None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:03:20.905685 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 783/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 11:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:03:20.912151 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ce79c-8d1e-476a-8699-a4eefd5d4d37 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:03:20.912900 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ce79c-8d1e-476a-8699-a4eefd5d4d37 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:03:20.913020 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ce79c-8d1e-476a-8699-a4eefd5d4d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:03:20.933456 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-0f7ce79c-8d1e-476a-8699-a4eefd5d4d37 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:03:20.934637 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0f7ce79c-8d1e-476a-8699-a4eefd5d4d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:03:20.943589 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 749/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 11:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:03:20.982947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaec2f5-a515-48be-8bf5-207dd06b0e5a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:03:20.996252 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaec2f5-a515-48be-8bf5-207dd06b0e5a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:03:21.003075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800e8ae-7758-43e3-8964-76f6076b9e1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:03:21.003803 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800e8ae-7758-43e3-8964-76f6076b9e1e service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:03:21.004080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800e8ae-7758-43e3-8964-76f6076b9e1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:03:21.004378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800e8ae-7758-43e3-8964-76f6076b9e1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:03:21.014660 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800e8ae-7758-43e3-8964-76f6076b9e1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:03:21.016102 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800e8ae-7758-43e3-8964-76f6076b9e1e service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:03:21.025987 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 784/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:03:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:03:30.928018 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=73 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:03:31.021570 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=24 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:42.168378 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae0385-4343-41f7-8a10-b598cc2f6747 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:42.169088 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae0385-4343-41f7-8a10-b598cc2f6747 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:42.169088 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae0385-4343-41f7-8a10-b598cc2f6747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:42.189781 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-07ae0385-4343-41f7-8a10-b598cc2f6747 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:42.191409 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-07ae0385-4343-41f7-8a10-b598cc2f6747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:42.205172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 750/1534] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:42.214023 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8ea33-2679-49e4-936a-768111c27bb4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:42.215074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8ea33-2679-49e4-936a-768111c27bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:42.215596 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8ea33-2679-49e4-936a-768111c27bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:42.239484 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e5e8ea33-2679-49e4-936a-768111c27bb4 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:42.245339 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e5e8ea33-2679-49e4-936a-768111c27bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:42.254242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 785/1535] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:04:42.259503 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae0385-4343-41f7-8a10-b598cc2f6747 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:42.278243 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae0385-4343-41f7-8a10-b598cc2f6747 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:42.290300 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35c06a-9ce3-427d-8088-fddb6b5b7bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:42.290990 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35c06a-9ce3-427d-8088-fddb6b5b7bff admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:42.291271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35c06a-9ce3-427d-8088-fddb6b5b7bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:42.291545 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35c06a-9ce3-427d-8088-fddb6b5b7bff admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:42.292277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35c06a-9ce3-427d-8088-fddb6b5b7bff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:04:42.292584 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35c06a-9ce3-427d-8088-fddb6b5b7bff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:42.294234 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35c06a-9ce3-427d-8088-fddb6b5b7bff admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:42.309856 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 751/1536] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:04:42.318095 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8ea33-2679-49e4-936a-768111c27bb4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:42.332747 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8ea33-2679-49e4-936a-768111c27bb4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:42.341216 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe474a4-bcbf-451f-a589-5bdfdbe9c339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:42.342290 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe474a4-bcbf-451f-a589-5bdfdbe9c339 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:42.342783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe474a4-bcbf-451f-a589-5bdfdbe9c339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:42.343259 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe474a4-bcbf-451f-a589-5bdfdbe9c339 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:42.344295 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe474a4-bcbf-451f-a589-5bdfdbe9c339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:42.346469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe474a4-bcbf-451f-a589-5bdfdbe9c339 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:42.410466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 786/1537] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:04:42 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:42.415801 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35c06a-9ce3-427d-8088-fddb6b5b7bff admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:42.442706 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35c06a-9ce3-427d-8088-fddb6b5b7bff admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:42.562761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6d5d6-2fd6-4ca2-8a58-4e9ce9a1c3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:42.563587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6d5d6-2fd6-4ca2-8a58-4e9ce9a1c3cb admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:42.563867 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6d5d6-2fd6-4ca2-8a58-4e9ce9a1c3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:42.564137 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6d5d6-2fd6-4ca2-8a58-4e9ce9a1c3cb admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:42.564969 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6d5d6-2fd6-4ca2-8a58-4e9ce9a1c3cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:42.566904 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6d5d6-2fd6-4ca2-8a58-4e9ce9a1c3cb admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:42.582770 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a2c95-6628-46e0-bed1-129a1e982e9c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:42.583618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a2c95-6628-46e0-bed1-129a1e982e9c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:42.584261 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a2c95-6628-46e0-bed1-129a1e982e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:42.623129 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ec0a2c95-6628-46e0-bed1-129a1e982e9c None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:42.623420 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 752/1538] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:04:42 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:42.625559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ec0a2c95-6628-46e0-bed1-129a1e982e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:42.633398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6d5d6-2fd6-4ca2-8a58-4e9ce9a1c3cb admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:42.651822 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 787/1539] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:42.658267 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6d5d6-2fd6-4ca2-8a58-4e9ce9a1c3cb admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:42.662108 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166ed46-9aaf-4177-8539-514f8fa0b460 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:42.662393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166ed46-9aaf-4177-8539-514f8fa0b460 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:42.662659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166ed46-9aaf-4177-8539-514f8fa0b460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:42.677737 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637e3c7-d756-44ad-a1d1-3a7fe7aaa89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:42.678862 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637e3c7-d756-44ad-a1d1-3a7fe7aaa89d admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:42.682716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637e3c7-d756-44ad-a1d1-3a7fe7aaa89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:42.683247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637e3c7-d756-44ad-a1d1-3a7fe7aaa89d admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:42.684559 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637e3c7-d756-44ad-a1d1-3a7fe7aaa89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:42.687502 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637e3c7-d756-44ad-a1d1-3a7fe7aaa89d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:42.701374 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2166ed46-9aaf-4177-8539-514f8fa0b460 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:42.702534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2166ed46-9aaf-4177-8539-514f8fa0b460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:42.706546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 753/1540] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:42.711860 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637e3c7-d756-44ad-a1d1-3a7fe7aaa89d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:42.719383 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 788/1541] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:04:42.725540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166ed46-9aaf-4177-8539-514f8fa0b460 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:42.728334 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637e3c7-d756-44ad-a1d1-3a7fe7aaa89d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:42.735351 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e17cf-c4c5-4c3e-a01e-475240cb78b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:42.736041 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e17cf-c4c5-4c3e-a01e-475240cb78b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:42.736322 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e17cf-c4c5-4c3e-a01e-475240cb78b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:42.736596 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e17cf-c4c5-4c3e-a01e-475240cb78b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:42.737367 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e17cf-c4c5-4c3e-a01e-475240cb78b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:42.738990 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e17cf-c4c5-4c3e-a01e-475240cb78b9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:42.743420 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166ed46-9aaf-4177-8539-514f8fa0b460 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:42.759762 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e007216-038e-41b3-821a-c3c5b3c64b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:42.760461 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e007216-038e-41b3-821a-c3c5b3c64b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:42.760880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e007216-038e-41b3-821a-c3c5b3c64b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:42.761171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e007216-038e-41b3-821a-c3c5b3c64b2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:42.762164 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e007216-038e-41b3-821a-c3c5b3c64b2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:04:42.762475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e007216-038e-41b3-821a-c3c5b3c64b2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:42.763511 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: WARNING py.warnings [None req-1e007216-038e-41b3-821a-c3c5b3c64b2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:04:42.763511 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: warnings.warn(msg) Jul 19 11:04:42.763511 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: Jul 19 11:04:42.764458 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e007216-038e-41b3-821a-c3c5b3c64b2b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:42.764919 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 754/1542] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:42.770140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e17cf-c4c5-4c3e-a01e-475240cb78b9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:42.790684 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e17cf-c4c5-4c3e-a01e-475240cb78b9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:42.794153 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 789/1543] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:04:42.805774 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e007216-038e-41b3-821a-c3c5b3c64b2b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:42.810306 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53e850-c426-4ca5-9145-fb43fc818468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:42.811234 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53e850-c426-4ca5-9145-fb43fc818468 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:42.811512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53e850-c426-4ca5-9145-fb43fc818468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:42.811789 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53e850-c426-4ca5-9145-fb43fc818468 admin admin] PATH_INFO: `/v3/projects/c17b2c2eb7d04c85a214e7b1b347123f/users/d4e31cfb0e1c456fb0346e944f5f9511/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:42.824515 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e007216-038e-41b3-821a-c3c5b3c64b2b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:42.838350 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61821034-eece-46a3-a826-a46b70a15e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:42.839116 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61821034-eece-46a3-a826-a46b70a15e79 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:42.839394 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61821034-eece-46a3-a826-a46b70a15e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:42.839672 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61821034-eece-46a3-a826-a46b70a15e79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:42.840644 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61821034-eece-46a3-a826-a46b70a15e79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:42.842790 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61821034-eece-46a3-a826-a46b70a15e79 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:42.853838 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53e850-c426-4ca5-9145-fb43fc818468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c17b2c2eb7d04c85a214e7b1b347123f, user_id=d4e31cfb0e1c456fb0346e944f5f9511, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:42.856312 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: WARNING py.warnings [None req-4a53e850-c426-4ca5-9145-fb43fc818468 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:04:42.856312 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: warnings.warn(msg) Jul 19 11:04:42.856312 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: Jul 19 11:04:42.860405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53e850-c426-4ca5-9145-fb43fc818468 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:42.903880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 790/1544] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:04:42 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:42.953293 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61821034-eece-46a3-a826-a46b70a15e79 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:42.953478 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 755/1545] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:04:42 2022] PUT /identity/v3/projects/c17b2c2eb7d04c85a214e7b1b347123f/users/d4e31cfb0e1c456fb0346e944f5f9511/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:04:42.968763 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463df76-98b8-419d-ba6a-93bfae272b7d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:42.968763 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463df76-98b8-419d-ba6a-93bfae272b7d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:42.968763 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463df76-98b8-419d-ba6a-93bfae272b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.082902 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4463df76-98b8-419d-ba6a-93bfae272b7d None None] MFA Rules not processed for user `d4e31cfb0e1c456fb0346e944f5f9511`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:43.085087 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4463df76-98b8-419d-ba6a-93bfae272b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:43.099889 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61821034-eece-46a3-a826-a46b70a15e79 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:43.105055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3dc9ef-5419-4ac5-90c6-6fefa3bb3b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:43.106044 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dc9ef-5419-4ac5-90c6-6fefa3bb3b5e admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.106517 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dc9ef-5419-4ac5-90c6-6fefa3bb3b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.106984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dc9ef-5419-4ac5-90c6-6fefa3bb3b5e admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.107881 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3dc9ef-5419-4ac5-90c6-6fefa3bb3b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:43.109126 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: WARNING py.warnings [None req-2b3dc9ef-5419-4ac5-90c6-6fefa3bb3b5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:04:43.109126 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: warnings.warn(msg) Jul 19 11:04:43.109126 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: Jul 19 11:04:43.110679 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3dc9ef-5419-4ac5-90c6-6fefa3bb3b5e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:43.141701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 791/1546] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:04:42 2022] POST /identity/v3/users => generated 285 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:43.143353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292ef5e-5307-4c92-8fb2-d590efb2f589 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.143353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292ef5e-5307-4c92-8fb2-d590efb2f589 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.143617 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292ef5e-5307-4c92-8fb2-d590efb2f589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.165132 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c292ef5e-5307-4c92-8fb2-d590efb2f589 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:43.166271 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c292ef5e-5307-4c92-8fb2-d590efb2f589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:43.174904 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 792/1547] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:43.176286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26be84-8f69-40ba-8ae8-13cc2dbf56b6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.176612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26be84-8f69-40ba-8ae8-13cc2dbf56b6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.176926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26be84-8f69-40ba-8ae8-13cc2dbf56b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.188969 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 756/1548] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:04:43.190356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa5471-1914-4884-b5ce-6c5fd1863d13 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.190650 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa5471-1914-4884-b5ce-6c5fd1863d13 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.190929 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa5471-1914-4884-b5ce-6c5fd1863d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.203941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-cc26be84-8f69-40ba-8ae8-13cc2dbf56b6 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:43.205581 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cc26be84-8f69-40ba-8ae8-13cc2dbf56b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:43.210994 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d9aa5471-1914-4884-b5ce-6c5fd1863d13 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:43.212144 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d9aa5471-1914-4884-b5ce-6c5fd1863d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:43.217891 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 793/1549] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:43.222864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7207a-b87a-42a5-b567-7b3e328e064a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.223253 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7207a-b87a-42a5-b567-7b3e328e064a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.223527 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7207a-b87a-42a5-b567-7b3e328e064a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.228276 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 757/1550] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:43.229811 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa5471-1914-4884-b5ce-6c5fd1863d13 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:43.242468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa5471-1914-4884-b5ce-6c5fd1863d13 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:43.244344 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dfc7207a-b87a-42a5-b567-7b3e328e064a None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:43.245967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dfc7207a-b87a-42a5-b567-7b3e328e064a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:43.248911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7daa6-f13b-42f3-ae33-6d32b4382bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:43.250235 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7daa6-f13b-42f3-ae33-6d32b4382bad admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.250764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7daa6-f13b-42f3-ae33-6d32b4382bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.251341 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7daa6-f13b-42f3-ae33-6d32b4382bad admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.252306 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7daa6-f13b-42f3-ae33-6d32b4382bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:43.254104 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7daa6-f13b-42f3-ae33-6d32b4382bad admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:43.256005 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 794/1551] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:43.258213 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:43.268547 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb41f6d-6564-44f3-b189-f627ab736485 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.268547 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb41f6d-6564-44f3-b189-f627ab736485 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.269139 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb41f6d-6564-44f3-b189-f627ab736485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.273266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 758/1552] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:43.275306 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bc628-045b-402c-a6f7-4031d3a3d068 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.275786 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bc628-045b-402c-a6f7-4031d3a3d068 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.276246 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bc628-045b-402c-a6f7-4031d3a3d068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.292158 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8eb41f6d-6564-44f3-b189-f627ab736485 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:43.293682 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8eb41f6d-6564-44f3-b189-f627ab736485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:43.301326 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-821bc628-045b-402c-a6f7-4031d3a3d068 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:43.302325 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 795/1553] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:43.302916 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-821bc628-045b-402c-a6f7-4031d3a3d068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:43.303092 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb41f6d-6564-44f3-b189-f627ab736485 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:43.312901 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb41f6d-6564-44f3-b189-f627ab736485 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:43.314278 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 759/1554] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:43.316016 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0646e79-1b90-4395-bbd6-4841f346140b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.316468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0646e79-1b90-4395-bbd6-4841f346140b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.316851 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0646e79-1b90-4395-bbd6-4841f346140b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.317885 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf184b-4616-4531-8332-9e32e574f3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:43.318504 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf184b-4616-4531-8332-9e32e574f3a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.318790 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf184b-4616-4531-8332-9e32e574f3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.319127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf184b-4616-4531-8332-9e32e574f3a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.319846 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf184b-4616-4531-8332-9e32e574f3a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:43.322423 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf184b-4616-4531-8332-9e32e574f3a7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:43.341438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e0646e79-1b90-4395-bbd6-4841f346140b None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:43.343370 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e0646e79-1b90-4395-bbd6-4841f346140b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:43.353094 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 796/1555] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:04:43 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:43.353094 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc12fec-63aa-44a1-9a1c-ddfe0981e587 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.353094 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc12fec-63aa-44a1-9a1c-ddfe0981e587 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.353094 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc12fec-63aa-44a1-9a1c-ddfe0981e587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.355435 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 760/1556] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:43.357361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04deae0d-fb1b-440c-ae15-078af306582a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.357746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04deae0d-fb1b-440c-ae15-078af306582a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.358425 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04deae0d-fb1b-440c-ae15-078af306582a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.374311 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9cc12fec-63aa-44a1-9a1c-ddfe0981e587 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:43.375515 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9cc12fec-63aa-44a1-9a1c-ddfe0981e587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:43.380618 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-04deae0d-fb1b-440c-ae15-078af306582a None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:43.381898 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-04deae0d-fb1b-440c-ae15-078af306582a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:43.387898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:43.445951 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 797/1557] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:43.446202 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc12fec-63aa-44a1-9a1c-ddfe0981e587 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:43.450215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 761/1558] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:43.451643 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791187e1-4e80-4154-8cc4-a7de1ae39cb2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.452098 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791187e1-4e80-4154-8cc4-a7de1ae39cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.452377 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791187e1-4e80-4154-8cc4-a7de1ae39cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.456524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc12fec-63aa-44a1-9a1c-ddfe0981e587 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:43.461272 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322eace-b6fa-41c3-921f-ea6f3d685aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:43.461941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322eace-b6fa-41c3-921f-ea6f3d685aca admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.462228 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322eace-b6fa-41c3-921f-ea6f3d685aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.462476 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322eace-b6fa-41c3-921f-ea6f3d685aca admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.463196 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322eace-b6fa-41c3-921f-ea6f3d685aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:43.464827 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322eace-b6fa-41c3-921f-ea6f3d685aca admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:43.472761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-791187e1-4e80-4154-8cc4-a7de1ae39cb2 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:43.473968 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-791187e1-4e80-4154-8cc4-a7de1ae39cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:43.478428 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 798/1559] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:43.478428 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154a5bd-95b2-4a1d-88ec-ea12e66d9ecf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.478428 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154a5bd-95b2-4a1d-88ec-ea12e66d9ecf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.478428 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154a5bd-95b2-4a1d-88ec-ea12e66d9ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.482620 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 762/1560] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:43.483416 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791187e1-4e80-4154-8cc4-a7de1ae39cb2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:43.498141 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a154a5bd-95b2-4a1d-88ec-ea12e66d9ecf None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:43.498395 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791187e1-4e80-4154-8cc4-a7de1ae39cb2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:43.499382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a154a5bd-95b2-4a1d-88ec-ea12e66d9ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:43.505005 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321e5fb-5942-4f6f-9902-10e6b3f4368b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:43.505952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321e5fb-5942-4f6f-9902-10e6b3f4368b admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.506336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321e5fb-5942-4f6f-9902-10e6b3f4368b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.506714 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321e5fb-5942-4f6f-9902-10e6b3f4368b admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.507450 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321e5fb-5942-4f6f-9902-10e6b3f4368b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:04:43.507750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321e5fb-5942-4f6f-9902-10e6b3f4368b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:43.508046 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 799/1561] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:43.510188 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321e5fb-5942-4f6f-9902-10e6b3f4368b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:43.512878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154a5bd-95b2-4a1d-88ec-ea12e66d9ecf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:43.522758 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154a5bd-95b2-4a1d-88ec-ea12e66d9ecf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:43.534568 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 763/1562] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:04:43.534778 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4c900-e855-4de5-9c7f-40453b947b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:43.534882 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321e5fb-5942-4f6f-9902-10e6b3f4368b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:43.534956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4c900-e855-4de5-9c7f-40453b947b87 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.534956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4c900-e855-4de5-9c7f-40453b947b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.534956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4c900-e855-4de5-9c7f-40453b947b87 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.534956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4c900-e855-4de5-9c7f-40453b947b87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:43.534956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4c900-e855-4de5-9c7f-40453b947b87 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:43.541704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321e5fb-5942-4f6f-9902-10e6b3f4368b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:43.547581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27958345-ff83-4746-a20c-1bb4d5d53103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:43.548256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27958345-ff83-4746-a20c-1bb4d5d53103 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.548523 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27958345-ff83-4746-a20c-1bb4d5d53103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.548821 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27958345-ff83-4746-a20c-1bb4d5d53103 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.549556 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27958345-ff83-4746-a20c-1bb4d5d53103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:04:43.549864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27958345-ff83-4746-a20c-1bb4d5d53103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:43.551906 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27958345-ff83-4746-a20c-1bb4d5d53103 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:43.557041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 800/1563] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:04:43 2022] POST /identity/v3/users => generated 298 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:43.557908 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4c900-e855-4de5-9c7f-40453b947b87 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:43.573955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 764/1564] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:04:43.574133 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4c900-e855-4de5-9c7f-40453b947b87 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:43.574235 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27958345-ff83-4746-a20c-1bb4d5d53103 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:43.574307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c002c8b-a203-4c63-9e15-8cc19a6496c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:43.574620 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c002c8b-a203-4c63-9e15-8cc19a6496c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.574900 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c002c8b-a203-4c63-9e15-8cc19a6496c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.575189 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c002c8b-a203-4c63-9e15-8cc19a6496c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.575924 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c002c8b-a203-4c63-9e15-8cc19a6496c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:04:43.576229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c002c8b-a203-4c63-9e15-8cc19a6496c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:43.577905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c002c8b-a203-4c63-9e15-8cc19a6496c0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:43.587106 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27958345-ff83-4746-a20c-1bb4d5d53103 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:43.591279 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 801/1565] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:04:43.591952 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c002c8b-a203-4c63-9e15-8cc19a6496c0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:43.600804 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5f4b2-3196-4b6e-9cb6-0f53f9935e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:43.601491 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5f4b2-3196-4b6e-9cb6-0f53f9935e99 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.601773 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5f4b2-3196-4b6e-9cb6-0f53f9935e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.601988 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c002c8b-a203-4c63-9e15-8cc19a6496c0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:43.602198 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5f4b2-3196-4b6e-9cb6-0f53f9935e99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.602800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5f4b2-3196-4b6e-9cb6-0f53f9935e99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:04:43.603070 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5f4b2-3196-4b6e-9cb6-0f53f9935e99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:43.604669 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5f4b2-3196-4b6e-9cb6-0f53f9935e99 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:43.607763 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a0e1e-19e1-4da4-bee2-f4aefe68d54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:43.608668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a0e1e-19e1-4da4-bee2-f4aefe68d54b admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.608981 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a0e1e-19e1-4da4-bee2-f4aefe68d54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.609251 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a0e1e-19e1-4da4-bee2-f4aefe68d54b admin admin] PATH_INFO: `/v3/projects/49664a2646a148818aec3a13d84def0e/users/8bb9553fcf0243a1ba805fa404d34ecf/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.617745 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 765/1566] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:04:43.626275 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f090a2-e29d-4517-9eec-94b4ff829aa7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.626473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a0e1e-19e1-4da4-bee2-f4aefe68d54b admin admin] RBAC: Authorizing `identity:create_grant(project_id=49664a2646a148818aec3a13d84def0e, user_id=8bb9553fcf0243a1ba805fa404d34ecf, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:43.626557 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f090a2-e29d-4517-9eec-94b4ff829aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.626826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f090a2-e29d-4517-9eec-94b4ff829aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.629117 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a0e1e-19e1-4da4-bee2-f4aefe68d54b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:43.644144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 802/1567] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:04:43 2022] PUT /identity/v3/projects/49664a2646a148818aec3a13d84def0e/users/8bb9553fcf0243a1ba805fa404d34ecf/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:43.645134 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a0e1e-19e1-4da4-bee2-f4aefe68d54b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:43.649967 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d2f090a2-e29d-4517-9eec-94b4ff829aa7 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:43.651361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d2f090a2-e29d-4517-9eec-94b4ff829aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:43.712776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a0e1e-19e1-4da4-bee2-f4aefe68d54b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:43.717548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 766/1568] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:43.721755 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aef494-e98e-403a-a32e-484b6d78dc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:43.721755 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aef494-e98e-403a-a32e-484b6d78dc11 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.722005 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f090a2-e29d-4517-9eec-94b4ff829aa7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:43.722091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aef494-e98e-403a-a32e-484b6d78dc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.722091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aef494-e98e-403a-a32e-484b6d78dc11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.722091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aef494-e98e-403a-a32e-484b6d78dc11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:04:43.722091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aef494-e98e-403a-a32e-484b6d78dc11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:43.722091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aef494-e98e-403a-a32e-484b6d78dc11 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:43.727920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f090a2-e29d-4517-9eec-94b4ff829aa7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:43.732752 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b839b3-4c04-4582-b9a0-3fc599a2e747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:43.733426 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b839b3-4c04-4582-b9a0-3fc599a2e747 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.733706 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b839b3-4c04-4582-b9a0-3fc599a2e747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.734009 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b839b3-4c04-4582-b9a0-3fc599a2e747 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.734576 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 803/1569] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:04:43.735422 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aef494-e98e-403a-a32e-484b6d78dc11 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:43.740557 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b839b3-4c04-4582-b9a0-3fc599a2e747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:43.742501 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: WARNING py.warnings [None req-99b839b3-4c04-4582-b9a0-3fc599a2e747 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:04:43.742501 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: warnings.warn(msg) Jul 19 11:04:43.742501 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: Jul 19 11:04:43.743776 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b839b3-4c04-4582-b9a0-3fc599a2e747 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:43.745486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aef494-e98e-403a-a32e-484b6d78dc11 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:43.750158 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac083c-7289-494c-9adb-802fd486f11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:43.750820 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac083c-7289-494c-9adb-802fd486f11b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.751098 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac083c-7289-494c-9adb-802fd486f11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.751413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac083c-7289-494c-9adb-802fd486f11b admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.752131 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac083c-7289-494c-9adb-802fd486f11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:43.753764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac083c-7289-494c-9adb-802fd486f11b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:43.765971 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 804/1570] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:43.766481 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac083c-7289-494c-9adb-802fd486f11b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:43.775122 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 767/1571] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:04:43 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:43.776055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b839b3-4c04-4582-b9a0-3fc599a2e747 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:43.776864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac083c-7289-494c-9adb-802fd486f11b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:43.794738 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:43.804187 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:43.839542 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6d947-f393-428a-89e5-39e401e37794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:43.840221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6d947-f393-428a-89e5-39e401e37794 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.840504 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6d947-f393-428a-89e5-39e401e37794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.840811 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6d947-f393-428a-89e5-39e401e37794 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.841498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6d947-f393-428a-89e5-39e401e37794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:43.843518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6d947-f393-428a-89e5-39e401e37794 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:43.845646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b839b3-4c04-4582-b9a0-3fc599a2e747 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:43.850581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6164a76-67d8-441d-9ef5-5ee56016d3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:43.851239 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6164a76-67d8-441d-9ef5-5ee56016d3e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.851524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6164a76-67d8-441d-9ef5-5ee56016d3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.851917 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6164a76-67d8-441d-9ef5-5ee56016d3e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.852612 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6164a76-67d8-441d-9ef5-5ee56016d3e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:43.854604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6164a76-67d8-441d-9ef5-5ee56016d3e9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:43.871590 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 805/1572] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:04:43 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:43.872639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6d947-f393-428a-89e5-39e401e37794 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:43.886818 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 768/1573] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:04:43 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:43.886818 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b842e0-81fb-4958-a16d-591e7f8148e1 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:43.886818 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b842e0-81fb-4958-a16d-591e7f8148e1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:43.886818 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b842e0-81fb-4958-a16d-591e7f8148e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:43.912317 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-61b842e0-81fb-4958-a16d-591e7f8148e1 None None] MFA Rules not processed for user `8bb9553fcf0243a1ba805fa404d34ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:43.913622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-61b842e0-81fb-4958-a16d-591e7f8148e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:43.936599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6d947-f393-428a-89e5-39e401e37794 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:43.983489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 769/1574] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:43.984267 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b842e0-81fb-4958-a16d-591e7f8148e1 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.001181 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68f782-ee68-4941-8886-972c52118727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.001861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68f782-ee68-4941-8886-972c52118727 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.002143 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68f782-ee68-4941-8886-972c52118727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.002420 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68f782-ee68-4941-8886-972c52118727 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.003110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68f782-ee68-4941-8886-972c52118727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.005064 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68f782-ee68-4941-8886-972c52118727 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.036994 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 806/1575] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:04:43 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:44.044199 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68f782-ee68-4941-8886-972c52118727 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.056893 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b842e0-81fb-4958-a16d-591e7f8148e1 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.096221 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:44.102168 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:44.122525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68f782-ee68-4941-8886-972c52118727 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.123482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783029ac-a22e-433f-919c-4fdcb38d3f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.124330 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783029ac-a22e-433f-919c-4fdcb38d3f3a admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.124765 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783029ac-a22e-433f-919c-4fdcb38d3f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.125061 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783029ac-a22e-433f-919c-4fdcb38d3f3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.125958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783029ac-a22e-433f-919c-4fdcb38d3f3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:04:44.126269 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783029ac-a22e-433f-919c-4fdcb38d3f3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.127164 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069fc4f-d0f8-409f-861d-97d611fdf34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.127844 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069fc4f-d0f8-409f-861d-97d611fdf34b admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.127946 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783029ac-a22e-433f-919c-4fdcb38d3f3a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.128147 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069fc4f-d0f8-409f-861d-97d611fdf34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.128452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069fc4f-d0f8-409f-861d-97d611fdf34b admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.129182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069fc4f-d0f8-409f-861d-97d611fdf34b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.131281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069fc4f-d0f8-409f-861d-97d611fdf34b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.143421 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 770/1576] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:04:44.144197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783029ac-a22e-433f-919c-4fdcb38d3f3a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.160464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783029ac-a22e-433f-919c-4fdcb38d3f3a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.165274 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf241ce0-aba8-4978-a45f-e9b9357dd19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.166188 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf241ce0-aba8-4978-a45f-e9b9357dd19a admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.166503 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf241ce0-aba8-4978-a45f-e9b9357dd19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.166783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf241ce0-aba8-4978-a45f-e9b9357dd19a admin admin] PATH_INFO: `/v3/projects/ac86edba6f5642e4927da95e3c9921e5/users/c19fe42bbb91461cb6618fab9286556d/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.185327 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 807/1577] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:04:44 2022] POST /identity/v3/projects => generated 411 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:44.185327 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069fc4f-d0f8-409f-861d-97d611fdf34b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.186542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf241ce0-aba8-4978-a45f-e9b9357dd19a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac86edba6f5642e4927da95e3c9921e5, user_id=c19fe42bbb91461cb6618fab9286556d, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.189296 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf241ce0-aba8-4978-a45f-e9b9357dd19a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.204258 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 771/1578] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:04:44 2022] PUT /identity/v3/projects/ac86edba6f5642e4927da95e3c9921e5/users/c19fe42bbb91461cb6618fab9286556d/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:44.205232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf241ce0-aba8-4978-a45f-e9b9357dd19a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.253271 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069fc4f-d0f8-409f-861d-97d611fdf34b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.267985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf241ce0-aba8-4978-a45f-e9b9357dd19a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.273938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51074845-e921-4aa1-bdcc-3dae9a604eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.274691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51074845-e921-4aa1-bdcc-3dae9a604eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.274971 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51074845-e921-4aa1-bdcc-3dae9a604eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.275242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51074845-e921-4aa1-bdcc-3dae9a604eb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.275978 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51074845-e921-4aa1-bdcc-3dae9a604eb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.277985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51074845-e921-4aa1-bdcc-3dae9a604eb2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.302299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 772/1579] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:04:44 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:44.303143 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51074845-e921-4aa1-bdcc-3dae9a604eb2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.313396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51074845-e921-4aa1-bdcc-3dae9a604eb2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.321012 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bf328-0daf-4bb3-a559-b7a91bacb7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.321698 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bf328-0daf-4bb3-a559-b7a91bacb7fc admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.321975 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bf328-0daf-4bb3-a559-b7a91bacb7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.322246 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bf328-0daf-4bb3-a559-b7a91bacb7fc admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.322778 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6eada2-4cd8-4b64-9724-5e5ab6ba0ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.323780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eada2-4cd8-4b64-9724-5e5ab6ba0ddf admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.323914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bf328-0daf-4bb3-a559-b7a91bacb7fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.324058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eada2-4cd8-4b64-9724-5e5ab6ba0ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.324350 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eada2-4cd8-4b64-9724-5e5ab6ba0ddf admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.325057 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6eada2-4cd8-4b64-9724-5e5ab6ba0ddf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.325855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bf328-0daf-4bb3-a559-b7a91bacb7fc admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.327001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6eada2-4cd8-4b64-9724-5e5ab6ba0ddf admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.348168 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 773/1580] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:04:44 2022] POST /identity/v3/users => generated 284 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:44.348366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 808/1581] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:04:44 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:44.349755 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bf328-0daf-4bb3-a559-b7a91bacb7fc admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.350046 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6eada2-4cd8-4b64-9724-5e5ab6ba0ddf admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.360523 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bf328-0daf-4bb3-a559-b7a91bacb7fc admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.361203 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6eada2-4cd8-4b64-9724-5e5ab6ba0ddf admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.365288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff210a8d-21ed-4959-9f5f-3b39cc780ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.365812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b6c93-02fe-4c69-9567-0277af3abff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.366065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff210a8d-21ed-4959-9f5f-3b39cc780ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.366349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff210a8d-21ed-4959-9f5f-3b39cc780ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.366623 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff210a8d-21ed-4959-9f5f-3b39cc780ea2 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.366718 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b6c93-02fe-4c69-9567-0277af3abff2 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.366967 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b6c93-02fe-4c69-9567-0277af3abff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.367247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b6c93-02fe-4c69-9567-0277af3abff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.367344 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff210a8d-21ed-4959-9f5f-3b39cc780ea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.367966 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b6c93-02fe-4c69-9567-0277af3abff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.369260 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff210a8d-21ed-4959-9f5f-3b39cc780ea2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.369917 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b6c93-02fe-4c69-9567-0277af3abff2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.391598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 809/1582] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:04:44 2022] POST /identity/v3/users => generated 290 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:44.392840 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff210a8d-21ed-4959-9f5f-3b39cc780ea2 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.398939 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 774/1583] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:04:44 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:44.399765 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b6c93-02fe-4c69-9567-0277af3abff2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.403742 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff210a8d-21ed-4959-9f5f-3b39cc780ea2 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.454213 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:44.465832 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:44.468693 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d6166-f1b4-4108-a04a-a595b9c85551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.469305 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d6166-f1b4-4108-a04a-a595b9c85551 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.469714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d6166-f1b4-4108-a04a-a595b9c85551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.469991 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d6166-f1b4-4108-a04a-a595b9c85551 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.470683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d6166-f1b4-4108-a04a-a595b9c85551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.471384 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b6c93-02fe-4c69-9567-0277af3abff2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.472595 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d6166-f1b4-4108-a04a-a595b9c85551 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.478820 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36e7c6-0cad-4eae-b242-071da5f8dbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.479687 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36e7c6-0cad-4eae-b242-071da5f8dbe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.480075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36e7c6-0cad-4eae-b242-071da5f8dbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.480451 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36e7c6-0cad-4eae-b242-071da5f8dbe8 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.481460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36e7c6-0cad-4eae-b242-071da5f8dbe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.484298 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36e7c6-0cad-4eae-b242-071da5f8dbe8 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.499389 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 810/1584] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:04:44 2022] POST /identity/v3/projects => generated 391 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:44.500262 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d6166-f1b4-4108-a04a-a595b9c85551 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.514606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 775/1585] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:04:44 2022] POST /identity/v3/users => generated 306 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:44.515746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36e7c6-0cad-4eae-b242-071da5f8dbe8 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.530287 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36e7c6-0cad-4eae-b242-071da5f8dbe8 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.564093 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d6166-f1b4-4108-a04a-a595b9c85551 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.568656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb496c5-97aa-4560-9203-31b9de597095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.569376 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb496c5-97aa-4560-9203-31b9de597095 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.569656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb496c5-97aa-4560-9203-31b9de597095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.569944 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb496c5-97aa-4560-9203-31b9de597095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.570653 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb496c5-97aa-4560-9203-31b9de597095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.572267 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb496c5-97aa-4560-9203-31b9de597095 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.583022 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 811/1586] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:44.583875 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb496c5-97aa-4560-9203-31b9de597095 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.592400 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3623f-a4eb-47e0-8933-cb83cd7352de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.593128 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3623f-a4eb-47e0-8933-cb83cd7352de admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.593409 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3623f-a4eb-47e0-8933-cb83cd7352de admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.593504 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb496c5-97aa-4560-9203-31b9de597095 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.593682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3623f-a4eb-47e0-8933-cb83cd7352de admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.594403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3623f-a4eb-47e0-8933-cb83cd7352de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.596009 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3623f-a4eb-47e0-8933-cb83cd7352de admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.598589 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2473c-c52e-422e-a4b9-dccad83efbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.599282 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2473c-c52e-422e-a4b9-dccad83efbba admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.599563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2473c-c52e-422e-a4b9-dccad83efbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.599840 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2473c-c52e-422e-a4b9-dccad83efbba admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.600579 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2473c-c52e-422e-a4b9-dccad83efbba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.602187 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2473c-c52e-422e-a4b9-dccad83efbba admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.607129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 776/1587] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:44.608026 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3623f-a4eb-47e0-8933-cb83cd7352de admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.613455 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 812/1588] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:44.614220 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2473c-c52e-422e-a4b9-dccad83efbba admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.619133 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3623f-a4eb-47e0-8933-cb83cd7352de admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.624293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792b2cb-2762-489c-a160-e9247d125908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.624962 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2473c-c52e-422e-a4b9-dccad83efbba admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.625068 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792b2cb-2762-489c-a160-e9247d125908 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.625252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792b2cb-2762-489c-a160-e9247d125908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.625520 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792b2cb-2762-489c-a160-e9247d125908 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.626239 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792b2cb-2762-489c-a160-e9247d125908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.627864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792b2cb-2762-489c-a160-e9247d125908 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.629553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da1414-0be3-4be3-80bb-e359ced324f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.630212 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da1414-0be3-4be3-80bb-e359ced324f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.630490 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da1414-0be3-4be3-80bb-e359ced324f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.630759 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da1414-0be3-4be3-80bb-e359ced324f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.631568 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da1414-0be3-4be3-80bb-e359ced324f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.633117 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da1414-0be3-4be3-80bb-e359ced324f9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.638917 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 777/1589] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:44.639840 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792b2cb-2762-489c-a160-e9247d125908 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.644462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 813/1590] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:44.645457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da1414-0be3-4be3-80bb-e359ced324f9 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.649914 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792b2cb-2762-489c-a160-e9247d125908 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.654683 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f90c02-6e98-4d90-be0e-1bd9177438f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.655311 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da1414-0be3-4be3-80bb-e359ced324f9 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.655470 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f90c02-6e98-4d90-be0e-1bd9177438f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.655610 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f90c02-6e98-4d90-be0e-1bd9177438f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.655886 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f90c02-6e98-4d90-be0e-1bd9177438f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.656568 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f90c02-6e98-4d90-be0e-1bd9177438f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.658519 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f90c02-6e98-4d90-be0e-1bd9177438f0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.660190 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1707c-524f-4ba8-a5d3-ee76905cece2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.660919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1707c-524f-4ba8-a5d3-ee76905cece2 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.661204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1707c-524f-4ba8-a5d3-ee76905cece2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.661484 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1707c-524f-4ba8-a5d3-ee76905cece2 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.662167 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1707c-524f-4ba8-a5d3-ee76905cece2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.664296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1707c-524f-4ba8-a5d3-ee76905cece2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.686112 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 778/1591] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:04:44 2022] POST /identity/v3/users => generated 290 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:44.686112 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f90c02-6e98-4d90-be0e-1bd9177438f0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.686898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 814/1592] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:04:44 2022] POST /identity/v3/users => generated 296 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:44.687702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1707c-524f-4ba8-a5d3-ee76905cece2 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.697444 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f90c02-6e98-4d90-be0e-1bd9177438f0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.697899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1707c-524f-4ba8-a5d3-ee76905cece2 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.702733 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139e514-573c-45e7-9492-823f5056d974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.702976 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a497f-ce8a-4ad0-acc1-bc7ff3f9fc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.703403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139e514-573c-45e7-9492-823f5056d974 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.703681 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139e514-573c-45e7-9492-823f5056d974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.703952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139e514-573c-45e7-9492-823f5056d974 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.704042 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a497f-ce8a-4ad0-acc1-bc7ff3f9fc55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.704287 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a497f-ce8a-4ad0-acc1-bc7ff3f9fc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.704567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a497f-ce8a-4ad0-acc1-bc7ff3f9fc55 admin admin] PATH_INFO: `/v3/projects/ac86edba6f5642e4927da95e3c9921e5/users/c19fe42bbb91461cb6618fab9286556d/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.704735 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139e514-573c-45e7-9492-823f5056d974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.706281 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139e514-573c-45e7-9492-823f5056d974 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.706567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a497f-ce8a-4ad0-acc1-bc7ff3f9fc55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac86edba6f5642e4927da95e3c9921e5, user_id=c19fe42bbb91461cb6618fab9286556d, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.709226 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a497f-ce8a-4ad0-acc1-bc7ff3f9fc55 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.717285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 779/1593] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:44.718059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139e514-573c-45e7-9492-823f5056d974 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.722709 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 815/1594] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:04:44 2022] PUT /identity/v3/projects/ac86edba6f5642e4927da95e3c9921e5/users/c19fe42bbb91461cb6618fab9286556d/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:44.723529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a497f-ce8a-4ad0-acc1-bc7ff3f9fc55 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.729387 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139e514-573c-45e7-9492-823f5056d974 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.792119 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5385033-cf5e-49f5-a925-9671ebefe318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.792742 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5385033-cf5e-49f5-a925-9671ebefe318 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.793018 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5385033-cf5e-49f5-a925-9671ebefe318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.793296 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5385033-cf5e-49f5-a925-9671ebefe318 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.794052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5385033-cf5e-49f5-a925-9671ebefe318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.795851 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5385033-cf5e-49f5-a925-9671ebefe318 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.800877 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a497f-ce8a-4ad0-acc1-bc7ff3f9fc55 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.806139 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b19c7-6b77-49de-837a-d092a4a2e713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.806471 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 780/1595] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:44.807271 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b19c7-6b77-49de-837a-d092a4a2e713 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.807371 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5385033-cf5e-49f5-a925-9671ebefe318 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.807644 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b19c7-6b77-49de-837a-d092a4a2e713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.807930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b19c7-6b77-49de-837a-d092a4a2e713 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.808595 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b19c7-6b77-49de-837a-d092a4a2e713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.810352 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b19c7-6b77-49de-837a-d092a4a2e713 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.819186 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5385033-cf5e-49f5-a925-9671ebefe318 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.824223 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 816/1596] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:44.824223 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b19c7-6b77-49de-837a-d092a4a2e713 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.828070 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13211d2b-56ff-48f9-b040-9f1f2fba6866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.828808 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13211d2b-56ff-48f9-b040-9f1f2fba6866 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.829079 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13211d2b-56ff-48f9-b040-9f1f2fba6866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.829356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13211d2b-56ff-48f9-b040-9f1f2fba6866 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.830146 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13211d2b-56ff-48f9-b040-9f1f2fba6866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.831894 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13211d2b-56ff-48f9-b040-9f1f2fba6866 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.832021 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b19c7-6b77-49de-837a-d092a4a2e713 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.836737 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b27dc-10bb-43e0-b578-88a9cdd1705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.837408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b27dc-10bb-43e0-b578-88a9cdd1705c admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.837683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b27dc-10bb-43e0-b578-88a9cdd1705c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.837975 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b27dc-10bb-43e0-b578-88a9cdd1705c admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.838695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b27dc-10bb-43e0-b578-88a9cdd1705c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.840289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b27dc-10bb-43e0-b578-88a9cdd1705c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.844477 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 781/1597] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:44.845328 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13211d2b-56ff-48f9-b040-9f1f2fba6866 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.853032 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 817/1598] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:44.853915 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b27dc-10bb-43e0-b578-88a9cdd1705c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.855527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13211d2b-56ff-48f9-b040-9f1f2fba6866 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.859060 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:44.861071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c025f-0550-40cb-9ac1-e1c8bbf54650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.861826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c025f-0550-40cb-9ac1-e1c8bbf54650 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.862154 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c025f-0550-40cb-9ac1-e1c8bbf54650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.862375 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c025f-0550-40cb-9ac1-e1c8bbf54650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.863256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c025f-0550-40cb-9ac1-e1c8bbf54650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.865231 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c025f-0550-40cb-9ac1-e1c8bbf54650 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.867223 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b27dc-10bb-43e0-b578-88a9cdd1705c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.872521 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d60222-3162-4a5e-a53c-869632820e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.873230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d60222-3162-4a5e-a53c-869632820e4e admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.873512 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d60222-3162-4a5e-a53c-869632820e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.873784 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d60222-3162-4a5e-a53c-869632820e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.874511 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d60222-3162-4a5e-a53c-869632820e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.876113 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d60222-3162-4a5e-a53c-869632820e4e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.877790 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 782/1599] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:44.878625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c025f-0550-40cb-9ac1-e1c8bbf54650 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.889162 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c025f-0550-40cb-9ac1-e1c8bbf54650 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.893148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 818/1600] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:44.893148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7895f0-81c1-45b9-8a02-cf07da1f9d3d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.893148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7895f0-81c1-45b9-8a02-cf07da1f9d3d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.893148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7895f0-81c1-45b9-8a02-cf07da1f9d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.897226 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f0019-4383-4e95-ad93-20e2e8b46551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.897880 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f0019-4383-4e95-ad93-20e2e8b46551 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.898159 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f0019-4383-4e95-ad93-20e2e8b46551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.898425 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f0019-4383-4e95-ad93-20e2e8b46551 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.899141 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f0019-4383-4e95-ad93-20e2e8b46551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.900768 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f0019-4383-4e95-ad93-20e2e8b46551 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.911608 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 783/1601] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:44.912423 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f0019-4383-4e95-ad93-20e2e8b46551 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.918977 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dd7895f0-81c1-45b9-8a02-cf07da1f9d3d None None] MFA Rules not processed for user `c19fe42bbb91461cb6618fab9286556d`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:44.920184 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dd7895f0-81c1-45b9-8a02-cf07da1f9d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:44.924204 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f0019-4383-4e95-ad93-20e2e8b46551 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:44.928921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f9f4c-4f41-4d58-a34a-f62ea27e3083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:44.929910 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9f4c-4f41-4d58-a34a-f62ea27e3083 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:44.930110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9f4c-4f41-4d58-a34a-f62ea27e3083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:44.930411 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9f4c-4f41-4d58-a34a-f62ea27e3083 admin admin] PATH_INFO: `/v3/projects/981e27010c2240ba806b4ef571526be4/users/49584496baed4538b25ffdb3071278cf/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:44.932927 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:44.950911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f9f4c-4f41-4d58-a34a-f62ea27e3083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=981e27010c2240ba806b4ef571526be4, user_id=49584496baed4538b25ffdb3071278cf, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:44.954368 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f9f4c-4f41-4d58-a34a-f62ea27e3083 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:44.969937 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 784/1602] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:04:44 2022] PUT /identity/v3/projects/981e27010c2240ba806b4ef571526be4/users/49584496baed4538b25ffdb3071278cf/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:44.970964 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f9f4c-4f41-4d58-a34a-f62ea27e3083 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:44.994932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 819/1603] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:44.995905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7895f0-81c1-45b9-8a02-cf07da1f9d3d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:45.007093 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7895f0-81c1-45b9-8a02-cf07da1f9d3d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:45.048509 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f9f4c-4f41-4d58-a34a-f62ea27e3083 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:45.053210 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2926116-0221-4b44-b7e5-f4b31cabf5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:45.054215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2926116-0221-4b44-b7e5-f4b31cabf5c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:45.054496 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2926116-0221-4b44-b7e5-f4b31cabf5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:45.054822 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2926116-0221-4b44-b7e5-f4b31cabf5c5 admin admin] PATH_INFO: `/v3/projects/f2bf7039ef6241cf84fccf53c92e5d86/users/02696270934b4ea3a6e83746599f64ee/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:45.069796 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2926116-0221-4b44-b7e5-f4b31cabf5c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2bf7039ef6241cf84fccf53c92e5d86, user_id=02696270934b4ea3a6e83746599f64ee, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:45.070466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249e7a4-c802-4523-893f-4f7ce9ed4e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:45.071765 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249e7a4-c802-4523-893f-4f7ce9ed4e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:45.072150 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249e7a4-c802-4523-893f-4f7ce9ed4e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:45.072499 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2926116-0221-4b44-b7e5-f4b31cabf5c5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:45.072585 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249e7a4-c802-4523-893f-4f7ce9ed4e1c admin admin] PATH_INFO: `/v3/projects/4914886561974d358b06b99d1582d906/users/5b244089f61f45cb812788ef46c15af5/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:45.086516 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 785/1604] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:04:44 2022] PUT /identity/v3/projects/f2bf7039ef6241cf84fccf53c92e5d86/users/02696270934b4ea3a6e83746599f64ee/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:45.090393 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2926116-0221-4b44-b7e5-f4b31cabf5c5 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:45.094500 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249e7a4-c802-4523-893f-4f7ce9ed4e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4914886561974d358b06b99d1582d906, user_id=5b244089f61f45cb812788ef46c15af5, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:45.098495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249e7a4-c802-4523-893f-4f7ce9ed4e1c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:45.113465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 820/1605] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:04:44 2022] PUT /identity/v3/projects/4914886561974d358b06b99d1582d906/users/5b244089f61f45cb812788ef46c15af5/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:45.114314 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249e7a4-c802-4523-893f-4f7ce9ed4e1c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:45.152921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2926116-0221-4b44-b7e5-f4b31cabf5c5 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:45.176497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249e7a4-c802-4523-893f-4f7ce9ed4e1c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:45.182148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6d040-880a-42cf-8a85-a0edc8c23779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:45.183039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6d040-880a-42cf-8a85-a0edc8c23779 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:45.183315 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6d040-880a-42cf-8a85-a0edc8c23779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:45.183596 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6d040-880a-42cf-8a85-a0edc8c23779 admin admin] PATH_INFO: `/v3/projects/6c8bdfbc6a3a4e9283f3affbff5f4bd6/users/3c219710094943748fdd037ebf0bf448/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:45.186066 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:45.201780 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6d040-880a-42cf-8a85-a0edc8c23779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c8bdfbc6a3a4e9283f3affbff5f4bd6, user_id=3c219710094943748fdd037ebf0bf448, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:45.204616 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6d040-880a-42cf-8a85-a0edc8c23779 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:45.214255 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551ac0b-169c-4aa8-b41f-f456ce3b745e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:45.215167 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551ac0b-169c-4aa8-b41f-f456ce3b745e admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:45.215450 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551ac0b-169c-4aa8-b41f-f456ce3b745e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:45.215725 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551ac0b-169c-4aa8-b41f-f456ce3b745e admin admin] PATH_INFO: `/v3/projects/d2d9f362b6844df2b1e604aa20002edf/users/917700ed75464456a056f42c446eaf6a/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:45.219414 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 821/1606] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:04:45 2022] PUT /identity/v3/projects/6c8bdfbc6a3a4e9283f3affbff5f4bd6/users/3c219710094943748fdd037ebf0bf448/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:45.220071 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6d040-880a-42cf-8a85-a0edc8c23779 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:45.230800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551ac0b-169c-4aa8-b41f-f456ce3b745e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d9f362b6844df2b1e604aa20002edf, user_id=917700ed75464456a056f42c446eaf6a, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:45.233519 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551ac0b-169c-4aa8-b41f-f456ce3b745e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:45.236556 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:45.247768 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 786/1607] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:04:45 2022] PUT /identity/v3/projects/d2d9f362b6844df2b1e604aa20002edf/users/917700ed75464456a056f42c446eaf6a/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:45.249505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551ac0b-169c-4aa8-b41f-f456ce3b745e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:45.286811 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6d040-880a-42cf-8a85-a0edc8c23779 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:45.327652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551ac0b-169c-4aa8-b41f-f456ce3b745e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:45.334041 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c8d6e-b3f5-492d-a5c3-ab40b69b8285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:45.335102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c8d6e-b3f5-492d-a5c3-ab40b69b8285 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:45.335434 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c8d6e-b3f5-492d-a5c3-ab40b69b8285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:45.335706 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c8d6e-b3f5-492d-a5c3-ab40b69b8285 admin admin] PATH_INFO: `/v3/projects/27e7c801a7c24ec3ad1ef849b7857eea/users/7f9dd2124bf24588bc3525e9f7b8ec38/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:45.347494 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e04808-759e-41f5-8616-eb4a329f402d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:45.348213 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e04808-759e-41f5-8616-eb4a329f402d admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:45.348494 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e04808-759e-41f5-8616-eb4a329f402d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:45.348822 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e04808-759e-41f5-8616-eb4a329f402d admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:45.349602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e04808-759e-41f5-8616-eb4a329f402d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:45.351949 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e04808-759e-41f5-8616-eb4a329f402d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:45.355616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c8d6e-b3f5-492d-a5c3-ab40b69b8285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27e7c801a7c24ec3ad1ef849b7857eea, user_id=7f9dd2124bf24588bc3525e9f7b8ec38, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:45.358417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c8d6e-b3f5-492d-a5c3-ab40b69b8285 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:45.362028 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 822/1608] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:45.363470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519ed4b-ca2f-41d2-881d-22af5ace472b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:45.363694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519ed4b-ca2f-41d2-881d-22af5ace472b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:45.363969 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519ed4b-ca2f-41d2-881d-22af5ace472b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:45.376952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 787/1609] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:04:45 2022] PUT /identity/v3/projects/27e7c801a7c24ec3ad1ef849b7857eea/users/7f9dd2124bf24588bc3525e9f7b8ec38/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:45.378226 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c8d6e-b3f5-492d-a5c3-ab40b69b8285 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:45.381852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cd5c8d6e-b3f5-492d-a5c3-ab40b69b8285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:45.400275 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e519ed4b-ca2f-41d2-881d-22af5ace472b None None] MFA Rules not processed for user `49584496baed4538b25ffdb3071278cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:45.401542 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e519ed4b-ca2f-41d2-881d-22af5ace472b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:45.443345 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c8d6e-b3f5-492d-a5c3-ab40b69b8285 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:45.450288 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ec9f9-e30d-49e4-98a4-3e9c9dbae8ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:45.451399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ec9f9-e30d-49e4-98a4-3e9c9dbae8ec service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:45.451892 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ec9f9-e30d-49e4-98a4-3e9c9dbae8ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:45.452370 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ec9f9-e30d-49e4-98a4-3e9c9dbae8ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:45.479851 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 823/1610] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:45.481199 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097eacc-398f-4d81-926d-3d30babe47a0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:45.481486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097eacc-398f-4d81-926d-3d30babe47a0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:45.481761 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097eacc-398f-4d81-926d-3d30babe47a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:45.499738 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1097eacc-398f-4d81-926d-3d30babe47a0 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:45.501047 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1097eacc-398f-4d81-926d-3d30babe47a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:45.510762 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:45.527684 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ec9f9-e30d-49e4-98a4-3e9c9dbae8ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:45.529467 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ec9f9-e30d-49e4-98a4-3e9c9dbae8ec service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:45.539054 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 788/1611] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:04:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:04:45.540547 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13506aa-a711-4c41-88ac-e5e0e55a570b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:45.540869 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13506aa-a711-4c41-88ac-e5e0e55a570b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:45.541153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13506aa-a711-4c41-88ac-e5e0e55a570b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:45.559716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e13506aa-a711-4c41-88ac-e5e0e55a570b None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:45.560980 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e13506aa-a711-4c41-88ac-e5e0e55a570b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:45.566198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 824/1612] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:45.566794 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097eacc-398f-4d81-926d-3d30babe47a0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:45.574747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 789/1613] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:45.577825 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097eacc-398f-4d81-926d-3d30babe47a0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:45.579320 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414179c-985d-4144-a61a-caa9c6080b52 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:45.579618 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414179c-985d-4144-a61a-caa9c6080b52 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:45.579903 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414179c-985d-4144-a61a-caa9c6080b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:45.583589 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0575c-f994-44ed-a7e7-b22ea4657962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:45.584279 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0575c-f994-44ed-a7e7-b22ea4657962 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:45.584677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0575c-f994-44ed-a7e7-b22ea4657962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:45.585053 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0575c-f994-44ed-a7e7-b22ea4657962 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:45.585926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0575c-f994-44ed-a7e7-b22ea4657962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:45.587664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0575c-f994-44ed-a7e7-b22ea4657962 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:45.600849 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 825/1614] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:45.601321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2414179c-985d-4144-a61a-caa9c6080b52 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:45.601870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0575c-f994-44ed-a7e7-b22ea4657962 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:45.602971 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2414179c-985d-4144-a61a-caa9c6080b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:45.612215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 790/1615] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:45.613983 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337364a-6b9f-45c3-943b-df81c3e48f46 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:45.614258 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337364a-6b9f-45c3-943b-df81c3e48f46 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:45.614564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337364a-6b9f-45c3-943b-df81c3e48f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:45.621376 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0575c-f994-44ed-a7e7-b22ea4657962 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:45.629839 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84425237-2901-4cb2-9d5c-1c8c2f96952c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:45.631175 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84425237-2901-4cb2-9d5c-1c8c2f96952c admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:45.631711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84425237-2901-4cb2-9d5c-1c8c2f96952c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:45.632000 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84425237-2901-4cb2-9d5c-1c8c2f96952c admin admin] PATH_INFO: `/v3/projects/2167ae2f6e064cfb9b45af3ecec53dae/users/e2204cf895ec4575a3a6e9296b34f849/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:45.651116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3337364a-6b9f-45c3-943b-df81c3e48f46 None None] MFA Rules not processed for user `7f9dd2124bf24588bc3525e9f7b8ec38`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:45.651988 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84425237-2901-4cb2-9d5c-1c8c2f96952c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2167ae2f6e064cfb9b45af3ecec53dae, user_id=e2204cf895ec4575a3a6e9296b34f849, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:45.652338 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3337364a-6b9f-45c3-943b-df81c3e48f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:45.656543 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84425237-2901-4cb2-9d5c-1c8c2f96952c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:45.663237 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:45.676565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 826/1616] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:04:45 2022] PUT /identity/v3/projects/2167ae2f6e064cfb9b45af3ecec53dae/users/e2204cf895ec4575a3a6e9296b34f849/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:45.677417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84425237-2901-4cb2-9d5c-1c8c2f96952c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:45.743579 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 791/1617] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:45 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:45.743579 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337364a-6b9f-45c3-943b-df81c3e48f46 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:45.758021 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337364a-6b9f-45c3-943b-df81c3e48f46 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:45.758439 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84425237-2901-4cb2-9d5c-1c8c2f96952c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:45.765505 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313a517-bdf6-40a3-be05-25dfcb48cda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:45.766232 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313a517-bdf6-40a3-be05-25dfcb48cda0 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:45.766545 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313a517-bdf6-40a3-be05-25dfcb48cda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:45.766827 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313a517-bdf6-40a3-be05-25dfcb48cda0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:45.767553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313a517-bdf6-40a3-be05-25dfcb48cda0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:45.769644 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313a517-bdf6-40a3-be05-25dfcb48cda0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:45.809967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 827/1618] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:04:45 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:45.810930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313a517-bdf6-40a3-be05-25dfcb48cda0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:45.826721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217402d-d806-4710-aad8-d6b505eebfbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:45.827656 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217402d-d806-4710-aad8-d6b505eebfbf service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:45.828348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217402d-d806-4710-aad8-d6b505eebfbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:45.828660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217402d-d806-4710-aad8-d6b505eebfbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:45.839943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217402d-d806-4710-aad8-d6b505eebfbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:45.841860 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217402d-d806-4710-aad8-d6b505eebfbf service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:45.855339 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 792/1619] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:04:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:04:45.856472 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217402d-d806-4710-aad8-d6b505eebfbf service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:45.868272 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217402d-d806-4710-aad8-d6b505eebfbf service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:45.871460 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313a517-bdf6-40a3-be05-25dfcb48cda0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:45.875835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a00d0-9062-499b-8a0c-6cefb8641f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:45.876506 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a00d0-9062-499b-8a0c-6cefb8641f48 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:45.876815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a00d0-9062-499b-8a0c-6cefb8641f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:45.877071 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a00d0-9062-499b-8a0c-6cefb8641f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:45.913518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:45.953325 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c27c5-d015-41f0-b5ff-02305ee7047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:45.954805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c27c5-d015-41f0-b5ff-02305ee7047f admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:45.955097 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c27c5-d015-41f0-b5ff-02305ee7047f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:45.955786 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c27c5-d015-41f0-b5ff-02305ee7047f admin admin] PATH_INFO: `/v3/projects/6c8bdfbc6a3a4e9283f3affbff5f4bd6/users/3c219710094943748fdd037ebf0bf448/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:45.959020 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c27c5-d015-41f0-b5ff-02305ee7047f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c8bdfbc6a3a4e9283f3affbff5f4bd6, user_id=3c219710094943748fdd037ebf0bf448, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:45.962592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c27c5-d015-41f0-b5ff-02305ee7047f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:45.978121 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 793/1620] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:04:45 2022] PUT /identity/v3/projects/6c8bdfbc6a3a4e9283f3affbff5f4bd6/users/3c219710094943748fdd037ebf0bf448/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:45.987296 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c27c5-d015-41f0-b5ff-02305ee7047f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:45.987418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a00d0-9062-499b-8a0c-6cefb8641f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:45.987418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a00d0-9062-499b-8a0c-6cefb8641f48 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:45.996998 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 828/1621] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:04:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:04:45.998595 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d5fb0-f100-4502-8381-0b0a363c4056 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:45.998988 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d5fb0-f100-4502-8381-0b0a363c4056 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:45.999430 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d5fb0-f100-4502-8381-0b0a363c4056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:46.030449 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-990d5fb0-f100-4502-8381-0b0a363c4056 None None] MFA Rules not processed for user `e2204cf895ec4575a3a6e9296b34f849`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:46.032015 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-990d5fb0-f100-4502-8381-0b0a363c4056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:46.073390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:46.083200 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c27c5-d015-41f0-b5ff-02305ee7047f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:46.089584 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00234824-a6a8-4584-967f-1923f5d138dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:46.090705 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00234824-a6a8-4584-967f-1923f5d138dc service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:46.091150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00234824-a6a8-4584-967f-1923f5d138dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:46.092135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00234824-a6a8-4584-967f-1923f5d138dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:46.124999 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 829/1622] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:46.124999 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d5fb0-f100-4502-8381-0b0a363c4056 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:46.173637 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00234824-a6a8-4584-967f-1923f5d138dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:46.175048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00234824-a6a8-4584-967f-1923f5d138dc service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:46.187817 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 794/1623] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:04:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:04:46.188669 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00234824-a6a8-4584-967f-1923f5d138dc service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:46.197756 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d5fb0-f100-4502-8381-0b0a363c4056 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:46.198971 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00234824-a6a8-4584-967f-1923f5d138dc service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:46.204860 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d2480-5e28-457b-955e-7e6b74f8f7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:46.205111 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b52a35-4243-44a0-9b34-5b8a6d0f45f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:46.205554 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d2480-5e28-457b-955e-7e6b74f8f7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:46.205808 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b52a35-4243-44a0-9b34-5b8a6d0f45f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:46.205903 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d2480-5e28-457b-955e-7e6b74f8f7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:46.206100 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d2480-5e28-457b-955e-7e6b74f8f7d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:46.206197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b52a35-4243-44a0-9b34-5b8a6d0f45f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:46.206400 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b52a35-4243-44a0-9b34-5b8a6d0f45f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:46.206799 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d2480-5e28-457b-955e-7e6b74f8f7d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:46.207118 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b52a35-4243-44a0-9b34-5b8a6d0f45f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:46.208757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d2480-5e28-457b-955e-7e6b74f8f7d3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:46.209191 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b52a35-4243-44a0-9b34-5b8a6d0f45f3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:46.235270 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 795/1624] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:04:46 2022] POST /identity/v3/users => generated 295 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:46.236196 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b52a35-4243-44a0-9b34-5b8a6d0f45f3 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:46.240661 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 830/1625] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:04:46 2022] POST /identity/v3/projects => generated 409 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:46.241577 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c821f14-5d35-49dc-af9e-0ff86af76d54 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:46.241893 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c821f14-5d35-49dc-af9e-0ff86af76d54 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:46.242235 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c821f14-5d35-49dc-af9e-0ff86af76d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:46.249865 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b52a35-4243-44a0-9b34-5b8a6d0f45f3 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:46.276532 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8c821f14-5d35-49dc-af9e-0ff86af76d54 None None] MFA Rules not processed for user `3c219710094943748fdd037ebf0bf448`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:46.277843 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8c821f14-5d35-49dc-af9e-0ff86af76d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:46.300470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:46.315631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2b5e6-bbb0-4e0c-a655-eafe2083b14b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:46.317323 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2b5e6-bbb0-4e0c-a655-eafe2083b14b service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:46.317874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2b5e6-bbb0-4e0c-a655-eafe2083b14b service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:46.318307 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2b5e6-bbb0-4e0c-a655-eafe2083b14b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:46.370524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 831/1626] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:46 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:46.372389 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c821f14-5d35-49dc-af9e-0ff86af76d54 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:46.399073 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2b5e6-bbb0-4e0c-a655-eafe2083b14b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:46.401192 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2b5e6-bbb0-4e0c-a655-eafe2083b14b service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:46.417606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 796/1627] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:04:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:04:46.418294 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2b5e6-bbb0-4e0c-a655-eafe2083b14b service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:46.469041 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:46.495008 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c821f14-5d35-49dc-af9e-0ff86af76d54 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:46.503958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575be991-c2b2-4fcd-889b-b6e3d5410123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:46.505718 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575be991-c2b2-4fcd-889b-b6e3d5410123 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:46.506713 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575be991-c2b2-4fcd-889b-b6e3d5410123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:46.506713 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575be991-c2b2-4fcd-889b-b6e3d5410123 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:46.507823 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575be991-c2b2-4fcd-889b-b6e3d5410123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:46.510070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575be991-c2b2-4fcd-889b-b6e3d5410123 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:46.526837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2b5e6-bbb0-4e0c-a655-eafe2083b14b service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:46.535544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305eb105-7583-4df1-afc4-2e12b2a4493b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:46.537010 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305eb105-7583-4df1-afc4-2e12b2a4493b admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:46.537935 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305eb105-7583-4df1-afc4-2e12b2a4493b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:46.538301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305eb105-7583-4df1-afc4-2e12b2a4493b admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:46.539594 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305eb105-7583-4df1-afc4-2e12b2a4493b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:46.542158 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305eb105-7583-4df1-afc4-2e12b2a4493b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:46.546265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 832/1628] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:04:46 2022] POST /identity/v3/projects => generated 391 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:46.551530 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575be991-c2b2-4fcd-889b-b6e3d5410123 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:46.557449 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 797/1629] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:46.562935 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305eb105-7583-4df1-afc4-2e12b2a4493b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:46.578672 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305eb105-7583-4df1-afc4-2e12b2a4493b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:46.658635 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575be991-c2b2-4fcd-889b-b6e3d5410123 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:46.667448 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f71b1-b9ae-40d9-a516-15267640d196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:46.668251 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f71b1-b9ae-40d9-a516-15267640d196 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:46.668576 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f71b1-b9ae-40d9-a516-15267640d196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:46.668924 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f71b1-b9ae-40d9-a516-15267640d196 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:46.669671 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f71b1-b9ae-40d9-a516-15267640d196 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:46.671956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f71b1-b9ae-40d9-a516-15267640d196 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:46.686005 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2caf90-db98-46de-8690-95015bd06006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:46.687679 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2caf90-db98-46de-8690-95015bd06006 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:46.690037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2caf90-db98-46de-8690-95015bd06006 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:46.690548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2caf90-db98-46de-8690-95015bd06006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:46.702815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 833/1630] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:04:46 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:46.703708 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f71b1-b9ae-40d9-a516-15267640d196 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:46.717783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f71b1-b9ae-40d9-a516-15267640d196 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:46.724904 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35f483-bc5a-445d-9d78-c3b6b54d8460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:46.726100 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35f483-bc5a-445d-9d78-c3b6b54d8460 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:46.726386 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35f483-bc5a-445d-9d78-c3b6b54d8460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:46.726659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35f483-bc5a-445d-9d78-c3b6b54d8460 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:46.727568 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35f483-bc5a-445d-9d78-c3b6b54d8460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:46.730913 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35f483-bc5a-445d-9d78-c3b6b54d8460 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:46.766612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 834/1631] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:04:46 2022] POST /identity/v3/users => generated 302 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:46.767592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35f483-bc5a-445d-9d78-c3b6b54d8460 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:46.783633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35f483-bc5a-445d-9d78-c3b6b54d8460 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:46.794326 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbb537-eb90-4579-9b22-cd91e21cbf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:46.796363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbb537-eb90-4579-9b22-cd91e21cbf72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:46.796877 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbb537-eb90-4579-9b22-cd91e21cbf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:46.797162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbb537-eb90-4579-9b22-cd91e21cbf72 admin admin] PATH_INFO: `/v3/projects/f6ccc1b4351841639da5d1a020d4af2c/users/e5ac569c5fd24b8ba6c608cc0980feb3/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:46.810418 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2caf90-db98-46de-8690-95015bd06006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:46.812327 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2caf90-db98-46de-8690-95015bd06006 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:46.815083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:46.824258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbb537-eb90-4579-9b22-cd91e21cbf72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ccc1b4351841639da5d1a020d4af2c, user_id=e5ac569c5fd24b8ba6c608cc0980feb3, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:46.827497 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 798/1632] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:04:46 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:04:46.828617 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2caf90-db98-46de-8690-95015bd06006 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:46.830697 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbb537-eb90-4579-9b22-cd91e21cbf72 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:46.844178 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2caf90-db98-46de-8690-95015bd06006 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:46.853334 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d72bb-5095-4d76-9cca-3c716538250d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:46.854208 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d72bb-5095-4d76-9cca-3c716538250d admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:46.854516 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d72bb-5095-4d76-9cca-3c716538250d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:46.854948 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d72bb-5095-4d76-9cca-3c716538250d admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:46.855616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d72bb-5095-4d76-9cca-3c716538250d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:46.857375 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d72bb-5095-4d76-9cca-3c716538250d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:46.860594 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 835/1633] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:04:46 2022] PUT /identity/v3/projects/f6ccc1b4351841639da5d1a020d4af2c/users/e5ac569c5fd24b8ba6c608cc0980feb3/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:46.861918 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbb537-eb90-4579-9b22-cd91e21cbf72 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:46.873707 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 799/1634] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:46.875143 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d72bb-5095-4d76-9cca-3c716538250d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:46.890688 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d72bb-5095-4d76-9cca-3c716538250d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:46.982993 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbb537-eb90-4579-9b22-cd91e21cbf72 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:46.988170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078bb64-866c-4dbd-bb80-af8214026f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:46.989785 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078bb64-866c-4dbd-bb80-af8214026f6c admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:46.990171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078bb64-866c-4dbd-bb80-af8214026f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:46.990639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078bb64-866c-4dbd-bb80-af8214026f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:46.991653 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078bb64-866c-4dbd-bb80-af8214026f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:46.994330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078bb64-866c-4dbd-bb80-af8214026f6c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:47.006675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 836/1635] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:47.007688 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078bb64-866c-4dbd-bb80-af8214026f6c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:47.021070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078bb64-866c-4dbd-bb80-af8214026f6c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:47.029127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b146e7-3193-42dd-99c2-844a8c02d1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:47.030730 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b146e7-3193-42dd-99c2-844a8c02d1a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:47.031056 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b146e7-3193-42dd-99c2-844a8c02d1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:47.031439 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b146e7-3193-42dd-99c2-844a8c02d1a5 admin admin] PATH_INFO: `/v3/projects/842933ccccc84f53bdef5756f9748c5c/users/44e55f73cc244acbaa1ead1198384ee6/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:47.049258 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412fbc4-b9cb-4341-9c9e-e092d313f154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:47.050101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412fbc4-b9cb-4341-9c9e-e092d313f154 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:47.050390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412fbc4-b9cb-4341-9c9e-e092d313f154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:47.050668 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412fbc4-b9cb-4341-9c9e-e092d313f154 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:47.051404 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412fbc4-b9cb-4341-9c9e-e092d313f154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:47.054208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b146e7-3193-42dd-99c2-844a8c02d1a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=842933ccccc84f53bdef5756f9748c5c, user_id=44e55f73cc244acbaa1ead1198384ee6, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:47.056063 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412fbc4-b9cb-4341-9c9e-e092d313f154 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:47.058367 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b146e7-3193-42dd-99c2-844a8c02d1a5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:47.079194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:47.084441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 837/1636] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:04:47 2022] PUT /identity/v3/projects/842933ccccc84f53bdef5756f9748c5c/users/44e55f73cc244acbaa1ead1198384ee6/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:47.084441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b146e7-3193-42dd-99c2-844a8c02d1a5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:47.093130 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 800/1637] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:47.093130 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412fbc4-b9cb-4341-9c9e-e092d313f154 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:47.127568 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412fbc4-b9cb-4341-9c9e-e092d313f154 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:47.229605 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b146e7-3193-42dd-99c2-844a8c02d1a5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:47.238529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74693cd-0036-418e-a5f4-b26e9706489c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:47.239632 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74693cd-0036-418e-a5f4-b26e9706489c admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:47.239965 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74693cd-0036-418e-a5f4-b26e9706489c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:47.240241 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74693cd-0036-418e-a5f4-b26e9706489c admin admin] PATH_INFO: `/v3/projects/a59211539d504ceebb345077aa85585e/users/bc04f098c506472b9e40bd88247ad137/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:47.271518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74693cd-0036-418e-a5f4-b26e9706489c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a59211539d504ceebb345077aa85585e, user_id=bc04f098c506472b9e40bd88247ad137, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:47.274919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74693cd-0036-418e-a5f4-b26e9706489c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:47.282605 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80734e98-4e11-4718-89ad-0295f2d26913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:47.284005 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80734e98-4e11-4718-89ad-0295f2d26913 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:47.284539 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80734e98-4e11-4718-89ad-0295f2d26913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:47.285430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80734e98-4e11-4718-89ad-0295f2d26913 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:47.286199 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80734e98-4e11-4718-89ad-0295f2d26913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:47.288213 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80734e98-4e11-4718-89ad-0295f2d26913 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:47.311565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 838/1638] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:04:47 2022] PUT /identity/v3/projects/a59211539d504ceebb345077aa85585e/users/bc04f098c506472b9e40bd88247ad137/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:47.314242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74693cd-0036-418e-a5f4-b26e9706489c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:47.320579 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 801/1639] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:47.321603 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80734e98-4e11-4718-89ad-0295f2d26913 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:47.347187 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80734e98-4e11-4718-89ad-0295f2d26913 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:47.409746 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:47.455437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74693cd-0036-418e-a5f4-b26e9706489c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:47.461620 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296160a3-2826-4520-b932-300a61712461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:47.463480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296160a3-2826-4520-b932-300a61712461 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:47.463827 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296160a3-2826-4520-b932-300a61712461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:47.465362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296160a3-2826-4520-b932-300a61712461 admin admin] PATH_INFO: `/v3/projects/f6ccc1b4351841639da5d1a020d4af2c/users/e5ac569c5fd24b8ba6c608cc0980feb3/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:47.468642 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296160a3-2826-4520-b932-300a61712461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ccc1b4351841639da5d1a020d4af2c, user_id=e5ac569c5fd24b8ba6c608cc0980feb3, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:47.472500 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296160a3-2826-4520-b932-300a61712461 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:47.474156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4b021-3097-4948-9a91-1f3a624d380c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:47.475052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4b021-3097-4948-9a91-1f3a624d380c admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:47.475474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4b021-3097-4948-9a91-1f3a624d380c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:47.475938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4b021-3097-4948-9a91-1f3a624d380c admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:47.476679 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4b021-3097-4948-9a91-1f3a624d380c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:47.478345 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4b021-3097-4948-9a91-1f3a624d380c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:47.487561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 839/1640] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:04:47 2022] PUT /identity/v3/projects/f6ccc1b4351841639da5d1a020d4af2c/users/e5ac569c5fd24b8ba6c608cc0980feb3/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:47.488955 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296160a3-2826-4520-b932-300a61712461 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:47.505908 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 802/1641] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:47.505908 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e609e-a090-4534-85ef-ce14333f6823 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:47.505908 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e609e-a090-4534-85ef-ce14333f6823 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:47.516978 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e609e-a090-4534-85ef-ce14333f6823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:47.568899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296160a3-2826-4520-b932-300a61712461 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:47.569751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-478e609e-a090-4534-85ef-ce14333f6823 None None] MFA Rules not processed for user `e5ac569c5fd24b8ba6c608cc0980feb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:47.571002 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-478e609e-a090-4534-85ef-ce14333f6823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:47.575015 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bb807-ac50-41a3-8432-7bf3707d42c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:47.575713 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bb807-ac50-41a3-8432-7bf3707d42c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:47.576438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bb807-ac50-41a3-8432-7bf3707d42c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:47.576438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bb807-ac50-41a3-8432-7bf3707d42c1 admin admin] PATH_INFO: `/v3/projects/842933ccccc84f53bdef5756f9748c5c/users/44e55f73cc244acbaa1ead1198384ee6/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:47.578955 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5bb807-ac50-41a3-8432-7bf3707d42c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=842933ccccc84f53bdef5756f9748c5c, user_id=44e55f73cc244acbaa1ead1198384ee6, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:47.582560 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5bb807-ac50-41a3-8432-7bf3707d42c1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:47.599626 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 840/1642] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:04:47 2022] PUT /identity/v3/projects/842933ccccc84f53bdef5756f9748c5c/users/44e55f73cc244acbaa1ead1198384ee6/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:47.600807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bb807-ac50-41a3-8432-7bf3707d42c1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:47.684785 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bb807-ac50-41a3-8432-7bf3707d42c1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:47.690410 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f091748-bc78-4351-a84b-a426226ac9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:47.692249 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f091748-bc78-4351-a84b-a426226ac9df admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:47.692708 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f091748-bc78-4351-a84b-a426226ac9df admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:47.693122 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f091748-bc78-4351-a84b-a426226ac9df admin admin] PATH_INFO: `/v3/projects/a59211539d504ceebb345077aa85585e/users/bc04f098c506472b9e40bd88247ad137/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:47.695508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f091748-bc78-4351-a84b-a426226ac9df admin admin] RBAC: Authorizing `identity:create_grant(project_id=a59211539d504ceebb345077aa85585e, user_id=bc04f098c506472b9e40bd88247ad137, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:47.699243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f091748-bc78-4351-a84b-a426226ac9df admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:47.731368 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 841/1643] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:04:47 2022] PUT /identity/v3/projects/a59211539d504ceebb345077aa85585e/users/bc04f098c506472b9e40bd88247ad137/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:47.731368 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0d986-a584-475d-8fc8-d89b0fd75a7f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:47.731368 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0d986-a584-475d-8fc8-d89b0fd75a7f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:47.731368 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0d986-a584-475d-8fc8-d89b0fd75a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:47.733717 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 803/1644] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:47.735093 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f74c5-7b08-46ee-b1dc-50c7eaffdbf6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:47.735381 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f74c5-7b08-46ee-b1dc-50c7eaffdbf6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:47.735658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f74c5-7b08-46ee-b1dc-50c7eaffdbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:47.780282 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-40c0d986-a584-475d-8fc8-d89b0fd75a7f None None] MFA Rules not processed for user `44e55f73cc244acbaa1ead1198384ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:47.781692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-40c0d986-a584-475d-8fc8-d89b0fd75a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:47.790051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ad9f74c5-7b08-46ee-b1dc-50c7eaffdbf6 None None] MFA Rules not processed for user `bc04f098c506472b9e40bd88247ad137`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:47.791671 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ad9f74c5-7b08-46ee-b1dc-50c7eaffdbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:47.802857 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:47.871916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:47.896659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 842/1645] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:47 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:47.897602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0d986-a584-475d-8fc8-d89b0fd75a7f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:47.934372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 804/1646] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:47.936997 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f74c5-7b08-46ee-b1dc-50c7eaffdbf6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:47.974674 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0d986-a584-475d-8fc8-d89b0fd75a7f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:47.980070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24672ec-05f6-4065-b5e9-30f9dd966cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:47.980957 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24672ec-05f6-4065-b5e9-30f9dd966cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:47.981368 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24672ec-05f6-4065-b5e9-30f9dd966cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:47.981733 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24672ec-05f6-4065-b5e9-30f9dd966cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:48.067325 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f74c5-7b08-46ee-b1dc-50c7eaffdbf6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:48.079067 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7cc80-d8c3-49db-b5c2-a502c909fd86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:48.079610 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7cc80-d8c3-49db-b5c2-a502c909fd86 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:48.080022 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7cc80-d8c3-49db-b5c2-a502c909fd86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:48.080311 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7cc80-d8c3-49db-b5c2-a502c909fd86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:48.083597 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24672ec-05f6-4065-b5e9-30f9dd966cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:48.085429 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24672ec-05f6-4065-b5e9-30f9dd966cd9 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:48.105228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7cc80-d8c3-49db-b5c2-a502c909fd86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:48.108091 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7cc80-d8c3-49db-b5c2-a502c909fd86 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:48.108532 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 843/1647] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:04:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:04:48.109604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24672ec-05f6-4065-b5e9-30f9dd966cd9 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:48.119153 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24672ec-05f6-4065-b5e9-30f9dd966cd9 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:48.140341 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 805/1648] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:04:47 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:04:48.147309 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bf201-acec-4057-ae06-4e7d44236e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:48.148012 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bf201-acec-4057-ae06-4e7d44236e38 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:48.148291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bf201-acec-4057-ae06-4e7d44236e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:48.148559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bf201-acec-4057-ae06-4e7d44236e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:48.224144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419bf201-acec-4057-ae06-4e7d44236e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:48.225800 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419bf201-acec-4057-ae06-4e7d44236e38 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:48.237047 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 844/1649] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:04:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:04:49.972983 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36b17c-79ed-474f-bca1-eadbbce89bae None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:49.973537 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36b17c-79ed-474f-bca1-eadbbce89bae None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:49.973537 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36b17c-79ed-474f-bca1-eadbbce89bae None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:49.975165 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 806/1650] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 19 11:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:04:50.038011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca645a-0960-49ea-981a-138039cb6193 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:50.038011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca645a-0960-49ea-981a-138039cb6193 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:50.038011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca645a-0960-49ea-981a-138039cb6193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:50.078461 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b1ca645a-0960-49ea-981a-138039cb6193 None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:50.080170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b1ca645a-0960-49ea-981a-138039cb6193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:50.191134 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:50.271376 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 845/1651] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 11:04:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:50.456123 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36b17c-79ed-474f-bca1-eadbbce89bae None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:50.480784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36b17c-79ed-474f-bca1-eadbbce89bae None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:50.487061 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82688d6-e37c-4294-8a19-5b7b377203ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:50.487786 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82688d6-e37c-4294-8a19-5b7b377203ce service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:50.488182 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82688d6-e37c-4294-8a19-5b7b377203ce service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:50.488528 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82688d6-e37c-4294-8a19-5b7b377203ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:50.502130 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82688d6-e37c-4294-8a19-5b7b377203ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:50.503850 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82688d6-e37c-4294-8a19-5b7b377203ce service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:50.524797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 807/1652] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:04:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:04:52.801044 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca645a-0960-49ea-981a-138039cb6193 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:52.891614 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca645a-0960-49ea-981a-138039cb6193 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:52.897887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357b72e-de2f-4354-afe5-6bfb76ffbf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:52.899153 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357b72e-de2f-4354-afe5-6bfb76ffbf5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:52.899663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357b72e-de2f-4354-afe5-6bfb76ffbf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:52.900123 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357b72e-de2f-4354-afe5-6bfb76ffbf5b admin admin] PATH_INFO: `/v3/users/8bb9553fcf0243a1ba805fa404d34ecf` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:52.901909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357b72e-de2f-4354-afe5-6bfb76ffbf5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bb9553fcf0243a1ba805fa404d34ecf)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:52.904964 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357b72e-de2f-4354-afe5-6bfb76ffbf5b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:52.999056 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9357b72e-de2f-4354-afe5-6bfb76ffbf5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bb9553fcf0243a1ba805fa404d34ecf'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:53.011026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9357b72e-de2f-4354-afe5-6bfb76ffbf5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bb9553fcf0243a1ba805fa404d34ecf'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:53.023823 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9357b72e-de2f-4354-afe5-6bfb76ffbf5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bb9553fcf0243a1ba805fa404d34ecf'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:53.025408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9357b72e-de2f-4354-afe5-6bfb76ffbf5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bb9553fcf0243a1ba805fa404d34ecf'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:53.026301 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9357b72e-de2f-4354-afe5-6bfb76ffbf5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bb9553fcf0243a1ba805fa404d34ecf'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:53.076161 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 846/1653] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:04:52 2022] DELETE /identity/v3/users/8bb9553fcf0243a1ba805fa404d34ecf => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:53.077880 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b1e29-985e-471c-b319-7996560a1169 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:53.078775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b1e29-985e-471c-b319-7996560a1169 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:53.079240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b1e29-985e-471c-b319-7996560a1169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:53.099652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1a6b1e29-985e-471c-b319-7996560a1169 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:53.101245 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1a6b1e29-985e-471c-b319-7996560a1169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:53.166281 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 808/1654] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:53.230982 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357b72e-de2f-4354-afe5-6bfb76ffbf5b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:53.232450 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9357b72e-de2f-4354-afe5-6bfb76ffbf5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:53.318142 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357b72e-de2f-4354-afe5-6bfb76ffbf5b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:53.324321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe881272-c2fe-4f61-9a9d-4b119680b19e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:53.325654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe881272-c2fe-4f61-9a9d-4b119680b19e service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:53.326413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe881272-c2fe-4f61-9a9d-4b119680b19e service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:53.326885 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe881272-c2fe-4f61-9a9d-4b119680b19e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:53.346046 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe881272-c2fe-4f61-9a9d-4b119680b19e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:53.348799 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe881272-c2fe-4f61-9a9d-4b119680b19e service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:53.355556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:53.372517 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 847/1655] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:04:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:04:55.359109 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b1e29-985e-471c-b319-7996560a1169 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:55.361292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1a6b1e29-985e-471c-b319-7996560a1169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:55.381039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b1e29-985e-471c-b319-7996560a1169 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:55.400676 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a6561-c51e-4c8a-9bd9-d13f62b0b7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:55.402476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a6561-c51e-4c8a-9bd9-d13f62b0b7cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:55.402735 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a6561-c51e-4c8a-9bd9-d13f62b0b7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:55.405234 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a6561-c51e-4c8a-9bd9-d13f62b0b7cc admin admin] PATH_INFO: `/v3/projects/49664a2646a148818aec3a13d84def0e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:55.407858 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a6561-c51e-4c8a-9bd9-d13f62b0b7cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=49664a2646a148818aec3a13d84def0e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:55.414500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a6561-c51e-4c8a-9bd9-d13f62b0b7cc admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:55.484838 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:55.514899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b48a6561-c51e-4c8a-9bd9-d13f62b0b7cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49664a2646a148818aec3a13d84def0e', 'request_id': 'req-b48a6561-c51e-4c8a-9bd9-d13f62b0b7cc'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:55.531227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b48a6561-c51e-4c8a-9bd9-d13f62b0b7cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49664a2646a148818aec3a13d84def0e', 'request_id': 'req-b48a6561-c51e-4c8a-9bd9-d13f62b0b7cc'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:55.560206 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b48a6561-c51e-4c8a-9bd9-d13f62b0b7cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49664a2646a148818aec3a13d84def0e', 'request_id': 'req-b48a6561-c51e-4c8a-9bd9-d13f62b0b7cc'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:55.597825 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b48a6561-c51e-4c8a-9bd9-d13f62b0b7cc admin admin] The token cache is being invalidate because project 49664a2646a148818aec3a13d84def0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:04:55.598131 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b48a6561-c51e-4c8a-9bd9-d13f62b0b7cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:55.601439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b48a6561-c51e-4c8a-9bd9-d13f62b0b7cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:55.608664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 809/1656] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:04:55 2022] DELETE /identity/v3/projects/49664a2646a148818aec3a13d84def0e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:55.609438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe881272-c2fe-4f61-9a9d-4b119680b19e service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:55.625224 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe881272-c2fe-4f61-9a9d-4b119680b19e service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:55.769316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf4d25-9728-4c49-80e5-ce6cbad5decc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:55.770416 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf4d25-9728-4c49-80e5-ce6cbad5decc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:55.770835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf4d25-9728-4c49-80e5-ce6cbad5decc admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:55.771724 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf4d25-9728-4c49-80e5-ce6cbad5decc admin admin] PATH_INFO: `/v3/users/3c219710094943748fdd037ebf0bf448` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:55.775550 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf4d25-9728-4c49-80e5-ce6cbad5decc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c219710094943748fdd037ebf0bf448)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:55.779036 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf4d25-9728-4c49-80e5-ce6cbad5decc admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:55.885024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a6561-c51e-4c8a-9bd9-d13f62b0b7cc admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:55.885613 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8adf4d25-9728-4c49-80e5-ce6cbad5decc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c219710094943748fdd037ebf0bf448'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:55.886887 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b48a6561-c51e-4c8a-9bd9-d13f62b0b7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:55.899913 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8adf4d25-9728-4c49-80e5-ce6cbad5decc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c219710094943748fdd037ebf0bf448'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:55.912910 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a6561-c51e-4c8a-9bd9-d13f62b0b7cc admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:55.915944 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8adf4d25-9728-4c49-80e5-ce6cbad5decc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c219710094943748fdd037ebf0bf448'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:55.918269 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8adf4d25-9728-4c49-80e5-ce6cbad5decc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c219710094943748fdd037ebf0bf448'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:55.919115 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8adf4d25-9728-4c49-80e5-ce6cbad5decc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c219710094943748fdd037ebf0bf448'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:55.920876 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e80cc-9fd0-43fb-b801-0bd85ce7241d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:55.921973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e80cc-9fd0-43fb-b801-0bd85ce7241d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:55.922412 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e80cc-9fd0-43fb-b801-0bd85ce7241d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:55.922829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e80cc-9fd0-43fb-b801-0bd85ce7241d admin admin] PATH_INFO: `/v3/users/49584496baed4538b25ffdb3071278cf` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:55.928144 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e80cc-9fd0-43fb-b801-0bd85ce7241d admin admin] RBAC: Authorizing `identity:delete_user(user_id=49584496baed4538b25ffdb3071278cf)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:55.929458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: WARNING py.warnings [None req-333e80cc-9fd0-43fb-b801-0bd85ce7241d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:04:55.929458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: warnings.warn(msg) Jul 19 11:04:55.929458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: Jul 19 11:04:55.944338 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e80cc-9fd0-43fb-b801-0bd85ce7241d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:55.964066 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 848/1657] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:04:55 2022] DELETE /identity/v3/users/3c219710094943748fdd037ebf0bf448 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:56.115216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-333e80cc-9fd0-43fb-b801-0bd85ce7241d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49584496baed4538b25ffdb3071278cf'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:56.133656 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-333e80cc-9fd0-43fb-b801-0bd85ce7241d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49584496baed4538b25ffdb3071278cf'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:56.210667 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-333e80cc-9fd0-43fb-b801-0bd85ce7241d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49584496baed4538b25ffdb3071278cf'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:56.214184 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-333e80cc-9fd0-43fb-b801-0bd85ce7241d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49584496baed4538b25ffdb3071278cf'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:56.251709 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-333e80cc-9fd0-43fb-b801-0bd85ce7241d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49584496baed4538b25ffdb3071278cf'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:56.274617 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 810/1658] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:04:55 2022] DELETE /identity/v3/users/49584496baed4538b25ffdb3071278cf => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:56.279349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1b710-17a8-4e48-a83e-a4c947853806 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:56.279762 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1b710-17a8-4e48-a83e-a4c947853806 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:56.280174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1b710-17a8-4e48-a83e-a4c947853806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:56.304984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-05d1b710-17a8-4e48-a83e-a4c947853806 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:56.307291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-05d1b710-17a8-4e48-a83e-a4c947853806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:56.475432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 849/1659] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:56.505173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e80cc-9fd0-43fb-b801-0bd85ce7241d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:56.506845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-333e80cc-9fd0-43fb-b801-0bd85ce7241d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:56.629032 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e80cc-9fd0-43fb-b801-0bd85ce7241d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:56.632242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d263ee-971e-4292-ab55-0f9eb8de3b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:56.633270 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d263ee-971e-4292-ab55-0f9eb8de3b88 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:56.633680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d263ee-971e-4292-ab55-0f9eb8de3b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:56.634058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d263ee-971e-4292-ab55-0f9eb8de3b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:56.653435 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d263ee-971e-4292-ab55-0f9eb8de3b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:56.655068 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d263ee-971e-4292-ab55-0f9eb8de3b88 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:56.686821 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 811/1660] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:04:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:04:57.608817 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1b710-17a8-4e48-a83e-a4c947853806 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:57.611567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-05d1b710-17a8-4e48-a83e-a4c947853806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:57.632199 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1b710-17a8-4e48-a83e-a4c947853806 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:57.649485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af0761-7411-406d-aee5-da5147a0b2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:57.650320 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af0761-7411-406d-aee5-da5147a0b2ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:57.650622 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af0761-7411-406d-aee5-da5147a0b2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:57.656912 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af0761-7411-406d-aee5-da5147a0b2ad admin admin] PATH_INFO: `/v3/users/7f9dd2124bf24588bc3525e9f7b8ec38` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:57.660854 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af0761-7411-406d-aee5-da5147a0b2ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f9dd2124bf24588bc3525e9f7b8ec38)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:57.669636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af0761-7411-406d-aee5-da5147a0b2ad admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:57.701343 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:57.835181 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-19af0761-7411-406d-aee5-da5147a0b2ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f9dd2124bf24588bc3525e9f7b8ec38'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:57.874655 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-19af0761-7411-406d-aee5-da5147a0b2ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f9dd2124bf24588bc3525e9f7b8ec38'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:57.916210 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-19af0761-7411-406d-aee5-da5147a0b2ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f9dd2124bf24588bc3525e9f7b8ec38'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:57.917200 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-19af0761-7411-406d-aee5-da5147a0b2ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f9dd2124bf24588bc3525e9f7b8ec38'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:57.924562 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-19af0761-7411-406d-aee5-da5147a0b2ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f9dd2124bf24588bc3525e9f7b8ec38'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:57.962518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 850/1661] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:04:57 2022] DELETE /identity/v3/users/7f9dd2124bf24588bc3525e9f7b8ec38 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:57.966613 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb51f0-0a56-41e8-adb7-b47f39fd5cea None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:57.967129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb51f0-0a56-41e8-adb7-b47f39fd5cea None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:57.967257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb51f0-0a56-41e8-adb7-b47f39fd5cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:57.995360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-11fb51f0-0a56-41e8-adb7-b47f39fd5cea None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:57.997022 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-11fb51f0-0a56-41e8-adb7-b47f39fd5cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:58.025874 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af0761-7411-406d-aee5-da5147a0b2ad admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:58.027999 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-19af0761-7411-406d-aee5-da5147a0b2ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:58.065711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:58.160047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 812/1662] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:04:58.270830 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb51f0-0a56-41e8-adb7-b47f39fd5cea None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:58.273506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-11fb51f0-0a56-41e8-adb7-b47f39fd5cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:58.284759 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af0761-7411-406d-aee5-da5147a0b2ad admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:58.301439 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feccc2e-f8bd-42bd-9970-95709e604cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:58.303894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feccc2e-f8bd-42bd-9970-95709e604cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:58.304203 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feccc2e-f8bd-42bd-9970-95709e604cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:58.304486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feccc2e-f8bd-42bd-9970-95709e604cc4 admin admin] PATH_INFO: `/v3/projects/6c8bdfbc6a3a4e9283f3affbff5f4bd6` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:58.309145 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feccc2e-f8bd-42bd-9970-95709e604cc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c8bdfbc6a3a4e9283f3affbff5f4bd6)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:58.316923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: WARNING py.warnings [None req-2feccc2e-f8bd-42bd-9970-95709e604cc4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:04:58.316923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: warnings.warn(msg) Jul 19 11:04:58.316923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: Jul 19 11:04:58.320299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feccc2e-f8bd-42bd-9970-95709e604cc4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:58.474197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb51f0-0a56-41e8-adb7-b47f39fd5cea None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:58.495777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616b49c-c169-4731-9026-ad532e6605b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:58.496652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616b49c-c169-4731-9026-ad532e6605b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:58.496968 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616b49c-c169-4731-9026-ad532e6605b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:58.497244 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616b49c-c169-4731-9026-ad532e6605b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:58.545326 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2feccc2e-f8bd-42bd-9970-95709e604cc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c8bdfbc6a3a4e9283f3affbff5f4bd6', 'request_id': 'req-2feccc2e-f8bd-42bd-9970-95709e604cc4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:58.559577 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616b49c-c169-4731-9026-ad532e6605b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:58.561534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616b49c-c169-4731-9026-ad532e6605b7 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:58.602773 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 813/1663] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:04:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:04:58.607615 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2feccc2e-f8bd-42bd-9970-95709e604cc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c8bdfbc6a3a4e9283f3affbff5f4bd6', 'request_id': 'req-2feccc2e-f8bd-42bd-9970-95709e604cc4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:58.630189 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2feccc2e-f8bd-42bd-9970-95709e604cc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c8bdfbc6a3a4e9283f3affbff5f4bd6', 'request_id': 'req-2feccc2e-f8bd-42bd-9970-95709e604cc4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:58.660317 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2feccc2e-f8bd-42bd-9970-95709e604cc4 admin admin] The token cache is being invalidate because project 6c8bdfbc6a3a4e9283f3affbff5f4bd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:04:58.660750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2feccc2e-f8bd-42bd-9970-95709e604cc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:58.669431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2feccc2e-f8bd-42bd-9970-95709e604cc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:58.671888 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 851/1664] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:04:58 2022] DELETE /identity/v3/projects/6c8bdfbc6a3a4e9283f3affbff5f4bd6 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:04:58.676886 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f8790-278e-4722-8bbd-1421eb17e95b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:58.677211 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f8790-278e-4722-8bbd-1421eb17e95b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:58.677601 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f8790-278e-4722-8bbd-1421eb17e95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:58.719934 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fa9f8790-278e-4722-8bbd-1421eb17e95b None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:58.722970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fa9f8790-278e-4722-8bbd-1421eb17e95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:58.934189 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd107b-24a5-4be2-944b-ff1e7cbf2c79 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:58.934544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd107b-24a5-4be2-944b-ff1e7cbf2c79 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:58.934885 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd107b-24a5-4be2-944b-ff1e7cbf2c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:58.941255 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 814/1665] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:58.979288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e8fd107b-24a5-4be2-944b-ff1e7cbf2c79 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:04:58.983147 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e8fd107b-24a5-4be2-944b-ff1e7cbf2c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:59.013481 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 852/1666] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:04:59.021555 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f8790-278e-4722-8bbd-1421eb17e95b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:59.037024 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd107b-24a5-4be2-944b-ff1e7cbf2c79 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:59.039025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e8fd107b-24a5-4be2-944b-ff1e7cbf2c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:59.046092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f8790-278e-4722-8bbd-1421eb17e95b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:59.058218 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd107b-24a5-4be2-944b-ff1e7cbf2c79 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:59.073550 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219318e-acd8-4aa1-828b-fe2936aad783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:59.074162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219318e-acd8-4aa1-828b-fe2936aad783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:59.075365 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219318e-acd8-4aa1-828b-fe2936aad783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:59.075649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219318e-acd8-4aa1-828b-fe2936aad783 admin admin] PATH_INFO: `/v3/projects/981e27010c2240ba806b4ef571526be4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:59.079226 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219318e-acd8-4aa1-828b-fe2936aad783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=981e27010c2240ba806b4ef571526be4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:59.079344 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf576d72-8150-43e6-b2f1-7c537fffee9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:59.082383 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf576d72-8150-43e6-b2f1-7c537fffee9c admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:59.084818 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219318e-acd8-4aa1-828b-fe2936aad783 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:59.087426 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf576d72-8150-43e6-b2f1-7c537fffee9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:59.087897 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf576d72-8150-43e6-b2f1-7c537fffee9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:59.090662 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf576d72-8150-43e6-b2f1-7c537fffee9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:04:59.091226 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf576d72-8150-43e6-b2f1-7c537fffee9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:59.097419 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf576d72-8150-43e6-b2f1-7c537fffee9c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:59.109744 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:59.155549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 815/1667] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:04:59.161806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf576d72-8150-43e6-b2f1-7c537fffee9c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:59.198754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf576d72-8150-43e6-b2f1-7c537fffee9c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:59.239156 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1219318e-acd8-4aa1-828b-fe2936aad783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '981e27010c2240ba806b4ef571526be4', 'request_id': 'req-1219318e-acd8-4aa1-828b-fe2936aad783'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:59.276092 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1219318e-acd8-4aa1-828b-fe2936aad783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '981e27010c2240ba806b4ef571526be4', 'request_id': 'req-1219318e-acd8-4aa1-828b-fe2936aad783'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:59.310338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1219318e-acd8-4aa1-828b-fe2936aad783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '981e27010c2240ba806b4ef571526be4', 'request_id': 'req-1219318e-acd8-4aa1-828b-fe2936aad783'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:59.363910 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1219318e-acd8-4aa1-828b-fe2936aad783 admin admin] The token cache is being invalidate because project 981e27010c2240ba806b4ef571526be4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:04:59.365061 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1219318e-acd8-4aa1-828b-fe2936aad783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:59.369080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1219318e-acd8-4aa1-828b-fe2936aad783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:59.372357 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbfa65-0583-4d87-9652-18b225d5d5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:59.373169 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbfa65-0583-4d87-9652-18b225d5d5dd admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:59.373457 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbfa65-0583-4d87-9652-18b225d5d5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:59.373736 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbfa65-0583-4d87-9652-18b225d5d5dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:59.374542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dbfa65-0583-4d87-9652-18b225d5d5dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:59.375758 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 853/1668] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:04:59 2022] DELETE /identity/v3/projects/981e27010c2240ba806b4ef571526be4 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:59.382236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219318e-acd8-4aa1-828b-fe2936aad783 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:59.383260 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dbfa65-0583-4d87-9652-18b225d5d5dd admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:59.384275 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1219318e-acd8-4aa1-828b-fe2936aad783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:59.401728 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:59.412204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219318e-acd8-4aa1-828b-fe2936aad783 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:59.426647 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3524f-cd72-4e51-9848-10cc645ab0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:59.427039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3524f-cd72-4e51-9848-10cc645ab0a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:59.430736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3524f-cd72-4e51-9848-10cc645ab0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:59.431027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3524f-cd72-4e51-9848-10cc645ab0a0 admin admin] PATH_INFO: `/v3/users/e5ac569c5fd24b8ba6c608cc0980feb3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:59.434239 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 816/1669] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:04:59 2022] POST /identity/v3/projects => generated 405 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:59.438510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3524f-cd72-4e51-9848-10cc645ab0a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5ac569c5fd24b8ba6c608cc0980feb3)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:59.439225 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbfa65-0583-4d87-9652-18b225d5d5dd admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:59.440697 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3524f-cd72-4e51-9848-10cc645ab0a0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:59.444975 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-64dbfa65-0583-4d87-9652-18b225d5d5dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:59.603037 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f4f3524f-cd72-4e51-9848-10cc645ab0a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5ac569c5fd24b8ba6c608cc0980feb3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:59.617486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f4f3524f-cd72-4e51-9848-10cc645ab0a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5ac569c5fd24b8ba6c608cc0980feb3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:59.636210 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f4f3524f-cd72-4e51-9848-10cc645ab0a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5ac569c5fd24b8ba6c608cc0980feb3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:59.639574 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f4f3524f-cd72-4e51-9848-10cc645ab0a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5ac569c5fd24b8ba6c608cc0980feb3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:59.645204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f4f3524f-cd72-4e51-9848-10cc645ab0a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5ac569c5fd24b8ba6c608cc0980feb3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:04:59.647852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbfa65-0583-4d87-9652-18b225d5d5dd admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:59.656837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658f889-4a21-49fe-9e18-dc93dfdbca21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:59.657616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658f889-4a21-49fe-9e18-dc93dfdbca21 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:59.658458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658f889-4a21-49fe-9e18-dc93dfdbca21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:59.658840 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658f889-4a21-49fe-9e18-dc93dfdbca21 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:59.659615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658f889-4a21-49fe-9e18-dc93dfdbca21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:59.663802 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658f889-4a21-49fe-9e18-dc93dfdbca21 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:59.682115 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 854/1670] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:04:59 2022] DELETE /identity/v3/users/e5ac569c5fd24b8ba6c608cc0980feb3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:04:59.700544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3524f-cd72-4e51-9848-10cc645ab0a0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:59.700862 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 817/1671] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:04:59 2022] POST /identity/v3/users => generated 303 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:04:59.702498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f4f3524f-cd72-4e51-9848-10cc645ab0a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:04:59.795384 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3524f-cd72-4e51-9848-10cc645ab0a0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:59.803170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0142cb4-9d0a-4d12-a6ce-1a35ca27c97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:59.804488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0142cb4-9d0a-4d12-a6ce-1a35ca27c97b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:59.804908 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0142cb4-9d0a-4d12-a6ce-1a35ca27c97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:59.805244 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0142cb4-9d0a-4d12-a6ce-1a35ca27c97b admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:59.806099 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0142cb4-9d0a-4d12-a6ce-1a35ca27c97b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:59.808228 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0142cb4-9d0a-4d12-a6ce-1a35ca27c97b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:59.823418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 855/1672] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:04:59.827677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658f889-4a21-49fe-9e18-dc93dfdbca21 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:59.842589 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658f889-4a21-49fe-9e18-dc93dfdbca21 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:59.855061 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb032c64-3ae8-465e-ae36-d33ddcf7c0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:59.855943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb032c64-3ae8-465e-ae36-d33ddcf7c0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:59.856699 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb032c64-3ae8-465e-ae36-d33ddcf7c0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:59.858827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb032c64-3ae8-465e-ae36-d33ddcf7c0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:59.859664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb032c64-3ae8-465e-ae36-d33ddcf7c0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:59.862087 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb032c64-3ae8-465e-ae36-d33ddcf7c0e9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:04:59.891205 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 818/1673] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:04:59.896225 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0142cb4-9d0a-4d12-a6ce-1a35ca27c97b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:04:59.905009 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:04:59.913496 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0142cb4-9d0a-4d12-a6ce-1a35ca27c97b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:04:59.926199 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5653a-666c-47db-acc4-157c8f6e9fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:04:59.927161 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5653a-666c-47db-acc4-157c8f6e9fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:04:59.927481 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5653a-666c-47db-acc4-157c8f6e9fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:04:59.927753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5653a-666c-47db-acc4-157c8f6e9fbb admin admin] PATH_INFO: `/v3/projects/38493b8cf46f4b94a95575ba0272dd8b/users/d387ad98d01b4071bad7861470fceebb/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:04:59.950487 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5653a-666c-47db-acc4-157c8f6e9fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=38493b8cf46f4b94a95575ba0272dd8b, user_id=d387ad98d01b4071bad7861470fceebb, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:04:59.954550 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5653a-666c-47db-acc4-157c8f6e9fbb admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:00.000305 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 856/1674] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:04:59 2022] PUT /identity/v3/projects/38493b8cf46f4b94a95575ba0272dd8b/users/d387ad98d01b4071bad7861470fceebb/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:00.005821 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9e2d6-9a5c-45af-8255-3837876eb4db None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:00.006130 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9e2d6-9a5c-45af-8255-3837876eb4db None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:00.006390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9e2d6-9a5c-45af-8255-3837876eb4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:00.064456 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c1d9e2d6-9a5c-45af-8255-3837876eb4db None None] MFA Rules not processed for user `d387ad98d01b4071bad7861470fceebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:00.065731 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c1d9e2d6-9a5c-45af-8255-3837876eb4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:00.158176 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5653a-666c-47db-acc4-157c8f6e9fbb admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:00.159325 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 819/1675] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:00 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:00.278691 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5653a-666c-47db-acc4-157c8f6e9fbb admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:00.304873 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ad812-c39a-48f9-bbfd-0649c2e216b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:00.305704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ad812-c39a-48f9-bbfd-0649c2e216b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:00.305996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ad812-c39a-48f9-bbfd-0649c2e216b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:00.306275 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ad812-c39a-48f9-bbfd-0649c2e216b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:00.307531 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ad812-c39a-48f9-bbfd-0649c2e216b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:00.310455 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ad812-c39a-48f9-bbfd-0649c2e216b4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:00.370034 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 857/1676] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:05:00 2022] POST /identity/v3/projects => generated 403 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:00.375507 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9e2d6-9a5c-45af-8255-3837876eb4db None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:00.395667 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9e2d6-9a5c-45af-8255-3837876eb4db None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:00.533667 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:00.558592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b95b8-89d5-48da-bb15-64becbb8e4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:00.560426 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b95b8-89d5-48da-bb15-64becbb8e4cf admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:00.560881 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b95b8-89d5-48da-bb15-64becbb8e4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:00.561344 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b95b8-89d5-48da-bb15-64becbb8e4cf admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:00.562121 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b95b8-89d5-48da-bb15-64becbb8e4cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:00.573042 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b95b8-89d5-48da-bb15-64becbb8e4cf admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:00.622490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 820/1677] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:05:00 2022] POST /identity/v3/users => generated 308 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:00.628088 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ad812-c39a-48f9-bbfd-0649c2e216b4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:00.657318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ad812-c39a-48f9-bbfd-0649c2e216b4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:00.676543 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e26d71-2c08-44be-9ef0-55cf100a6f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:00.681226 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e26d71-2c08-44be-9ef0-55cf100a6f7c admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:00.681648 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e26d71-2c08-44be-9ef0-55cf100a6f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:00.682032 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e26d71-2c08-44be-9ef0-55cf100a6f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:00.684635 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e26d71-2c08-44be-9ef0-55cf100a6f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:00.696557 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e26d71-2c08-44be-9ef0-55cf100a6f7c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:00.731917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 858/1678] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:05:00.733791 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b95b8-89d5-48da-bb15-64becbb8e4cf admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:00.749442 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b95b8-89d5-48da-bb15-64becbb8e4cf admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:00.760743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ca86f-e790-4936-b441-f7575c6fad4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:00.762155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ca86f-e790-4936-b441-f7575c6fad4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:00.762617 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ca86f-e790-4936-b441-f7575c6fad4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:00.763829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ca86f-e790-4936-b441-f7575c6fad4f admin admin] PATH_INFO: `/v3/projects/efbadbdac50143ef878bd0a653fd1242/users/bf315aa1abf64a40920978425723f63f/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:00.802174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ca86f-e790-4936-b441-f7575c6fad4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=efbadbdac50143ef878bd0a653fd1242, user_id=bf315aa1abf64a40920978425723f63f, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:00.805911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ca86f-e790-4936-b441-f7575c6fad4f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:00.840910 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 821/1679] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:05:00 2022] PUT /identity/v3/projects/efbadbdac50143ef878bd0a653fd1242/users/bf315aa1abf64a40920978425723f63f/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:05:00.844881 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e26d71-2c08-44be-9ef0-55cf100a6f7c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:00.857647 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e26d71-2c08-44be-9ef0-55cf100a6f7c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:00.978348 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a968e81-6401-4a36-89ff-3deb9f88b604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:00.979123 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a968e81-6401-4a36-89ff-3deb9f88b604 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:00.979360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a968e81-6401-4a36-89ff-3deb9f88b604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:00.979627 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a968e81-6401-4a36-89ff-3deb9f88b604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:00.980364 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a968e81-6401-4a36-89ff-3deb9f88b604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:00.986812 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a968e81-6401-4a36-89ff-3deb9f88b604 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:01.019704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 859/1680] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:05:01.023437 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ca86f-e790-4936-b441-f7575c6fad4f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:01.038265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ca86f-e790-4936-b441-f7575c6fad4f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:01.044207 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54ae51-b03b-45f3-a6ff-f874c8e2d08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:01.045466 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54ae51-b03b-45f3-a6ff-f874c8e2d08c admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:01.055423 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54ae51-b03b-45f3-a6ff-f874c8e2d08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:01.055858 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54ae51-b03b-45f3-a6ff-f874c8e2d08c admin admin] PATH_INFO: `/v3/projects/efbadbdac50143ef878bd0a653fd1242/users/bf315aa1abf64a40920978425723f63f/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:01.059595 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54ae51-b03b-45f3-a6ff-f874c8e2d08c admin admin] RBAC: Authorizing `identity:create_grant(project_id=efbadbdac50143ef878bd0a653fd1242, user_id=bf315aa1abf64a40920978425723f63f, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:01.063109 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54ae51-b03b-45f3-a6ff-f874c8e2d08c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:01.086450 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 822/1681] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:05:01 2022] PUT /identity/v3/projects/efbadbdac50143ef878bd0a653fd1242/users/bf315aa1abf64a40920978425723f63f/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:05:01.098793 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688de7f2-1755-4b4e-9935-20412dd264ee None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:01.099171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688de7f2-1755-4b4e-9935-20412dd264ee None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:01.099651 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688de7f2-1755-4b4e-9935-20412dd264ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:01.157927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-688de7f2-1755-4b4e-9935-20412dd264ee None None] MFA Rules not processed for user `bf315aa1abf64a40920978425723f63f`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:01.159636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-688de7f2-1755-4b4e-9935-20412dd264ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:01.231550 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:01.307498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 860/1682] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:01 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:01.442343 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54ae51-b03b-45f3-a6ff-f874c8e2d08c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:01.444831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fc54ae51-b03b-45f3-a6ff-f874c8e2d08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:01.575550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54ae51-b03b-45f3-a6ff-f874c8e2d08c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:01.584984 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a825d-08e0-4065-8c45-13807da38da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:01.585670 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a825d-08e0-4065-8c45-13807da38da9 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:01.586341 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a825d-08e0-4065-8c45-13807da38da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:01.586341 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a825d-08e0-4065-8c45-13807da38da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:01.588353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688de7f2-1755-4b4e-9935-20412dd264ee None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:01.615260 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688de7f2-1755-4b4e-9935-20412dd264ee None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:01.621221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efc3a0-05a2-406b-9454-7fe59ed1ec8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:01.622223 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efc3a0-05a2-406b-9454-7fe59ed1ec8a service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:01.622626 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efc3a0-05a2-406b-9454-7fe59ed1ec8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:01.623512 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efc3a0-05a2-406b-9454-7fe59ed1ec8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:01.625705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-23efc3a0-05a2-406b-9454-7fe59ed1ec8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:01.687774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a825d-08e0-4065-8c45-13807da38da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:01.690328 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a825d-08e0-4065-8c45-13807da38da9 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:01.708301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 823/1683] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:01 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:01.710341 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace827ff-7af2-4d9b-99b4-753508214aee None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:01.710701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace827ff-7af2-4d9b-99b4-753508214aee None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:01.711515 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace827ff-7af2-4d9b-99b4-753508214aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:01.718697 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23efc3a0-05a2-406b-9454-7fe59ed1ec8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:01.721108 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23efc3a0-05a2-406b-9454-7fe59ed1ec8a service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:01.739946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 861/1684] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:01 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:01.757377 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ace827ff-7af2-4d9b-99b4-753508214aee None None] MFA Rules not processed for user `02696270934b4ea3a6e83746599f64ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:01.759142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ace827ff-7af2-4d9b-99b4-753508214aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:01.823499 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:01.852821 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 824/1685] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:01.877888 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298e272-efc3-418d-bea4-6b5056ad9e96 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:01.878425 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298e272-efc3-418d-bea4-6b5056ad9e96 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:01.878894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298e272-efc3-418d-bea4-6b5056ad9e96 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:01.880606 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 862/1686] 10.222.0.18 () {54 vars in 962 bytes} [Tue Jul 19 11:05:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:05:01.898546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347adc2-cd59-40c4-83da-9a872d2333a3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:01.898856 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347adc2-cd59-40c4-83da-9a872d2333a3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:01.899133 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347adc2-cd59-40c4-83da-9a872d2333a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:01.956769 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d347adc2-cd59-40c4-83da-9a872d2333a3 None None] MFA Rules not processed for user `3c50a821e9ef44cb9fccd49ee4af7dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:01.958353 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d347adc2-cd59-40c4-83da-9a872d2333a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:02.058422 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 825/1687] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Jul 19 11:05:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:02.071974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298e272-efc3-418d-bea4-6b5056ad9e96 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:02.091140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298e272-efc3-418d-bea4-6b5056ad9e96 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:02.097957 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67b534-789d-42fc-98e8-b53e6289099e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:02.098965 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67b534-789d-42fc-98e8-b53e6289099e service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:02.099366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67b534-789d-42fc-98e8-b53e6289099e service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:02.100167 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67b534-789d-42fc-98e8-b53e6289099e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:02.109755 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347adc2-cd59-40c4-83da-9a872d2333a3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:02.111447 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d347adc2-cd59-40c4-83da-9a872d2333a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:02.123770 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67b534-789d-42fc-98e8-b53e6289099e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:02.127341 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67b534-789d-42fc-98e8-b53e6289099e service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:02.167387 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 863/1688] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:02.266263 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347adc2-cd59-40c4-83da-9a872d2333a3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:02.280254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4ea0f-5a51-4091-b602-2899a018b693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:02.281185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4ea0f-5a51-4091-b602-2899a018b693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:02.281468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4ea0f-5a51-4091-b602-2899a018b693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:02.281740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4ea0f-5a51-4091-b602-2899a018b693 admin admin] PATH_INFO: `/v3/projects/f6ccc1b4351841639da5d1a020d4af2c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:02.285080 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4ea0f-5a51-4091-b602-2899a018b693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6ccc1b4351841639da5d1a020d4af2c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:02.287093 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4ea0f-5a51-4091-b602-2899a018b693 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:02.435219 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7ac4ea0f-5a51-4091-b602-2899a018b693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6ccc1b4351841639da5d1a020d4af2c', 'request_id': 'req-7ac4ea0f-5a51-4091-b602-2899a018b693'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:02.497900 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7ac4ea0f-5a51-4091-b602-2899a018b693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6ccc1b4351841639da5d1a020d4af2c', 'request_id': 'req-7ac4ea0f-5a51-4091-b602-2899a018b693'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:02.505028 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8b228-06d0-4b50-ac33-09a668359e26 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:02.505684 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8b228-06d0-4b50-ac33-09a668359e26 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:02.506363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8b228-06d0-4b50-ac33-09a668359e26 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:02.508526 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 864/1689] 10.222.0.18 () {54 vars in 962 bytes} [Tue Jul 19 11:05:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:05:02.520528 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8b228-06d0-4b50-ac33-09a668359e26 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:02.523848 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-73d8b228-06d0-4b50-ac33-09a668359e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:02.524693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7ac4ea0f-5a51-4091-b602-2899a018b693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6ccc1b4351841639da5d1a020d4af2c', 'request_id': 'req-7ac4ea0f-5a51-4091-b602-2899a018b693'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:02.543469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:02.555817 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7ac4ea0f-5a51-4091-b602-2899a018b693 admin admin] The token cache is being invalidate because project f6ccc1b4351841639da5d1a020d4af2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:05:02.556313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7ac4ea0f-5a51-4091-b602-2899a018b693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:02.565263 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7ac4ea0f-5a51-4091-b602-2899a018b693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:02.577908 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 826/1690] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:05:02 2022] DELETE /identity/v3/projects/f6ccc1b4351841639da5d1a020d4af2c => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:02.590984 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15070897-2978-4684-9bd0-f602d3d05ed9 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:02.600193 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15070897-2978-4684-9bd0-f602d3d05ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:02.602843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15070897-2978-4684-9bd0-f602d3d05ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:02.652648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-15070897-2978-4684-9bd0-f602d3d05ed9 None None] MFA Rules not processed for user `3c50a821e9ef44cb9fccd49ee4af7dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:02.654291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-15070897-2978-4684-9bd0-f602d3d05ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:02.789742 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8b228-06d0-4b50-ac33-09a668359e26 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:02.805591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8df939-85a8-432d-b027-0e383e923611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:02.807337 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8df939-85a8-432d-b027-0e383e923611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:02.807620 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8df939-85a8-432d-b027-0e383e923611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:02.807863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8df939-85a8-432d-b027-0e383e923611 admin admin] PATH_INFO: `/v3/projects/27e7c801a7c24ec3ad1ef849b7857eea` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:02.813049 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8df939-85a8-432d-b027-0e383e923611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27e7c801a7c24ec3ad1ef849b7857eea)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:02.819382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8df939-85a8-432d-b027-0e383e923611 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:02.836201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 827/1691] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Jul 19 11:05:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:02.838045 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d94e1-b261-4e22-b0e0-38b6b0680fdd None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:02.840459 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d94e1-b261-4e22-b0e0-38b6b0680fdd None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:02.841007 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d94e1-b261-4e22-b0e0-38b6b0680fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:02.886722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-0c9d94e1-b261-4e22-b0e0-38b6b0680fdd None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:02.888598 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0c9d94e1-b261-4e22-b0e0-38b6b0680fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:02.906089 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 828/1692] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:02.916678 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d94e1-b261-4e22-b0e0-38b6b0680fdd None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:02.940974 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d94e1-b261-4e22-b0e0-38b6b0680fdd None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:02.979498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4e8df939-85a8-432d-b027-0e383e923611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27e7c801a7c24ec3ad1ef849b7857eea', 'request_id': 'req-4e8df939-85a8-432d-b027-0e383e923611'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:02.996684 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4e8df939-85a8-432d-b027-0e383e923611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27e7c801a7c24ec3ad1ef849b7857eea', 'request_id': 'req-4e8df939-85a8-432d-b027-0e383e923611'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:03.002673 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:03.005073 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4e8df939-85a8-432d-b027-0e383e923611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27e7c801a7c24ec3ad1ef849b7857eea', 'request_id': 'req-4e8df939-85a8-432d-b027-0e383e923611'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:03.035111 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4e8df939-85a8-432d-b027-0e383e923611 admin admin] The token cache is being invalidate because project 27e7c801a7c24ec3ad1ef849b7857eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:05:03.035490 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4e8df939-85a8-432d-b027-0e383e923611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:03.037240 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4e8df939-85a8-432d-b027-0e383e923611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:03.050886 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 865/1693] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:05:02 2022] DELETE /identity/v3/projects/27e7c801a7c24ec3ad1ef849b7857eea => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:03.052608 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c5aa2-70eb-4e4b-ac09-06de09ba0389 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:03.054933 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c5aa2-70eb-4e4b-ac09-06de09ba0389 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:03.055249 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c5aa2-70eb-4e4b-ac09-06de09ba0389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:03.071651 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd580db1-83ed-424d-958f-7976de569fd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:03.073235 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd580db1-83ed-424d-958f-7976de569fd4 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:03.073887 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd580db1-83ed-424d-958f-7976de569fd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:03.074795 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd580db1-83ed-424d-958f-7976de569fd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:03.079527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fd580db1-83ed-424d-958f-7976de569fd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:03.132647 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-cd3c5aa2-70eb-4e4b-ac09-06de09ba0389 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:03.141183 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cd3c5aa2-70eb-4e4b-ac09-06de09ba0389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:03.179054 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd580db1-83ed-424d-958f-7976de569fd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:03.182656 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd580db1-83ed-424d-958f-7976de569fd4 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:03.195001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 829/1694] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:02 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:03.196344 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd580db1-83ed-424d-958f-7976de569fd4 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:03.198780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fd580db1-83ed-424d-958f-7976de569fd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:03.224132 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:03.288772 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd580db1-83ed-424d-958f-7976de569fd4 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:03.295310 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0f073-09c6-43d0-b881-bff42bcb4e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:03.296246 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0f073-09c6-43d0-b881-bff42bcb4e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:03.296778 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0f073-09c6-43d0-b881-bff42bcb4e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:03.297226 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0f073-09c6-43d0-b881-bff42bcb4e29 admin admin] PATH_INFO: `/v3/users/44e55f73cc244acbaa1ead1198384ee6` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:03.299777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0f073-09c6-43d0-b881-bff42bcb4e29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e55f73cc244acbaa1ead1198384ee6)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:03.302760 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0f073-09c6-43d0-b881-bff42bcb4e29 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:03.353942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 866/1695] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:03.355855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0f47c-8e85-4667-9fb4-1ff68d75697b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:03.356149 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0f47c-8e85-4667-9fb4-1ff68d75697b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:03.356472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0f47c-8e85-4667-9fb4-1ff68d75697b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:03.385575 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-efb0f073-09c6-43d0-b881-bff42bcb4e29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e55f73cc244acbaa1ead1198384ee6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:03.387699 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a7d0f47c-8e85-4667-9fb4-1ff68d75697b None None] MFA Rules not processed for user `917700ed75464456a056f42c446eaf6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:03.390153 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a7d0f47c-8e85-4667-9fb4-1ff68d75697b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:03.402669 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-efb0f073-09c6-43d0-b881-bff42bcb4e29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e55f73cc244acbaa1ead1198384ee6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:03.437012 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-efb0f073-09c6-43d0-b881-bff42bcb4e29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e55f73cc244acbaa1ead1198384ee6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:03.444021 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-efb0f073-09c6-43d0-b881-bff42bcb4e29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e55f73cc244acbaa1ead1198384ee6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:03.458125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-efb0f073-09c6-43d0-b881-bff42bcb4e29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e55f73cc244acbaa1ead1198384ee6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:03.475656 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 830/1696] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:05:03 2022] DELETE /identity/v3/users/44e55f73cc244acbaa1ead1198384ee6 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:03.477444 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0f073-09c6-43d0-b881-bff42bcb4e29 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:03.480654 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-efb0f073-09c6-43d0-b881-bff42bcb4e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:03.569434 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 867/1697] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:03.587938 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0f47c-8e85-4667-9fb4-1ff68d75697b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:03.589847 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a7d0f47c-8e85-4667-9fb4-1ff68d75697b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:03.622885 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0f47c-8e85-4667-9fb4-1ff68d75697b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:03.640750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0f073-09c6-43d0-b881-bff42bcb4e29 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:03.651027 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f65c46-29a8-4d34-9000-4623684e04f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:03.653219 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f65c46-29a8-4d34-9000-4623684e04f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:03.654726 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f65c46-29a8-4d34-9000-4623684e04f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:03.655781 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f65c46-29a8-4d34-9000-4623684e04f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:03.658052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f65c46-29a8-4d34-9000-4623684e04f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:05:03.662058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f65c46-29a8-4d34-9000-4623684e04f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:03.664052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f65c46-29a8-4d34-9000-4623684e04f0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:03.711195 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 831/1698] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:05:03.712178 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f65c46-29a8-4d34-9000-4623684e04f0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:03.736829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f65c46-29a8-4d34-9000-4623684e04f0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:03.750453 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28b8fd-c5e7-4daf-aae9-3a7a9056771c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:03.751149 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28b8fd-c5e7-4daf-aae9-3a7a9056771c admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:03.751433 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28b8fd-c5e7-4daf-aae9-3a7a9056771c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:03.751710 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28b8fd-c5e7-4daf-aae9-3a7a9056771c admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:03.757605 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28b8fd-c5e7-4daf-aae9-3a7a9056771c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:03.759592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28b8fd-c5e7-4daf-aae9-3a7a9056771c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:03.784380 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426129ed-71ce-4c8b-9a50-0b06c76201fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:03.787650 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426129ed-71ce-4c8b-9a50-0b06c76201fd service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:03.788048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426129ed-71ce-4c8b-9a50-0b06c76201fd service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:03.788427 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426129ed-71ce-4c8b-9a50-0b06c76201fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:03.818939 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:03.846453 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 832/1699] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:05:03 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:03.850259 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931986a-f6bf-40c8-8175-01621f847159 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:03.852726 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931986a-f6bf-40c8-8175-01621f847159 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:03.853032 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931986a-f6bf-40c8-8175-01621f847159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:03.905860 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:03.931409 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4931986a-f6bf-40c8-8175-01621f847159 None None] MFA Rules not processed for user `5b244089f61f45cb812788ef46c15af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:03.938625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4931986a-f6bf-40c8-8175-01621f847159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:03.940995 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426129ed-71ce-4c8b-9a50-0b06c76201fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:03.944620 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426129ed-71ce-4c8b-9a50-0b06c76201fd service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:03.985490 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 868/1700] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:03.987153 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426129ed-71ce-4c8b-9a50-0b06c76201fd service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:04.014698 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426129ed-71ce-4c8b-9a50-0b06c76201fd service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:04.077728 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 833/1701] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:04.102618 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931986a-f6bf-40c8-8175-01621f847159 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:04.105128 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4931986a-f6bf-40c8-8175-01621f847159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:04.143314 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7b9c1-1db2-4119-99c1-62912338b608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:04.144139 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7b9c1-1db2-4119-99c1-62912338b608 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:04.144488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7b9c1-1db2-4119-99c1-62912338b608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:04.144909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7b9c1-1db2-4119-99c1-62912338b608 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:04.145702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7b9c1-1db2-4119-99c1-62912338b608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:04.148729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7b9c1-1db2-4119-99c1-62912338b608 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:04.183196 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 869/1702] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:05:03 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:04.185485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7b9c1-1db2-4119-99c1-62912338b608 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:04.202640 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7b9c1-1db2-4119-99c1-62912338b608 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:04.221754 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de4ac5-6f51-4ada-be17-1c617c6983ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:04.230359 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de4ac5-6f51-4ada-be17-1c617c6983ab admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:04.230359 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de4ac5-6f51-4ada-be17-1c617c6983ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:04.230359 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de4ac5-6f51-4ada-be17-1c617c6983ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:04.230359 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de4ac5-6f51-4ada-be17-1c617c6983ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:04.238312 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de4ac5-6f51-4ada-be17-1c617c6983ab admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:04.273715 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 870/1703] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:05:04.276274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de4ac5-6f51-4ada-be17-1c617c6983ab admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:04.299891 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de4ac5-6f51-4ada-be17-1c617c6983ab admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:04.303780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931986a-f6bf-40c8-8175-01621f847159 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:04.321673 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7f008-f5bc-43f1-9d19-515fc3de0a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:04.323099 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7f008-f5bc-43f1-9d19-515fc3de0a9a admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:04.326076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7f008-f5bc-43f1-9d19-515fc3de0a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:04.326076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7f008-f5bc-43f1-9d19-515fc3de0a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:04.331099 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7f008-f5bc-43f1-9d19-515fc3de0a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:04.332038 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7f008-f5bc-43f1-9d19-515fc3de0a9a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:04.335138 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817a7ce-1b6c-4946-8e6c-26f7cb82b048 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:04.335945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817a7ce-1b6c-4946-8e6c-26f7cb82b048 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:04.336690 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817a7ce-1b6c-4946-8e6c-26f7cb82b048 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:04.338070 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817a7ce-1b6c-4946-8e6c-26f7cb82b048 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:04.362039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817a7ce-1b6c-4946-8e6c-26f7cb82b048 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:04.367862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 871/1704] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:05:04.368136 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817a7ce-1b6c-4946-8e6c-26f7cb82b048 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:04.369386 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7f008-f5bc-43f1-9d19-515fc3de0a9a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:04.390778 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 834/1705] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:04.391995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817a7ce-1b6c-4946-8e6c-26f7cb82b048 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:04.392459 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7f008-f5bc-43f1-9d19-515fc3de0a9a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:04.393708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b817a7ce-1b6c-4946-8e6c-26f7cb82b048 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:04.399991 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133f0e4-87d4-4646-90bf-5d63cfca87c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:04.401272 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133f0e4-87d4-4646-90bf-5d63cfca87c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:04.403018 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133f0e4-87d4-4646-90bf-5d63cfca87c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:04.403511 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133f0e4-87d4-4646-90bf-5d63cfca87c8 admin admin] PATH_INFO: `/v3/projects/557bc85f82604ed386af52a76e6fc2f7/users/7abeee7875e64588b71c2a707da9c2fe/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:04.424573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817a7ce-1b6c-4946-8e6c-26f7cb82b048 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:04.434105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133f0e4-87d4-4646-90bf-5d63cfca87c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=557bc85f82604ed386af52a76e6fc2f7, user_id=7abeee7875e64588b71c2a707da9c2fe, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:04.440850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133f0e4-87d4-4646-90bf-5d63cfca87c8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:04.446802 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb31d8a-809b-43eb-9d38-b6a73399317f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:04.447794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb31d8a-809b-43eb-9d38-b6a73399317f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:04.448077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb31d8a-809b-43eb-9d38-b6a73399317f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:04.448411 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb31d8a-809b-43eb-9d38-b6a73399317f admin admin] PATH_INFO: `/v3/projects/842933ccccc84f53bdef5756f9748c5c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:04.449841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb31d8a-809b-43eb-9d38-b6a73399317f admin admin] RBAC: Authorizing `identity:delete_project(project_id=842933ccccc84f53bdef5756f9748c5c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:04.451831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb31d8a-809b-43eb-9d38-b6a73399317f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:04.488022 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 872/1706] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:05:04 2022] PUT /identity/v3/projects/557bc85f82604ed386af52a76e6fc2f7/users/7abeee7875e64588b71c2a707da9c2fe/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:05:04.504878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10b32c-92de-4f60-98c7-f0d354181583 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:04.506583 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10b32c-92de-4f60-98c7-f0d354181583 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:04.507716 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10b32c-92de-4f60-98c7-f0d354181583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:04.668239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2f10b32c-92de-4f60-98c7-f0d354181583 None None] MFA Rules not processed for user `7abeee7875e64588b71c2a707da9c2fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:04.677279 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2f10b32c-92de-4f60-98c7-f0d354181583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:04.709800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4bb31d8a-809b-43eb-9d38-b6a73399317f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '842933ccccc84f53bdef5756f9748c5c', 'request_id': 'req-4bb31d8a-809b-43eb-9d38-b6a73399317f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:04.779618 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4bb31d8a-809b-43eb-9d38-b6a73399317f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '842933ccccc84f53bdef5756f9748c5c', 'request_id': 'req-4bb31d8a-809b-43eb-9d38-b6a73399317f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:04.817091 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4bb31d8a-809b-43eb-9d38-b6a73399317f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '842933ccccc84f53bdef5756f9748c5c', 'request_id': 'req-4bb31d8a-809b-43eb-9d38-b6a73399317f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:04.867006 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4bb31d8a-809b-43eb-9d38-b6a73399317f admin admin] The token cache is being invalidate because project 842933ccccc84f53bdef5756f9748c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:05:04.867778 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4bb31d8a-809b-43eb-9d38-b6a73399317f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:04.868877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4bb31d8a-809b-43eb-9d38-b6a73399317f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:04.875600 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 835/1707] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:05:04 2022] DELETE /identity/v3/projects/842933ccccc84f53bdef5756f9748c5c => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:04.895270 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbd3fb-fd32-48b0-a668-cfc77a4c6b1e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:04.896300 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbd3fb-fd32-48b0-a668-cfc77a4c6b1e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:04.897003 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbd3fb-fd32-48b0-a668-cfc77a4c6b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:04.901900 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:04.937741 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:04.958544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-aecbd3fb-fd32-48b0-a668-cfc77a4c6b1e None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:04.958544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-aecbd3fb-fd32-48b0-a668-cfc77a4c6b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:04.958933 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 873/1708] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:05.006446 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10b32c-92de-4f60-98c7-f0d354181583 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:05.007886 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2f10b32c-92de-4f60-98c7-f0d354181583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:05.157975 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 836/1709] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:05:05.166363 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3eac1-5e0a-4747-8889-0abd6f981e56 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:05.166924 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3eac1-5e0a-4747-8889-0abd6f981e56 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:05.167364 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3eac1-5e0a-4747-8889-0abd6f981e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:05.202489 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10b32c-92de-4f60-98c7-f0d354181583 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:05.207371 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f2e3eac1-5e0a-4747-8889-0abd6f981e56 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:05.209668 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f2e3eac1-5e0a-4747-8889-0abd6f981e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:05.217182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c12d7-685c-417b-800a-a7b910a96a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:05.217881 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c12d7-685c-417b-800a-a7b910a96a32 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:05.218163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c12d7-685c-417b-800a-a7b910a96a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:05.218438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c12d7-685c-417b-800a-a7b910a96a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:05.239567 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 837/1710] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:05:05.241422 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcbcd0-289b-4eb6-9b49-a79b86bfbf7e None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:05.241809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcbcd0-289b-4eb6-9b49-a79b86bfbf7e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:05.242198 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcbcd0-289b-4eb6-9b49-a79b86bfbf7e None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:05.244098 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 838/1711] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 19 11:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:05:05.245350 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcbcd0-289b-4eb6-9b49-a79b86bfbf7e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:05.246062 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c12d7-685c-417b-800a-a7b910a96a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:05.253737 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c12d7-685c-417b-800a-a7b910a96a32 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:05.276346 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcbcd0-289b-4eb6-9b49-a79b86bfbf7e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:05.289391 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4d012-439d-47d2-9d68-d9dbbea6bf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:05.290363 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4d012-439d-47d2-9d68-d9dbbea6bf3e admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:05.290714 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4d012-439d-47d2-9d68-d9dbbea6bf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:05.291065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4d012-439d-47d2-9d68-d9dbbea6bf3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:05.291926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4d012-439d-47d2-9d68-d9dbbea6bf3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:05:05.292308 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4d012-439d-47d2-9d68-d9dbbea6bf3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:05.294734 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4d012-439d-47d2-9d68-d9dbbea6bf3e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:05.312208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 874/1712] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:05:05.314092 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3913395-a457-4368-9b9c-3686a9000345 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:05.320233 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3913395-a457-4368-9b9c-3686a9000345 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:05.322727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3913395-a457-4368-9b9c-3686a9000345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:05.326401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 839/1713] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:05:05.331457 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4d012-439d-47d2-9d68-d9dbbea6bf3e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:05.352813 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4d012-439d-47d2-9d68-d9dbbea6bf3e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:05.368792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6a6bf-b07b-4483-b012-200cf0768900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:05.369602 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6a6bf-b07b-4483-b012-200cf0768900 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:05.369966 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6a6bf-b07b-4483-b012-200cf0768900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:05.370345 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6a6bf-b07b-4483-b012-200cf0768900 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:05.371151 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6a6bf-b07b-4483-b012-200cf0768900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:05.374791 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6a6bf-b07b-4483-b012-200cf0768900 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:05.394127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e3913395-a457-4368-9b9c-3686a9000345 None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:05.395378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e3913395-a457-4368-9b9c-3686a9000345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:05.440791 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 840/1714] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:05:05 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:05:05.446583 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6a6bf-b07b-4483-b012-200cf0768900 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:05.629030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6a6bf-b07b-4483-b012-200cf0768900 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:05.640360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 875/1715] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 11:05:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:05.645558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578531bd-3a3f-4de7-a4af-2281896687b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:05.647157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578531bd-3a3f-4de7-a4af-2281896687b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:05.647564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578531bd-3a3f-4de7-a4af-2281896687b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:05.647938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578531bd-3a3f-4de7-a4af-2281896687b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:05.648771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578531bd-3a3f-4de7-a4af-2281896687b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:05.653444 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578531bd-3a3f-4de7-a4af-2281896687b9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:05.691538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3913395-a457-4368-9b9c-3686a9000345 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:05.693592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e3913395-a457-4368-9b9c-3686a9000345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:05.705662 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 841/1716] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:05:05 2022] POST /identity/v3/users => generated 287 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:05.706839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578531bd-3a3f-4de7-a4af-2281896687b9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:05.715258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3913395-a457-4368-9b9c-3686a9000345 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:05.735126 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578531bd-3a3f-4de7-a4af-2281896687b9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:05.749197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef699fa6-1c88-4367-a460-235f076eb9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:05.750012 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef699fa6-1c88-4367-a460-235f076eb9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:05.750388 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef699fa6-1c88-4367-a460-235f076eb9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:05.750757 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef699fa6-1c88-4367-a460-235f076eb9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:05.751722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef699fa6-1c88-4367-a460-235f076eb9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:05.759428 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef699fa6-1c88-4367-a460-235f076eb9c3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:05.788646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 842/1717] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:05:05.793393 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef699fa6-1c88-4367-a460-235f076eb9c3 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:05.813722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef699fa6-1c88-4367-a460-235f076eb9c3 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:05.826406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ba8dd-d587-4f87-964a-390f31bdd5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:05.827515 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ba8dd-d587-4f87-964a-390f31bdd5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:05.829046 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ba8dd-d587-4f87-964a-390f31bdd5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:05.829520 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ba8dd-d587-4f87-964a-390f31bdd5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:05.832946 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ba8dd-d587-4f87-964a-390f31bdd5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:05.834860 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ba8dd-d587-4f87-964a-390f31bdd5e9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:05.859252 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab6a0b-be3c-45d3-aaab-57b87d8736c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:05.860187 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab6a0b-be3c-45d3-aaab-57b87d8736c9 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:05.860608 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab6a0b-be3c-45d3-aaab-57b87d8736c9 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:05.861033 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab6a0b-be3c-45d3-aaab-57b87d8736c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:05.862493 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 843/1718] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:05:05.869247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ba8dd-d587-4f87-964a-390f31bdd5e9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:05.884738 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab6a0b-be3c-45d3-aaab-57b87d8736c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:05.887139 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab6a0b-be3c-45d3-aaab-57b87d8736c9 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:05.892801 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ba8dd-d587-4f87-964a-390f31bdd5e9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:05.909716 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 876/1719] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:05:05.910206 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928b3be-acb3-498a-846c-ff504c31c8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:05.911070 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928b3be-acb3-498a-846c-ff504c31c8d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:05.911637 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928b3be-acb3-498a-846c-ff504c31c8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:05.912001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928b3be-acb3-498a-846c-ff504c31c8d4 admin admin] PATH_INFO: `/v3/projects/8f50ccb20fbe402bab5821760d2fe482/users/26954cb2f6eb4184b6488d84a842183b/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:05.953668 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928b3be-acb3-498a-846c-ff504c31c8d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f50ccb20fbe402bab5821760d2fe482, user_id=26954cb2f6eb4184b6488d84a842183b, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:05.956354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928b3be-acb3-498a-846c-ff504c31c8d4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:05.990779 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 844/1720] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:05:05 2022] PUT /identity/v3/projects/8f50ccb20fbe402bab5821760d2fe482/users/26954cb2f6eb4184b6488d84a842183b/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:06.002473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46d8ed-a678-4270-ae91-5e1d55870dc9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:06.003299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46d8ed-a678-4270-ae91-5e1d55870dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:06.003991 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46d8ed-a678-4270-ae91-5e1d55870dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:06.071245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ab46d8ed-a678-4270-ae91-5e1d55870dc9 None None] MFA Rules not processed for user `26954cb2f6eb4184b6488d84a842183b`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:06.073091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ab46d8ed-a678-4270-ae91-5e1d55870dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:06.083899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:06.231660 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 877/1721] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:06.283844 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928b3be-acb3-498a-846c-ff504c31c8d4 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:06.286011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6928b3be-acb3-498a-846c-ff504c31c8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:06.299863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:06.386003 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928b3be-acb3-498a-846c-ff504c31c8d4 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:06.389980 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70ea77-9cbf-49d5-af71-26ab4ff14911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:06.390824 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70ea77-9cbf-49d5-af71-26ab4ff14911 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:06.391589 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70ea77-9cbf-49d5-af71-26ab4ff14911 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:06.391873 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70ea77-9cbf-49d5-af71-26ab4ff14911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:06.404760 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70ea77-9cbf-49d5-af71-26ab4ff14911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:06.406344 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70ea77-9cbf-49d5-af71-26ab4ff14911 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:06.420357 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 845/1722] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:08.357096 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46d8ed-a678-4270-ae91-5e1d55870dc9 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:08.360313 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ab46d8ed-a678-4270-ae91-5e1d55870dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:08.489483 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46d8ed-a678-4270-ae91-5e1d55870dc9 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:08.497273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4d35d-99c2-442b-9c8f-c2f7bcc2ef19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:08.500229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4d35d-99c2-442b-9c8f-c2f7bcc2ef19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:08.500440 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4d35d-99c2-442b-9c8f-c2f7bcc2ef19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:08.500881 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4d35d-99c2-442b-9c8f-c2f7bcc2ef19 admin admin] PATH_INFO: `/v3/users/7abeee7875e64588b71c2a707da9c2fe` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:08.502208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4d35d-99c2-442b-9c8f-c2f7bcc2ef19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7abeee7875e64588b71c2a707da9c2fe)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:08.506046 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4d35d-99c2-442b-9c8f-c2f7bcc2ef19 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:08.580030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822459c8-b917-41ba-b078-de4832a479f2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:08.580512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822459c8-b917-41ba-b078-de4832a479f2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:08.580603 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822459c8-b917-41ba-b078-de4832a479f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:08.614688 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-45d4d35d-99c2-442b-9c8f-c2f7bcc2ef19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7abeee7875e64588b71c2a707da9c2fe'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:08.617778 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-822459c8-b917-41ba-b078-de4832a479f2 None None] MFA Rules not processed for user `02696270934b4ea3a6e83746599f64ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:08.622227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-822459c8-b917-41ba-b078-de4832a479f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:08.630105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-45d4d35d-99c2-442b-9c8f-c2f7bcc2ef19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7abeee7875e64588b71c2a707da9c2fe'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:08.646817 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-45d4d35d-99c2-442b-9c8f-c2f7bcc2ef19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7abeee7875e64588b71c2a707da9c2fe'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:08.649174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-45d4d35d-99c2-442b-9c8f-c2f7bcc2ef19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7abeee7875e64588b71c2a707da9c2fe'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:08.650142 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-45d4d35d-99c2-442b-9c8f-c2f7bcc2ef19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7abeee7875e64588b71c2a707da9c2fe'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:08.706776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 878/1723] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:05:08 2022] DELETE /identity/v3/users/7abeee7875e64588b71c2a707da9c2fe => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:08.709303 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64548eec-0c13-4a6d-9c53-c3c573fece37 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:08.709701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64548eec-0c13-4a6d-9c53-c3c573fece37 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:08.710110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64548eec-0c13-4a6d-9c53-c3c573fece37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:08.748848 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-64548eec-0c13-4a6d-9c53-c3c573fece37 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:08.750596 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-64548eec-0c13-4a6d-9c53-c3c573fece37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:08.777306 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 846/1724] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:08.799442 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:08.871386 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 879/1725] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:08.885106 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af39a4-ae23-4220-bb9d-97c1587a8716 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:08.885488 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af39a4-ae23-4220-bb9d-97c1587a8716 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:08.885770 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af39a4-ae23-4220-bb9d-97c1587a8716 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:08.888008 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 847/1726] 10.222.0.18 () {54 vars in 912 bytes} [Tue Jul 19 11:05:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 11:05:08.896447 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060a190-573f-46b9-99b8-81a4e77e315f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:08.896823 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060a190-573f-46b9-99b8-81a4e77e315f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:08.897032 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060a190-573f-46b9-99b8-81a4e77e315f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:08.922703 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a060a190-573f-46b9-99b8-81a4e77e315f None None] MFA Rules not processed for user `3c50a821e9ef44cb9fccd49ee4af7dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:08.942658 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a060a190-573f-46b9-99b8-81a4e77e315f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:08.947381 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af39a4-ae23-4220-bb9d-97c1587a8716 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:08.949416 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-47af39a4-ae23-4220-bb9d-97c1587a8716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:09.132667 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af39a4-ae23-4220-bb9d-97c1587a8716 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:09.155236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 880/1727] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 19 11:05:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:09.155468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e78211-ac3a-4a9a-b077-2d1ac45d77ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:09.156050 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e78211-ac3a-4a9a-b077-2d1ac45d77ec service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:09.156342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e78211-ac3a-4a9a-b077-2d1ac45d77ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:09.156614 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e78211-ac3a-4a9a-b077-2d1ac45d77ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:09.156906 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060a190-573f-46b9-99b8-81a4e77e315f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:09.162699 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a060a190-573f-46b9-99b8-81a4e77e315f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:09.196424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e78211-ac3a-4a9a-b077-2d1ac45d77ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:09.200742 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e78211-ac3a-4a9a-b077-2d1ac45d77ec service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:09.247530 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 848/1728] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:09.286993 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060a190-573f-46b9-99b8-81a4e77e315f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:09.291076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16daa990-1d4f-408a-a84c-2920e9dd4ddd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bcfbee5a5e4016a77901d0a637da63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:09.291913 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16daa990-1d4f-408a-a84c-2920e9dd4ddd service glance] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:09.292302 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16daa990-1d4f-408a-a84c-2920e9dd4ddd service glance] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:09.292680 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16daa990-1d4f-408a-a84c-2920e9dd4ddd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:09.306983 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16daa990-1d4f-408a-a84c-2920e9dd4ddd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:09.308591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16daa990-1d4f-408a-a84c-2920e9dd4ddd service glance] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:09.330334 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 881/1729] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:05:10.527534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0417c-b213-43db-9ffa-d8a31dbe331f None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:10.528096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0417c-b213-43db-9ffa-d8a31dbe331f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:10.528096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0417c-b213-43db-9ffa-d8a31dbe331f None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:10.529807 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 849/1730] 10.222.0.18 () {54 vars in 912 bytes} [Tue Jul 19 11:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:05:10.546350 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50731bcf-6165-4adc-ba4e-1fe09cdea7db None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:10.554627 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50731bcf-6165-4adc-ba4e-1fe09cdea7db None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:10.554896 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50731bcf-6165-4adc-ba4e-1fe09cdea7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:10.656922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-50731bcf-6165-4adc-ba4e-1fe09cdea7db None None] MFA Rules not processed for user `07eaacc831ae481d99e8ab03ee295e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:10.658836 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-50731bcf-6165-4adc-ba4e-1fe09cdea7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:10.682608 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 882/1731] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 19 11:05:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:05:10.721547 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0417c-b213-43db-9ffa-d8a31dbe331f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:10.723370 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-43b0417c-b213-43db-9ffa-d8a31dbe331f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:10.751498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0417c-b213-43db-9ffa-d8a31dbe331f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:10.758226 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0deb4-41bf-4d14-9801-9482f5550736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:10.759093 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0deb4-41bf-4d14-9801-9482f5550736 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:10.759507 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0deb4-41bf-4d14-9801-9482f5550736 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:10.760897 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0deb4-41bf-4d14-9801-9482f5550736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:10.782493 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0deb4-41bf-4d14-9801-9482f5550736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:10.785002 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0deb4-41bf-4d14-9801-9482f5550736 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:10.800257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 850/1732] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:11.604903 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda8ec1-e52f-4331-b30c-f96704bf51e6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:11.605312 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda8ec1-e52f-4331-b30c-f96704bf51e6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:11.605312 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda8ec1-e52f-4331-b30c-f96704bf51e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:11.614831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0deb4-41bf-4d14-9801-9482f5550736 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:11.616317 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e9c0deb4-41bf-4d14-9801-9482f5550736 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:11.643599 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0deb4-41bf-4d14-9801-9482f5550736 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:11.643833 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ffda8ec1-e52f-4331-b30c-f96704bf51e6 None None] MFA Rules not processed for user `917700ed75464456a056f42c446eaf6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:11.648567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ffda8ec1-e52f-4331-b30c-f96704bf51e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:11.659885 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ceef7-83d8-4bb9-931c-04e4c1bd3663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:11.661356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ceef7-83d8-4bb9-931c-04e4c1bd3663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:11.662044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ceef7-83d8-4bb9-931c-04e4c1bd3663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:11.662591 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ceef7-83d8-4bb9-931c-04e4c1bd3663 admin admin] PATH_INFO: `/v3/projects/557bc85f82604ed386af52a76e6fc2f7` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:11.673759 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ceef7-83d8-4bb9-931c-04e4c1bd3663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=557bc85f82604ed386af52a76e6fc2f7)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:11.676239 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ceef7-83d8-4bb9-931c-04e4c1bd3663 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:11.684446 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:11.748000 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 883/1733] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:11.779915 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:11.794261 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3a8ceef7-83d8-4bb9-931c-04e4c1bd3663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '557bc85f82604ed386af52a76e6fc2f7', 'request_id': 'req-3a8ceef7-83d8-4bb9-931c-04e4c1bd3663'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:11.812235 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3a8ceef7-83d8-4bb9-931c-04e4c1bd3663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '557bc85f82604ed386af52a76e6fc2f7', 'request_id': 'req-3a8ceef7-83d8-4bb9-931c-04e4c1bd3663'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:11.832284 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3a8ceef7-83d8-4bb9-931c-04e4c1bd3663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '557bc85f82604ed386af52a76e6fc2f7', 'request_id': 'req-3a8ceef7-83d8-4bb9-931c-04e4c1bd3663'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:11.848928 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3a8ceef7-83d8-4bb9-931c-04e4c1bd3663 admin admin] The token cache is being invalidate because project 557bc85f82604ed386af52a76e6fc2f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:05:11.849574 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3a8ceef7-83d8-4bb9-931c-04e4c1bd3663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:11.852409 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3a8ceef7-83d8-4bb9-931c-04e4c1bd3663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:11.854567 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 851/1734] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:05:11 2022] DELETE /identity/v3/projects/557bc85f82604ed386af52a76e6fc2f7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:05:11.859867 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896327c4-304d-44eb-b5e8-bcba77ae7d2d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:11.860461 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896327c4-304d-44eb-b5e8-bcba77ae7d2d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:11.860951 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896327c4-304d-44eb-b5e8-bcba77ae7d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:11.870628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e0be7-c4a8-45df-8276-8693ffe2c0fc None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:11.875220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e0be7-c4a8-45df-8276-8693ffe2c0fc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:11.875688 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e0be7-c4a8-45df-8276-8693ffe2c0fc None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:11.884103 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 852/1735] 10.222.0.18 () {54 vars in 912 bytes} [Tue Jul 19 11:05:11 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:05:11.891410 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3baac-0b2a-48a8-970f-73cfd6de96cd None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:11.891911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3baac-0b2a-48a8-970f-73cfd6de96cd None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:11.892318 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3baac-0b2a-48a8-970f-73cfd6de96cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:11.909701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-896327c4-304d-44eb-b5e8-bcba77ae7d2d None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:11.911044 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-896327c4-304d-44eb-b5e8-bcba77ae7d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:11.938590 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f0c3baac-0b2a-48a8-970f-73cfd6de96cd None None] MFA Rules not processed for user `3c50a821e9ef44cb9fccd49ee4af7dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:11.940486 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f0c3baac-0b2a-48a8-970f-73cfd6de96cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:12.055647 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 884/1736] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:05:12.063257 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917fd89-385a-4ad6-8ec9-6ed466973e0b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:12.063548 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917fd89-385a-4ad6-8ec9-6ed466973e0b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:12.063887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917fd89-385a-4ad6-8ec9-6ed466973e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:12.103751 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8917fd89-385a-4ad6-8ec9-6ed466973e0b None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:12.105588 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8917fd89-385a-4ad6-8ec9-6ed466973e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:12.125136 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 885/1737] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:12.128186 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917fd89-385a-4ad6-8ec9-6ed466973e0b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:12.147592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917fd89-385a-4ad6-8ec9-6ed466973e0b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:12.157716 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b7a6f-64e5-4b8b-b8f5-ecad96a51df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:12.159260 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b7a6f-64e5-4b8b-b8f5-ecad96a51df8 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:12.159551 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b7a6f-64e5-4b8b-b8f5-ecad96a51df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:12.159826 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b7a6f-64e5-4b8b-b8f5-ecad96a51df8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:12.162866 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b7a6f-64e5-4b8b-b8f5-ecad96a51df8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:05:12.163195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b7a6f-64e5-4b8b-b8f5-ecad96a51df8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:12.166745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b7a6f-64e5-4b8b-b8f5-ecad96a51df8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:12.191024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 853/1738] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 19 11:05:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:12.196806 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 886/1739] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:05:12.202706 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3baac-0b2a-48a8-970f-73cfd6de96cd None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:12.205094 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b7a6f-64e5-4b8b-b8f5-ecad96a51df8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:12.209513 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8d9b7a6f-64e5-4b8b-b8f5-ecad96a51df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:12.220161 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3baac-0b2a-48a8-970f-73cfd6de96cd None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:12.226835 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d50fb-65e5-46b8-9031-8c716a5addf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:12.227665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d50fb-65e5-46b8-9031-8c716a5addf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:12.228391 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d50fb-65e5-46b8-9031-8c716a5addf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:12.228816 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d50fb-65e5-46b8-9031-8c716a5addf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:12.230089 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d50fb-65e5-46b8-9031-8c716a5addf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:12.234347 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d50fb-65e5-46b8-9031-8c716a5addf5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:12.343995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 854/1740] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:05:12 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:12.345293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d50fb-65e5-46b8-9031-8c716a5addf5 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:12.394962 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b7a6f-64e5-4b8b-b8f5-ecad96a51df8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:12.496899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d50fb-65e5-46b8-9031-8c716a5addf5 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:12.515148 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec057772-41e5-4df9-a6f2-d7bb6d5b542e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:12.516613 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec057772-41e5-4df9-a6f2-d7bb6d5b542e admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:12.517106 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec057772-41e5-4df9-a6f2-d7bb6d5b542e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:12.517571 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec057772-41e5-4df9-a6f2-d7bb6d5b542e admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:12.518469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec057772-41e5-4df9-a6f2-d7bb6d5b542e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:12.521632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec057772-41e5-4df9-a6f2-d7bb6d5b542e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:12.563416 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8555729-e2a9-467c-88df-100135b46cf0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bcfbee5a5e4016a77901d0a637da63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:12.565790 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8555729-e2a9-467c-88df-100135b46cf0 service glance] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:12.566097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8555729-e2a9-467c-88df-100135b46cf0 service glance] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:12.566425 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8555729-e2a9-467c-88df-100135b46cf0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:12.571246 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 855/1741] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:05:12 2022] POST /identity/v3/users => generated 288 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:12.573393 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391d5fd-43de-4dc7-b948-e03f8a2fd044 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:12.574809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391d5fd-43de-4dc7-b948-e03f8a2fd044 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:12.575307 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391d5fd-43de-4dc7-b948-e03f8a2fd044 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:12.589569 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 856/1742] 10.222.0.18 () {54 vars in 961 bytes} [Tue Jul 19 11:05:12 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:05:12.590867 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391d5fd-43de-4dc7-b948-e03f8a2fd044 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:12.601215 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:12.616931 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391d5fd-43de-4dc7-b948-e03f8a2fd044 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:12.626145 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5e760-a2bb-4f2b-83e5-25af0aabda38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:12.626840 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5e760-a2bb-4f2b-83e5-25af0aabda38 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:12.627383 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5e760-a2bb-4f2b-83e5-25af0aabda38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:12.627383 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5e760-a2bb-4f2b-83e5-25af0aabda38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:12.628259 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5e760-a2bb-4f2b-83e5-25af0aabda38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:12.629996 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5e760-a2bb-4f2b-83e5-25af0aabda38 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:12.644099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 857/1743] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:05:12.645569 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62464c5c-bf94-410e-a232-094320295f96 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:12.645865 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62464c5c-bf94-410e-a232-094320295f96 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:12.646144 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62464c5c-bf94-410e-a232-094320295f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:12.672706 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-62464c5c-bf94-410e-a232-094320295f96 None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:12.673882 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8555729-e2a9-467c-88df-100135b46cf0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:12.675942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8555729-e2a9-467c-88df-100135b46cf0 service glance] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:12.681486 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-62464c5c-bf94-410e-a232-094320295f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:12.692604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 887/1744] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:12.695095 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8555729-e2a9-467c-88df-100135b46cf0 service glance] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:12.709058 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8555729-e2a9-467c-88df-100135b46cf0 service glance] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:12.719336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:12.722623 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d7d8f-4278-4e67-b57f-e85214f5aba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:12.723719 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d7d8f-4278-4e67-b57f-e85214f5aba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:12.726424 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d7d8f-4278-4e67-b57f-e85214f5aba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:12.726947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d7d8f-4278-4e67-b57f-e85214f5aba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:12.741161 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d7d8f-4278-4e67-b57f-e85214f5aba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:12.743233 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d7d8f-4278-4e67-b57f-e85214f5aba6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:12.800282 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 888/1745] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:05:12.804935 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d7d8f-4278-4e67-b57f-e85214f5aba6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:12.822450 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 858/1746] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Jul 19 11:05:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:12.830996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d7d8f-4278-4e67-b57f-e85214f5aba6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:12.832297 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62464c5c-bf94-410e-a232-094320295f96 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:12.841281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f71dc-e9e6-40c7-a3d3-aa2166d70589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:12.844831 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f71dc-e9e6-40c7-a3d3-aa2166d70589 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:12.846127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f71dc-e9e6-40c7-a3d3-aa2166d70589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:12.846528 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62464c5c-bf94-410e-a232-094320295f96 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:12.847993 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f71dc-e9e6-40c7-a3d3-aa2166d70589 admin admin] PATH_INFO: `/v3/projects/d67f80e4925444c5ab5879bef937c385/users/84db99d0956b4c39a6139b4a455e5606/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:12.853179 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f5f87-5b39-4de3-89bf-27e62067f3e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:12.854209 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f5f87-5b39-4de3-89bf-27e62067f3e4 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:12.854494 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f5f87-5b39-4de3-89bf-27e62067f3e4 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:12.854884 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f5f87-5b39-4de3-89bf-27e62067f3e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:12.861184 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f75f5f87-5b39-4de3-89bf-27e62067f3e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:12.877998 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f5f87-5b39-4de3-89bf-27e62067f3e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:12.880448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f5f87-5b39-4de3-89bf-27e62067f3e4 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:12.884424 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f71dc-e9e6-40c7-a3d3-aa2166d70589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d67f80e4925444c5ab5879bef937c385, user_id=84db99d0956b4c39a6139b4a455e5606, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:12.890490 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f71dc-e9e6-40c7-a3d3-aa2166d70589 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:12.896943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 859/1747] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:05:12.902248 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b0234-8aef-4b9c-a5b9-58d04105a456 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:12.902529 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b0234-8aef-4b9c-a5b9-58d04105a456 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:12.902830 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b0234-8aef-4b9c-a5b9-58d04105a456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:12.913107 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 889/1748] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:05:12 2022] PUT /identity/v3/projects/d67f80e4925444c5ab5879bef937c385/users/84db99d0956b4c39a6139b4a455e5606/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:05:12.927941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd169f50-8799-4cac-9c99-3bda27ef8dda None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:12.928380 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd169f50-8799-4cac-9c99-3bda27ef8dda None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:12.929320 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd169f50-8799-4cac-9c99-3bda27ef8dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:12.952611 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2a5b0234-8aef-4b9c-a5b9-58d04105a456 None None] MFA Rules not processed for user `5b244089f61f45cb812788ef46c15af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:12.954412 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2a5b0234-8aef-4b9c-a5b9-58d04105a456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:13.035616 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bd169f50-8799-4cac-9c99-3bda27ef8dda None None] MFA Rules not processed for user `84db99d0956b4c39a6139b4a455e5606`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:13.041201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bd169f50-8799-4cac-9c99-3bda27ef8dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:13.069219 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 860/1749] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:13.265951 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 890/1750] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:05:13.411858 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b0234-8aef-4b9c-a5b9-58d04105a456 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:13.414498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2a5b0234-8aef-4b9c-a5b9-58d04105a456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:13.627145 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b0234-8aef-4b9c-a5b9-58d04105a456 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:13.648256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe84414-3e68-4456-b59b-e8fb273e637c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:13.648762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe84414-3e68-4456-b59b-e8fb273e637c service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:13.649058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe84414-3e68-4456-b59b-e8fb273e637c service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:13.650993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe84414-3e68-4456-b59b-e8fb273e637c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:13.695216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe84414-3e68-4456-b59b-e8fb273e637c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:13.698741 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe84414-3e68-4456-b59b-e8fb273e637c service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:13.734777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 861/1751] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:14.535121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ebeaf-fefd-40a7-b61d-40593f73fdd0 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:14.535756 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ebeaf-fefd-40a7-b61d-40593f73fdd0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:14.535848 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ebeaf-fefd-40a7-b61d-40593f73fdd0 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:14.537692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 891/1752] 10.222.0.18 () {54 vars in 912 bytes} [Tue Jul 19 11:05:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:05:14.543707 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b83731-b11e-44e3-bcba-0f8553d83284 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:14.544283 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b83731-b11e-44e3-bcba-0f8553d83284 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:14.544632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b83731-b11e-44e3-bcba-0f8553d83284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:14.569869 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c0b83731-b11e-44e3-bcba-0f8553d83284 None None] MFA Rules not processed for user `07eaacc831ae481d99e8ab03ee295e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:14.572360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c0b83731-b11e-44e3-bcba-0f8553d83284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:14.581792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 862/1753] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 19 11:05:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:14.675708 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ebeaf-fefd-40a7-b61d-40593f73fdd0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:14.695556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ebeaf-fefd-40a7-b61d-40593f73fdd0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:14.706776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8ab86-38f2-42b2-a644-141377f5165b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:14.710987 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8ab86-38f2-42b2-a644-141377f5165b service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:14.711503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8ab86-38f2-42b2-a644-141377f5165b service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:14.713183 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8ab86-38f2-42b2-a644-141377f5165b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:14.752553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8ab86-38f2-42b2-a644-141377f5165b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:14.754384 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8ab86-38f2-42b2-a644-141377f5165b service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:14.794712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 892/1754] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:15.126449 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b83731-b11e-44e3-bcba-0f8553d83284 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:15.127995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c0b83731-b11e-44e3-bcba-0f8553d83284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:15.218865 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:15.275139 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b83731-b11e-44e3-bcba-0f8553d83284 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:15.289593 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522963c-d44c-4f5a-b48c-dfbc8624cf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:15.291196 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522963c-d44c-4f5a-b48c-dfbc8624cf74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:15.291618 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522963c-d44c-4f5a-b48c-dfbc8624cf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:15.292050 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522963c-d44c-4f5a-b48c-dfbc8624cf74 admin admin] PATH_INFO: `/v3/users/e2204cf895ec4575a3a6e9296b34f849` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:15.297214 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522963c-d44c-4f5a-b48c-dfbc8624cf74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2204cf895ec4575a3a6e9296b34f849)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:15.299351 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522963c-d44c-4f5a-b48c-dfbc8624cf74 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:15.434269 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2522963c-d44c-4f5a-b48c-dfbc8624cf74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2204cf895ec4575a3a6e9296b34f849'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:15.450086 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2522963c-d44c-4f5a-b48c-dfbc8624cf74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2204cf895ec4575a3a6e9296b34f849'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:15.482619 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2522963c-d44c-4f5a-b48c-dfbc8624cf74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2204cf895ec4575a3a6e9296b34f849'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:15.484329 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2522963c-d44c-4f5a-b48c-dfbc8624cf74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2204cf895ec4575a3a6e9296b34f849'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:15.503197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2522963c-d44c-4f5a-b48c-dfbc8624cf74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2204cf895ec4575a3a6e9296b34f849'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:15.524805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 863/1755] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:05:15 2022] DELETE /identity/v3/users/e2204cf895ec4575a3a6e9296b34f849 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:15.527402 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9884c-6742-40a6-902e-4f3663e69650 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:15.527688 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9884c-6742-40a6-902e-4f3663e69650 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:15.527990 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9884c-6742-40a6-902e-4f3663e69650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:15.562847 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-24c9884c-6742-40a6-902e-4f3663e69650 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:15.564632 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-24c9884c-6742-40a6-902e-4f3663e69650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:15.675978 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:15.726983 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 893/1756] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:15.771897 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522963c-d44c-4f5a-b48c-dfbc8624cf74 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:15.783141 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2522963c-d44c-4f5a-b48c-dfbc8624cf74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:15.808274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f635df-9db5-4b69-93b1-67a07743140a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:15.808838 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f635df-9db5-4b69-93b1-67a07743140a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:15.809288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f635df-9db5-4b69-93b1-67a07743140a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:15.919371 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522963c-d44c-4f5a-b48c-dfbc8624cf74 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:15.925097 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6bd38-86db-4104-9cda-ab82dc6e60bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:15.925887 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6bd38-86db-4104-9cda-ab82dc6e60bd service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:15.926169 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6bd38-86db-4104-9cda-ab82dc6e60bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:15.926507 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6bd38-86db-4104-9cda-ab82dc6e60bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:15.931605 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-38f635df-9db5-4b69-93b1-67a07743140a None None] MFA Rules not processed for user `654631b067b94b269f93ea7b3977609d`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:15.933494 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-38f635df-9db5-4b69-93b1-67a07743140a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:15.939264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6bd38-86db-4104-9cda-ab82dc6e60bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:15.942090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6bd38-86db-4104-9cda-ab82dc6e60bd service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:15.959489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 864/1757] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:16.020326 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 894/1758] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 19 11:05:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:05:16.207737 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6bd38-86db-4104-9cda-ab82dc6e60bd service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:16.209436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8df6bd38-86db-4104-9cda-ab82dc6e60bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:16.308103 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:16.346849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6bd38-86db-4104-9cda-ab82dc6e60bd service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:16.354303 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502c611-b574-4931-9fb5-24917b427827 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa6a9aa611640f893b5e717a094acf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:16.355128 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502c611-b574-4931-9fb5-24917b427827 service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:16.355532 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502c611-b574-4931-9fb5-24917b427827 service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:16.355901 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502c611-b574-4931-9fb5-24917b427827 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:16.369938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502c611-b574-4931-9fb5-24917b427827 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:16.371815 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502c611-b574-4931-9fb5-24917b427827 service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:16.388255 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 865/1759] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 19 11:05:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:05:17.442149 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f635df-9db5-4b69-93b1-67a07743140a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:17.446341 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-38f635df-9db5-4b69-93b1-67a07743140a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:17.500217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f635df-9db5-4b69-93b1-67a07743140a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:17.527110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3139ea-5446-45b5-b446-362ea6d97a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:17.532037 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3139ea-5446-45b5-b446-362ea6d97a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:17.537668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3139ea-5446-45b5-b446-362ea6d97a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:17.538211 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3139ea-5446-45b5-b446-362ea6d97a6f admin admin] PATH_INFO: `/v3/projects/2167ae2f6e064cfb9b45af3ecec53dae` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:17.549681 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3139ea-5446-45b5-b446-362ea6d97a6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2167ae2f6e064cfb9b45af3ecec53dae)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:17.553482 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3139ea-5446-45b5-b446-362ea6d97a6f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:17.750063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0f3139ea-5446-45b5-b446-362ea6d97a6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2167ae2f6e064cfb9b45af3ecec53dae', 'request_id': 'req-0f3139ea-5446-45b5-b446-362ea6d97a6f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:17.758373 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0f3139ea-5446-45b5-b446-362ea6d97a6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2167ae2f6e064cfb9b45af3ecec53dae', 'request_id': 'req-0f3139ea-5446-45b5-b446-362ea6d97a6f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:17.766924 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0f3139ea-5446-45b5-b446-362ea6d97a6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2167ae2f6e064cfb9b45af3ecec53dae', 'request_id': 'req-0f3139ea-5446-45b5-b446-362ea6d97a6f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:17.794078 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0f3139ea-5446-45b5-b446-362ea6d97a6f admin admin] The token cache is being invalidate because project 2167ae2f6e064cfb9b45af3ecec53dae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:05:17.795583 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0f3139ea-5446-45b5-b446-362ea6d97a6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:17.797619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0f3139ea-5446-45b5-b446-362ea6d97a6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:17.806624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 895/1760] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:05:17 2022] DELETE /identity/v3/projects/2167ae2f6e064cfb9b45af3ecec53dae => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:17.810341 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502c611-b574-4931-9fb5-24917b427827 service swift] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:17.845869 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502c611-b574-4931-9fb5-24917b427827 service swift] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:18.029139 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e4f4c-1307-4aa2-ab97-87bb23a8deb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:18.033359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e4f4c-1307-4aa2-ab97-87bb23a8deb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:18.033865 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e4f4c-1307-4aa2-ab97-87bb23a8deb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:18.034159 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e4f4c-1307-4aa2-ab97-87bb23a8deb4 admin admin] PATH_INFO: `/v3/users/bc04f098c506472b9e40bd88247ad137` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:18.036484 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e4f4c-1307-4aa2-ab97-87bb23a8deb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc04f098c506472b9e40bd88247ad137)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:18.043930 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e4f4c-1307-4aa2-ab97-87bb23a8deb4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:18.179482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-621e4f4c-1307-4aa2-ab97-87bb23a8deb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc04f098c506472b9e40bd88247ad137'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:18.212105 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-621e4f4c-1307-4aa2-ab97-87bb23a8deb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc04f098c506472b9e40bd88247ad137'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:18.247968 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-621e4f4c-1307-4aa2-ab97-87bb23a8deb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc04f098c506472b9e40bd88247ad137'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:18.248766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-621e4f4c-1307-4aa2-ab97-87bb23a8deb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc04f098c506472b9e40bd88247ad137'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:18.257569 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-621e4f4c-1307-4aa2-ab97-87bb23a8deb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc04f098c506472b9e40bd88247ad137'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:18.276175 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 866/1761] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:05:17 2022] DELETE /identity/v3/users/bc04f098c506472b9e40bd88247ad137 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:19.032000 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3139ea-5446-45b5-b446-362ea6d97a6f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:19.034488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0f3139ea-5446-45b5-b446-362ea6d97a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:19.083659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3139ea-5446-45b5-b446-362ea6d97a6f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:19.181115 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:19.230706 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d8972-085c-47d7-88b4-230ce6d39cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:19.231726 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d8972-085c-47d7-88b4-230ce6d39cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:19.232003 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d8972-085c-47d7-88b4-230ce6d39cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:19.235125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d8972-085c-47d7-88b4-230ce6d39cad admin admin] PATH_INFO: `/v3/users/d4e31cfb0e1c456fb0346e944f5f9511` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:19.239638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d8972-085c-47d7-88b4-230ce6d39cad admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4e31cfb0e1c456fb0346e944f5f9511)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:19.242883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d8972-085c-47d7-88b4-230ce6d39cad admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:19.364473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-591d8972-085c-47d7-88b4-230ce6d39cad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4e31cfb0e1c456fb0346e944f5f9511'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:19.373998 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-591d8972-085c-47d7-88b4-230ce6d39cad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4e31cfb0e1c456fb0346e944f5f9511'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:19.384847 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-591d8972-085c-47d7-88b4-230ce6d39cad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4e31cfb0e1c456fb0346e944f5f9511'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:19.386069 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-591d8972-085c-47d7-88b4-230ce6d39cad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4e31cfb0e1c456fb0346e944f5f9511'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:19.387583 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-591d8972-085c-47d7-88b4-230ce6d39cad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4e31cfb0e1c456fb0346e944f5f9511'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:19.445224 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 896/1762] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:05:19 2022] DELETE /identity/v3/users/d4e31cfb0e1c456fb0346e944f5f9511 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:19.447048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de8690-d1aa-41f7-97a6-b109602ddfb1 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:19.448444 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de8690-d1aa-41f7-97a6-b109602ddfb1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:19.449075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de8690-d1aa-41f7-97a6-b109602ddfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:19.499495 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b6de8690-d1aa-41f7-97a6-b109602ddfb1 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:19.504786 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b6de8690-d1aa-41f7-97a6-b109602ddfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:19.630957 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:19.674992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 867/1763] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:19.735587 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d8972-085c-47d7-88b4-230ce6d39cad admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:19.738003 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-591d8972-085c-47d7-88b4-230ce6d39cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:19.957695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d8972-085c-47d7-88b4-230ce6d39cad admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:19.974489 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fad81f-4e53-403d-8b83-7e46dcdd3c73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:19.975301 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fad81f-4e53-403d-8b83-7e46dcdd3c73 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:19.975690 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fad81f-4e53-403d-8b83-7e46dcdd3c73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:19.976251 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fad81f-4e53-403d-8b83-7e46dcdd3c73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:20.001542 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fad81f-4e53-403d-8b83-7e46dcdd3c73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:20.014598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fad81f-4e53-403d-8b83-7e46dcdd3c73 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:20.075331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 897/1764] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:21.254030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a47b9d-d485-435b-856b-81c227bc5187 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:21.255197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a47b9d-d485-435b-856b-81c227bc5187 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:21.256064 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a47b9d-d485-435b-856b-81c227bc5187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:21.292763 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f4a47b9d-d485-435b-856b-81c227bc5187 None None] MFA Rules not processed for user `07eaacc831ae481d99e8ab03ee295e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:21.294608 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f4a47b9d-d485-435b-856b-81c227bc5187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:21.313317 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 868/1765] 10.222.0.17 () {58 vars in 1015 bytes} [Tue Jul 19 11:05:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:05:21.400070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fad81f-4e53-403d-8b83-7e46dcdd3c73 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:21.414307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fad81f-4e53-403d-8b83-7e46dcdd3c73 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:21.429158 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffbb7a-b403-4917-b593-8ef99d4209df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:21.434540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffbb7a-b403-4917-b593-8ef99d4209df service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:21.436077 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffbb7a-b403-4917-b593-8ef99d4209df service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:21.436534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffbb7a-b403-4917-b593-8ef99d4209df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:21.477943 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffbb7a-b403-4917-b593-8ef99d4209df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:21.483086 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffbb7a-b403-4917-b593-8ef99d4209df service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:21.566325 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 898/1766] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:21.997334 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a47b9d-d485-435b-856b-81c227bc5187 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:22.000696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f4a47b9d-d485-435b-856b-81c227bc5187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:22.046089 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a47b9d-d485-435b-856b-81c227bc5187 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:22.057103 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601e016-a8dd-49da-a294-d9c8761c6d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:22.058479 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601e016-a8dd-49da-a294-d9c8761c6d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:22.058911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601e016-a8dd-49da-a294-d9c8761c6d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:22.059458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601e016-a8dd-49da-a294-d9c8761c6d5e admin admin] PATH_INFO: `/v3/projects/a59211539d504ceebb345077aa85585e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:22.082582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601e016-a8dd-49da-a294-d9c8761c6d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a59211539d504ceebb345077aa85585e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:22.087389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601e016-a8dd-49da-a294-d9c8761c6d5e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:22.239761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5601e016-a8dd-49da-a294-d9c8761c6d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a59211539d504ceebb345077aa85585e', 'request_id': 'req-5601e016-a8dd-49da-a294-d9c8761c6d5e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:22.255105 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5601e016-a8dd-49da-a294-d9c8761c6d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a59211539d504ceebb345077aa85585e', 'request_id': 'req-5601e016-a8dd-49da-a294-d9c8761c6d5e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:22.278089 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5601e016-a8dd-49da-a294-d9c8761c6d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a59211539d504ceebb345077aa85585e', 'request_id': 'req-5601e016-a8dd-49da-a294-d9c8761c6d5e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:22.298890 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5601e016-a8dd-49da-a294-d9c8761c6d5e admin admin] The token cache is being invalidate because project a59211539d504ceebb345077aa85585e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:05:22.299395 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5601e016-a8dd-49da-a294-d9c8761c6d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:22.300173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5601e016-a8dd-49da-a294-d9c8761c6d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:22.305931 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 869/1767] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:05:21 2022] DELETE /identity/v3/projects/a59211539d504ceebb345077aa85585e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:22.308261 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acbbf7-c0c7-48e5-ab2c-7ac81b65aba3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:22.308621 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acbbf7-c0c7-48e5-ab2c-7ac81b65aba3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:22.309001 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acbbf7-c0c7-48e5-ab2c-7ac81b65aba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:22.338847 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-98acbbf7-c0c7-48e5-ab2c-7ac81b65aba3 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:22.340249 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-98acbbf7-c0c7-48e5-ab2c-7ac81b65aba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:22.418073 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:22.448979 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 899/1768] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:22.457141 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41068318-7604-40d9-955e-8c6b9393cd30 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:22.457799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41068318-7604-40d9-955e-8c6b9393cd30 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:22.458221 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41068318-7604-40d9-955e-8c6b9393cd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:22.534416 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-41068318-7604-40d9-955e-8c6b9393cd30 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:22.536527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-41068318-7604-40d9-955e-8c6b9393cd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:22.569218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 870/1769] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:22.576539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acbbf7-c0c7-48e5-ab2c-7ac81b65aba3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:22.613734 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acbbf7-c0c7-48e5-ab2c-7ac81b65aba3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:22.640134 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356248c-7f79-4832-bf8e-157806ee3f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:22.640877 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356248c-7f79-4832-bf8e-157806ee3f90 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:22.641165 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356248c-7f79-4832-bf8e-157806ee3f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:22.641438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356248c-7f79-4832-bf8e-157806ee3f90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:22.645561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356248c-7f79-4832-bf8e-157806ee3f90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:05:22.645886 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356248c-7f79-4832-bf8e-157806ee3f90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:22.654913 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356248c-7f79-4832-bf8e-157806ee3f90 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:22.702202 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 900/1770] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:05:22.707102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41068318-7604-40d9-955e-8c6b9393cd30 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:22.722405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41068318-7604-40d9-955e-8c6b9393cd30 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:22.736319 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5513a-e7d1-4841-a47d-3672daf97e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:22.737224 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5513a-e7d1-4841-a47d-3672daf97e97 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:22.737566 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5513a-e7d1-4841-a47d-3672daf97e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:22.737874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5513a-e7d1-4841-a47d-3672daf97e97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:22.739349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5513a-e7d1-4841-a47d-3672daf97e97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:22.740768 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5513a-e7d1-4841-a47d-3672daf97e97 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:22.802901 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 871/1771] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:05:22 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:22.808603 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356248c-7f79-4832-bf8e-157806ee3f90 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:22.827417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356248c-7f79-4832-bf8e-157806ee3f90 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:22.940555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9810a6c-a9d2-49aa-b205-bbc5e7741baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:22.941278 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9810a6c-a9d2-49aa-b205-bbc5e7741baa admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:22.941627 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9810a6c-a9d2-49aa-b205-bbc5e7741baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:22.941901 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9810a6c-a9d2-49aa-b205-bbc5e7741baa admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:22.942606 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9810a6c-a9d2-49aa-b205-bbc5e7741baa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:22.944563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9810a6c-a9d2-49aa-b205-bbc5e7741baa admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:23.025609 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 901/1772] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:05:22 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:23.030001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5513a-e7d1-4841-a47d-3672daf97e97 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:23.055218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5513a-e7d1-4841-a47d-3672daf97e97 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:23.073203 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c340cb6-61bb-4052-8dc4-dc7b8422bf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:23.074033 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c340cb6-61bb-4052-8dc4-dc7b8422bf75 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:23.076670 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c340cb6-61bb-4052-8dc4-dc7b8422bf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:23.077095 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c340cb6-61bb-4052-8dc4-dc7b8422bf75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:23.078064 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c340cb6-61bb-4052-8dc4-dc7b8422bf75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:23.084006 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c340cb6-61bb-4052-8dc4-dc7b8422bf75 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:23.119435 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 872/1773] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:05:23.124681 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9810a6c-a9d2-49aa-b205-bbc5e7741baa admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:23.147842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9810a6c-a9d2-49aa-b205-bbc5e7741baa admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:23.163884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2756d16-3c77-4cc4-bd89-5afd6014d23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:23.164915 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2756d16-3c77-4cc4-bd89-5afd6014d23f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:23.165384 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2756d16-3c77-4cc4-bd89-5afd6014d23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:23.166427 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2756d16-3c77-4cc4-bd89-5afd6014d23f admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:23.168018 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2756d16-3c77-4cc4-bd89-5afd6014d23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:23.173527 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2756d16-3c77-4cc4-bd89-5afd6014d23f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:23.208057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 902/1774] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:05:23.211393 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c340cb6-61bb-4052-8dc4-dc7b8422bf75 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:23.229846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c340cb6-61bb-4052-8dc4-dc7b8422bf75 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:23.273643 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232b45f-d919-4218-b93c-619bf70580c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:23.273643 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232b45f-d919-4218-b93c-619bf70580c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:23.273643 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232b45f-d919-4218-b93c-619bf70580c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:23.273643 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232b45f-d919-4218-b93c-619bf70580c0 admin admin] PATH_INFO: `/v3/projects/7d911926d760413b835abf584757c1f0/users/62a420cae1104b3087c7735ece1f59f2/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:23.277667 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232b45f-d919-4218-b93c-619bf70580c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d911926d760413b835abf584757c1f0, user_id=62a420cae1104b3087c7735ece1f59f2, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:23.285760 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232b45f-d919-4218-b93c-619bf70580c0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:23.344994 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 873/1775] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:05:23 2022] PUT /identity/v3/projects/7d911926d760413b835abf584757c1f0/users/62a420cae1104b3087c7735ece1f59f2/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:23.360461 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0c850-fb71-42f1-a073-8ad0e01109ac None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:23.361199 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0c850-fb71-42f1-a073-8ad0e01109ac None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:23.361972 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0c850-fb71-42f1-a073-8ad0e01109ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:23.440118 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c5e0c850-fb71-42f1-a073-8ad0e01109ac None None] MFA Rules not processed for user `62a420cae1104b3087c7735ece1f59f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:23.443577 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c5e0c850-fb71-42f1-a073-8ad0e01109ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:23.671253 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 903/1776] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:23.675709 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232b45f-d919-4218-b93c-619bf70580c0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:23.811470 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232b45f-d919-4218-b93c-619bf70580c0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:23.817044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4a1e4-39a8-44fe-9a7e-db89c93658f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:23.818462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4a1e4-39a8-44fe-9a7e-db89c93658f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:23.818935 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4a1e4-39a8-44fe-9a7e-db89c93658f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:23.819493 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4a1e4-39a8-44fe-9a7e-db89c93658f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:23.820370 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4a1e4-39a8-44fe-9a7e-db89c93658f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:23.823164 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4a1e4-39a8-44fe-9a7e-db89c93658f1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:23.835634 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:23.879264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 874/1777] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:05:23 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:05:23.880498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0c850-fb71-42f1-a073-8ad0e01109ac None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:23.901083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0c850-fb71-42f1-a073-8ad0e01109ac None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:23.904054 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4a1e4-39a8-44fe-9a7e-db89c93658f1 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:23.906475 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-53c4a1e4-39a8-44fe-9a7e-db89c93658f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:24.118599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:24.135997 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4a1e4-39a8-44fe-9a7e-db89c93658f1 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:24.172659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d9227-60c1-42b1-aff7-ad288133653d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:24.174049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d9227-60c1-42b1-aff7-ad288133653d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:24.174496 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d9227-60c1-42b1-aff7-ad288133653d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:24.174918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d9227-60c1-42b1-aff7-ad288133653d admin admin] PATH_INFO: `/v3/projects/c17b2c2eb7d04c85a214e7b1b347123f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:24.181687 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d9227-60c1-42b1-aff7-ad288133653d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c17b2c2eb7d04c85a214e7b1b347123f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:24.187165 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f410de-0727-495b-8059-865c827e25a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:24.187941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f410de-0727-495b-8059-865c827e25a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:24.188236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f410de-0727-495b-8059-865c827e25a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:24.188545 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d9227-60c1-42b1-aff7-ad288133653d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:24.189729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f410de-0727-495b-8059-865c827e25a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:24.193244 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f410de-0727-495b-8059-865c827e25a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:24.197767 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f410de-0727-495b-8059-865c827e25a6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:24.241825 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 904/1778] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:05:23 2022] POST /identity/v3/users => generated 292 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:24.245732 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f410de-0727-495b-8059-865c827e25a6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:24.272011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f410de-0727-495b-8059-865c827e25a6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:24.285646 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87f75a-3bf3-400d-ae28-163803b712d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:24.286375 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87f75a-3bf3-400d-ae28-163803b712d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:24.286659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87f75a-3bf3-400d-ae28-163803b712d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:24.286932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87f75a-3bf3-400d-ae28-163803b712d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:24.290259 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87f75a-3bf3-400d-ae28-163803b712d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:24.297605 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87f75a-3bf3-400d-ae28-163803b712d2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:24.331474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-de6d9227-60c1-42b1-aff7-ad288133653d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c17b2c2eb7d04c85a214e7b1b347123f', 'request_id': 'req-de6d9227-60c1-42b1-aff7-ad288133653d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:24.344613 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 905/1779] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:05:24.349310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87f75a-3bf3-400d-ae28-163803b712d2 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:24.352674 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-de6d9227-60c1-42b1-aff7-ad288133653d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c17b2c2eb7d04c85a214e7b1b347123f', 'request_id': 'req-de6d9227-60c1-42b1-aff7-ad288133653d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:24.373737 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87f75a-3bf3-400d-ae28-163803b712d2 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:24.377325 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-de6d9227-60c1-42b1-aff7-ad288133653d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c17b2c2eb7d04c85a214e7b1b347123f', 'request_id': 'req-de6d9227-60c1-42b1-aff7-ad288133653d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:24.400859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-de6d9227-60c1-42b1-aff7-ad288133653d admin admin] The token cache is being invalidate because project c17b2c2eb7d04c85a214e7b1b347123f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:05:24.402344 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-de6d9227-60c1-42b1-aff7-ad288133653d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:24.403294 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-de6d9227-60c1-42b1-aff7-ad288133653d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:24.405996 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 875/1780] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:05:23 2022] DELETE /identity/v3/projects/c17b2c2eb7d04c85a214e7b1b347123f => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:24.409856 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d9227-60c1-42b1-aff7-ad288133653d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:24.449666 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-de6d9227-60c1-42b1-aff7-ad288133653d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:24.576015 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180aa5a6-ece5-4aea-9211-736733a8d9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:24.576839 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aa5a6-ece5-4aea-9211-736733a8d9be admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:24.577033 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aa5a6-ece5-4aea-9211-736733a8d9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:24.577493 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aa5a6-ece5-4aea-9211-736733a8d9be admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:24.578528 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180aa5a6-ece5-4aea-9211-736733a8d9be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:24.580357 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180aa5a6-ece5-4aea-9211-736733a8d9be admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:24.607963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d9227-60c1-42b1-aff7-ad288133653d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:24.623228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af82957-9cdc-477f-8df6-3c4d353001fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:24.623228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af82957-9cdc-477f-8df6-3c4d353001fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:24.623228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af82957-9cdc-477f-8df6-3c4d353001fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:24.623228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af82957-9cdc-477f-8df6-3c4d353001fc admin admin] PATH_INFO: `/v3/users/c19fe42bbb91461cb6618fab9286556d` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:24.624850 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af82957-9cdc-477f-8df6-3c4d353001fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c19fe42bbb91461cb6618fab9286556d)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:24.624850 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af82957-9cdc-477f-8df6-3c4d353001fc admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:24.650955 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 906/1781] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:05:24.652933 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180aa5a6-ece5-4aea-9211-736733a8d9be admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:24.661500 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-180aa5a6-ece5-4aea-9211-736733a8d9be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:24.694019 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:24.721133 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180aa5a6-ece5-4aea-9211-736733a8d9be admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:24.743940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9e544-5599-4bb4-b144-d8de7f1e1d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:24.744965 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9e544-5599-4bb4-b144-d8de7f1e1d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:24.745209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9e544-5599-4bb4-b144-d8de7f1e1d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:24.745493 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9e544-5599-4bb4-b144-d8de7f1e1d9c admin admin] PATH_INFO: `/v3/projects/0347e1d7b913450a9e861d05bd4b0ea8/users/e5f8defe0b684dafbf561b74563d3e40/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:24.783887 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7af82957-9cdc-477f-8df6-3c4d353001fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c19fe42bbb91461cb6618fab9286556d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:24.797159 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7af82957-9cdc-477f-8df6-3c4d353001fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c19fe42bbb91461cb6618fab9286556d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:24.798335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9e544-5599-4bb4-b144-d8de7f1e1d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0347e1d7b913450a9e861d05bd4b0ea8, user_id=e5f8defe0b684dafbf561b74563d3e40, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:24.801707 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9e544-5599-4bb4-b144-d8de7f1e1d9c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:24.828129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7af82957-9cdc-477f-8df6-3c4d353001fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c19fe42bbb91461cb6618fab9286556d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:24.828960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7af82957-9cdc-477f-8df6-3c4d353001fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c19fe42bbb91461cb6618fab9286556d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:24.840972 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 907/1782] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:05:24 2022] PUT /identity/v3/projects/0347e1d7b913450a9e861d05bd4b0ea8/users/e5f8defe0b684dafbf561b74563d3e40/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:24.841176 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7af82957-9cdc-477f-8df6-3c4d353001fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c19fe42bbb91461cb6618fab9286556d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:24.845998 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fb187-f32f-4a80-a26f-259df22b3888 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:24.846273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fb187-f32f-4a80-a26f-259df22b3888 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:24.846533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fb187-f32f-4a80-a26f-259df22b3888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:24.865115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 876/1783] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:05:24 2022] DELETE /identity/v3/users/c19fe42bbb91461cb6618fab9286556d => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:05:24.886844 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a00fb187-f32f-4a80-a26f-259df22b3888 None None] MFA Rules not processed for user `e5f8defe0b684dafbf561b74563d3e40`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:24.888503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a00fb187-f32f-4a80-a26f-259df22b3888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:25.057930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 908/1784] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:25.059513 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af82957-9cdc-477f-8df6-3c4d353001fc admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:25.061527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7af82957-9cdc-477f-8df6-3c4d353001fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:25.203481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af82957-9cdc-477f-8df6-3c4d353001fc admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:25.214392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c065a2d-2af6-447e-a00e-cf8bb1e53fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:25.215468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c065a2d-2af6-447e-a00e-cf8bb1e53fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:25.244755 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c065a2d-2af6-447e-a00e-cf8bb1e53fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:25.247040 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c065a2d-2af6-447e-a00e-cf8bb1e53fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:25.251155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c065a2d-2af6-447e-a00e-cf8bb1e53fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:25.274648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c065a2d-2af6-447e-a00e-cf8bb1e53fd8 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:25.364770 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 877/1785] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:05:25 2022] POST /identity/v3/projects => generated 383 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:25.365998 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fb187-f32f-4a80-a26f-259df22b3888 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:25.384276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fb187-f32f-4a80-a26f-259df22b3888 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:25.455840 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:25.543277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00e6c3-007e-4575-aae7-2c86fe1dc89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:25.543681 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00e6c3-007e-4575-aae7-2c86fe1dc89e admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:25.543956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00e6c3-007e-4575-aae7-2c86fe1dc89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:25.544245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00e6c3-007e-4575-aae7-2c86fe1dc89e admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:25.544966 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00e6c3-007e-4575-aae7-2c86fe1dc89e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:25.547041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00e6c3-007e-4575-aae7-2c86fe1dc89e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:25.591130 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 909/1786] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:05:25 2022] POST /identity/v3/users => generated 298 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:25.595085 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c065a2d-2af6-447e-a00e-cf8bb1e53fd8 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:25.618842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c065a2d-2af6-447e-a00e-cf8bb1e53fd8 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:25.629233 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90376c2d-5098-4090-bce8-6fd0ed884908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:25.630018 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90376c2d-5098-4090-bce8-6fd0ed884908 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:25.630265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90376c2d-5098-4090-bce8-6fd0ed884908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:25.630539 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90376c2d-5098-4090-bce8-6fd0ed884908 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:25.631674 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90376c2d-5098-4090-bce8-6fd0ed884908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:25.633097 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90376c2d-5098-4090-bce8-6fd0ed884908 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:25.668111 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 878/1787] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:05:25.673072 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00e6c3-007e-4575-aae7-2c86fe1dc89e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:25.700188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00e6c3-007e-4575-aae7-2c86fe1dc89e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:25.714925 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b9ff3-bb6f-43b5-aa8a-d1e808429ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:25.719347 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b9ff3-bb6f-43b5-aa8a-d1e808429ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:25.721776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b9ff3-bb6f-43b5-aa8a-d1e808429ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:25.722502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b9ff3-bb6f-43b5-aa8a-d1e808429ec8 admin admin] PATH_INFO: `/v3/projects/eff4fdb45e194b2ab24356cb33b436e5/users/2afed7b688ed4af39d674a5a147c709e/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:25.788017 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b9ff3-bb6f-43b5-aa8a-d1e808429ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff4fdb45e194b2ab24356cb33b436e5, user_id=2afed7b688ed4af39d674a5a147c709e, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:25.791599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b9ff3-bb6f-43b5-aa8a-d1e808429ec8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:25.824214 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 910/1788] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:05:25 2022] PUT /identity/v3/projects/eff4fdb45e194b2ab24356cb33b436e5/users/2afed7b688ed4af39d674a5a147c709e/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:25.825602 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90376c2d-5098-4090-bce8-6fd0ed884908 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:25.848867 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90376c2d-5098-4090-bce8-6fd0ed884908 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:25.986090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcee6f-a0f7-4bf9-8f45-ab6d386d5d40 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:25.986676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcee6f-a0f7-4bf9-8f45-ab6d386d5d40 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:25.986788 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcee6f-a0f7-4bf9-8f45-ab6d386d5d40 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:25.988912 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 911/1789] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 19 11:05:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:05:26.025401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a364f-2b3e-4b55-8a0c-7477e812c943 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:26.026074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a364f-2b3e-4b55-8a0c-7477e812c943 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:26.026506 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a364f-2b3e-4b55-8a0c-7477e812c943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:26.065321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3b0a364f-2b3e-4b55-8a0c-7477e812c943 None None] MFA Rules not processed for user `3c50a821e9ef44cb9fccd49ee4af7dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:26.066673 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3b0a364f-2b3e-4b55-8a0c-7477e812c943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:26.070607 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9bd60-4d91-40d4-b509-1fd9ebd0a823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:26.071949 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9bd60-4d91-40d4-b509-1fd9ebd0a823 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:26.072283 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9bd60-4d91-40d4-b509-1fd9ebd0a823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:26.072596 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9bd60-4d91-40d4-b509-1fd9ebd0a823 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:26.073405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9bd60-4d91-40d4-b509-1fd9ebd0a823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:26.075089 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9bd60-4d91-40d4-b509-1fd9ebd0a823 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:26.091509 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 879/1790] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:05:26.094237 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9bd60-4d91-40d4-b509-1fd9ebd0a823 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:26.120090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9bd60-4d91-40d4-b509-1fd9ebd0a823 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:26.147218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e034ef6-3a90-4055-bc5b-6f5f2f0397d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:26.147430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e034ef6-3a90-4055-bc5b-6f5f2f0397d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:26.147693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e034ef6-3a90-4055-bc5b-6f5f2f0397d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:26.147874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e034ef6-3a90-4055-bc5b-6f5f2f0397d5 admin admin] PATH_INFO: `/v3/projects/eff4fdb45e194b2ab24356cb33b436e5/users/2afed7b688ed4af39d674a5a147c709e/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:26.151266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e034ef6-3a90-4055-bc5b-6f5f2f0397d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff4fdb45e194b2ab24356cb33b436e5, user_id=2afed7b688ed4af39d674a5a147c709e, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:26.154071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e034ef6-3a90-4055-bc5b-6f5f2f0397d5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:26.186627 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:26.210807 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 880/1791] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:05:26 2022] PUT /identity/v3/projects/eff4fdb45e194b2ab24356cb33b436e5/users/2afed7b688ed4af39d674a5a147c709e/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:26.228549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311e94f-bfa4-472a-b54a-0bb22212c626 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:26.228931 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311e94f-bfa4-472a-b54a-0bb22212c626 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:26.236528 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311e94f-bfa4-472a-b54a-0bb22212c626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:26.248780 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 912/1792] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 11:05:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:05:26.335929 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9311e94f-bfa4-472a-b54a-0bb22212c626 None None] MFA Rules not processed for user `2afed7b688ed4af39d674a5a147c709e`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:26.340424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9311e94f-bfa4-472a-b54a-0bb22212c626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:26.445313 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a364f-2b3e-4b55-8a0c-7477e812c943 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:26.452404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3b0a364f-2b3e-4b55-8a0c-7477e812c943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:26.502017 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a364f-2b3e-4b55-8a0c-7477e812c943 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:26.673573 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed7e7b-792d-42a6-a16d-e56ad38d2e58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:26.675093 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed7e7b-792d-42a6-a16d-e56ad38d2e58 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:26.675539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed7e7b-792d-42a6-a16d-e56ad38d2e58 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:26.675991 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed7e7b-792d-42a6-a16d-e56ad38d2e58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:26.693930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed7e7b-792d-42a6-a16d-e56ad38d2e58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:26.695889 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed7e7b-792d-42a6-a16d-e56ad38d2e58 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:26.723884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 913/1793] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:05:26.725094 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed7e7b-792d-42a6-a16d-e56ad38d2e58 service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:26.728016 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4fed7e7b-792d-42a6-a16d-e56ad38d2e58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:26.758122 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:26.823664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 881/1794] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 597 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:26.851895 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311e94f-bfa4-472a-b54a-0bb22212c626 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:26.854354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9311e94f-bfa4-472a-b54a-0bb22212c626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:26.908672 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed7e7b-792d-42a6-a16d-e56ad38d2e58 service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:26.921008 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19b208-69b7-4c4a-ab37-b7e73d4ed7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:26.922136 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19b208-69b7-4c4a-ab37-b7e73d4ed7a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:26.922328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19b208-69b7-4c4a-ab37-b7e73d4ed7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:26.922686 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19b208-69b7-4c4a-ab37-b7e73d4ed7a9 admin admin] PATH_INFO: `/v3/projects/ac86edba6f5642e4927da95e3c9921e5` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:26.925006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19b208-69b7-4c4a-ab37-b7e73d4ed7a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac86edba6f5642e4927da95e3c9921e5)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:26.927202 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19b208-69b7-4c4a-ab37-b7e73d4ed7a9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:27.048930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ac19b208-69b7-4c4a-ab37-b7e73d4ed7a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac86edba6f5642e4927da95e3c9921e5', 'request_id': 'req-ac19b208-69b7-4c4a-ab37-b7e73d4ed7a9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:27.081018 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ac19b208-69b7-4c4a-ab37-b7e73d4ed7a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac86edba6f5642e4927da95e3c9921e5', 'request_id': 'req-ac19b208-69b7-4c4a-ab37-b7e73d4ed7a9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:27.112675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ac19b208-69b7-4c4a-ab37-b7e73d4ed7a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac86edba6f5642e4927da95e3c9921e5', 'request_id': 'req-ac19b208-69b7-4c4a-ab37-b7e73d4ed7a9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:27.179439 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ac19b208-69b7-4c4a-ab37-b7e73d4ed7a9 admin admin] The token cache is being invalidate because project ac86edba6f5642e4927da95e3c9921e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:05:27.180008 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ac19b208-69b7-4c4a-ab37-b7e73d4ed7a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:27.181121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ac19b208-69b7-4c4a-ab37-b7e73d4ed7a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:27.185058 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 914/1795] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:05:26 2022] DELETE /identity/v3/projects/ac86edba6f5642e4927da95e3c9921e5 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:27.186094 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311e94f-bfa4-472a-b54a-0bb22212c626 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:27.189954 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89763445-7586-49b5-bde4-3854632cc337 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:27.190804 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89763445-7586-49b5-bde4-3854632cc337 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:27.191291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89763445-7586-49b5-bde4-3854632cc337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:27.263854 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-89763445-7586-49b5-bde4-3854632cc337 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:27.265167 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-89763445-7586-49b5-bde4-3854632cc337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:27.329461 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b556caf-6279-457b-8f90-d60a74b798e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:27.330151 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b556caf-6279-457b-8f90-d60a74b798e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:27.330435 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b556caf-6279-457b-8f90-d60a74b798e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:27.330826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b556caf-6279-457b-8f90-d60a74b798e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:27.347422 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5b556caf-6279-457b-8f90-d60a74b798e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:27.407861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 915/1796] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:27.415815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc09fc8-a932-4941-a228-183ba18f4ed6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:27.416106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc09fc8-a932-4941-a228-183ba18f4ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:27.416368 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc09fc8-a932-4941-a228-183ba18f4ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:27.471616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:27.475478 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2cc09fc8-a932-4941-a228-183ba18f4ed6 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:27.476760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2cc09fc8-a932-4941-a228-183ba18f4ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:27.476890 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b556caf-6279-457b-8f90-d60a74b798e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:27.493428 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b556caf-6279-457b-8f90-d60a74b798e4 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:27.501421 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 916/1797] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:05:27.507341 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc09fc8-a932-4941-a228-183ba18f4ed6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:27.516969 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 882/1798] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:27.535802 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc09fc8-a932-4941-a228-183ba18f4ed6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:27.541189 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e870c8b-6587-42eb-957d-2713fcfcd45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:27.541913 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e870c8b-6587-42eb-957d-2713fcfcd45e admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:27.542197 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e870c8b-6587-42eb-957d-2713fcfcd45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:27.542474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e870c8b-6587-42eb-957d-2713fcfcd45e admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:27.543252 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e870c8b-6587-42eb-957d-2713fcfcd45e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:05:27.543571 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e870c8b-6587-42eb-957d-2713fcfcd45e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:27.553892 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e870c8b-6587-42eb-957d-2713fcfcd45e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:27.576771 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 917/1799] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:05:27.581537 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b556caf-6279-457b-8f90-d60a74b798e4 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:27.599817 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b556caf-6279-457b-8f90-d60a74b798e4 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:27.608559 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6585815-0238-4cf1-b291-5f9385a8b744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:27.609608 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6585815-0238-4cf1-b291-5f9385a8b744 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:27.610183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6585815-0238-4cf1-b291-5f9385a8b744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:27.610780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6585815-0238-4cf1-b291-5f9385a8b744 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:27.611993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6585815-0238-4cf1-b291-5f9385a8b744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:27.616404 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6585815-0238-4cf1-b291-5f9385a8b744 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:27.673920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 883/1800] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:05:27 2022] POST /identity/v3/projects => generated 357 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:27.675132 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e870c8b-6587-42eb-957d-2713fcfcd45e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:27.695741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e870c8b-6587-42eb-957d-2713fcfcd45e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:27.725708 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:27.821006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e836e0-8365-4bb7-bdf5-39d05e89dc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:27.822077 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e836e0-8365-4bb7-bdf5-39d05e89dc1e admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:27.822361 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e836e0-8365-4bb7-bdf5-39d05e89dc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:27.822636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e836e0-8365-4bb7-bdf5-39d05e89dc1e admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:27.823345 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e836e0-8365-4bb7-bdf5-39d05e89dc1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:27.825381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e836e0-8365-4bb7-bdf5-39d05e89dc1e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:27.894712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 918/1801] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:05:27 2022] POST /identity/v3/users => generated 279 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:05:27.895996 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6585815-0238-4cf1-b291-5f9385a8b744 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:27.914734 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6585815-0238-4cf1-b291-5f9385a8b744 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:27.928778 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570108bc-3b2e-46d5-8f8f-97e388e2efbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:27.929538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570108bc-3b2e-46d5-8f8f-97e388e2efbb admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:27.929838 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570108bc-3b2e-46d5-8f8f-97e388e2efbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:27.930155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570108bc-3b2e-46d5-8f8f-97e388e2efbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:27.930932 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570108bc-3b2e-46d5-8f8f-97e388e2efbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:27.932920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570108bc-3b2e-46d5-8f8f-97e388e2efbb admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:27.969160 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 884/1802] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:05:27.970313 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e836e0-8365-4bb7-bdf5-39d05e89dc1e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:27.992314 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e836e0-8365-4bb7-bdf5-39d05e89dc1e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:28.012991 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75a977-2694-41df-a063-95d7471427a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:28.014037 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75a977-2694-41df-a063-95d7471427a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:28.014464 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75a977-2694-41df-a063-95d7471427a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:28.014891 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75a977-2694-41df-a063-95d7471427a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:28.015911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75a977-2694-41df-a063-95d7471427a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:28.017990 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75a977-2694-41df-a063-95d7471427a1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:28.050009 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 919/1803] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:05:28.054483 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570108bc-3b2e-46d5-8f8f-97e388e2efbb admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:28.073437 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570108bc-3b2e-46d5-8f8f-97e388e2efbb admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:28.084699 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67ef95-5496-4e8b-8947-7b473252d1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:28.086182 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67ef95-5496-4e8b-8947-7b473252d1d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:28.086670 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67ef95-5496-4e8b-8947-7b473252d1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:28.087100 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67ef95-5496-4e8b-8947-7b473252d1d0 admin admin] PATH_INFO: `/v3/projects/b1ff92ba1fcb4352a2535e29420709cd/users/2e95de2993204aec95115c28ca374035/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:28.190704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67ef95-5496-4e8b-8947-7b473252d1d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ff92ba1fcb4352a2535e29420709cd, user_id=2e95de2993204aec95115c28ca374035, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:28.202745 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67ef95-5496-4e8b-8947-7b473252d1d0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:28.262111 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 885/1804] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:05:28 2022] PUT /identity/v3/projects/b1ff92ba1fcb4352a2535e29420709cd/users/2e95de2993204aec95115c28ca374035/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:28.262870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56084f-ef71-4810-989d-df52d678eb42 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:28.263349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56084f-ef71-4810-989d-df52d678eb42 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:28.263782 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56084f-ef71-4810-989d-df52d678eb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:28.348490 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9c56084f-ef71-4810-989d-df52d678eb42 None None] MFA Rules not processed for user `2e95de2993204aec95115c28ca374035`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:28.350040 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9c56084f-ef71-4810-989d-df52d678eb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:28.539958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 920/1805] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:28 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:05:28.542002 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67ef95-5496-4e8b-8947-7b473252d1d0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:28.677335 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67ef95-5496-4e8b-8947-7b473252d1d0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:28.696089 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fdcd8-9596-4068-99e1-c0b4963f81c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:28.697503 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fdcd8-9596-4068-99e1-c0b4963f81c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:28.697784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fdcd8-9596-4068-99e1-c0b4963f81c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:28.698071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fdcd8-9596-4068-99e1-c0b4963f81c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:28.698796 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188fdcd8-9596-4068-99e1-c0b4963f81c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:28.703557 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188fdcd8-9596-4068-99e1-c0b4963f81c1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:28.760039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 886/1806] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:05:28 2022] POST /identity/v3/projects => generated 357 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:28.761988 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56084f-ef71-4810-989d-df52d678eb42 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:28.810681 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56084f-ef71-4810-989d-df52d678eb42 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:28.916084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa931b9a-f8d0-4109-91bd-5905912d82f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:28.917721 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa931b9a-f8d0-4109-91bd-5905912d82f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:28.918548 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa931b9a-f8d0-4109-91bd-5905912d82f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:28.918548 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa931b9a-f8d0-4109-91bd-5905912d82f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:28.919572 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa931b9a-f8d0-4109-91bd-5905912d82f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:28.922048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa931b9a-f8d0-4109-91bd-5905912d82f4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:28.977759 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 921/1807] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:05:28 2022] POST /identity/v3/users => generated 285 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:28.981793 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fdcd8-9596-4068-99e1-c0b4963f81c1 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:28.996506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fdcd8-9596-4068-99e1-c0b4963f81c1 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:29.012819 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604cced-77ab-4e8b-bbca-190c35e114e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:29.017759 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604cced-77ab-4e8b-bbca-190c35e114e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:29.021420 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604cced-77ab-4e8b-bbca-190c35e114e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:29.021925 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604cced-77ab-4e8b-bbca-190c35e114e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:29.022850 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604cced-77ab-4e8b-bbca-190c35e114e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:29.024657 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604cced-77ab-4e8b-bbca-190c35e114e2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:29.061163 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 887/1808] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:05:29.065757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa931b9a-f8d0-4109-91bd-5905912d82f4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:29.079775 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa931b9a-f8d0-4109-91bd-5905912d82f4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:29.085664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8009c66-c7de-44d2-af03-dfc168387516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:29.086824 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8009c66-c7de-44d2-af03-dfc168387516 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:29.087099 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8009c66-c7de-44d2-af03-dfc168387516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:29.087414 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8009c66-c7de-44d2-af03-dfc168387516 admin admin] PATH_INFO: `/v3/projects/90c712d582454495b1ce9f61af7dc70a/users/f0733b3fcbd44b4383984ff4e24f5636/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:29.103220 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:29.107061 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8009c66-c7de-44d2-af03-dfc168387516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c712d582454495b1ce9f61af7dc70a, user_id=f0733b3fcbd44b4383984ff4e24f5636, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:29.110899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8009c66-c7de-44d2-af03-dfc168387516 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:29.134043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 922/1809] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:05:29 2022] PUT /identity/v3/projects/90c712d582454495b1ce9f61af7dc70a/users/f0733b3fcbd44b4383984ff4e24f5636/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:29.138066 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604cced-77ab-4e8b-bbca-190c35e114e2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:29.151674 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604cced-77ab-4e8b-bbca-190c35e114e2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:29.283244 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ebb39-d792-4aab-ab96-b1b7c87fea49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:29.286504 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ebb39-d792-4aab-ab96-b1b7c87fea49 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:29.287438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ebb39-d792-4aab-ab96-b1b7c87fea49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:29.288258 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ebb39-d792-4aab-ab96-b1b7c87fea49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:29.289101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ebb39-d792-4aab-ab96-b1b7c87fea49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:29.303347 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ebb39-d792-4aab-ab96-b1b7c87fea49 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:29.320197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 888/1810] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:05:29.323420 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8009c66-c7de-44d2-af03-dfc168387516 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:29.338884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8009c66-c7de-44d2-af03-dfc168387516 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:29.350333 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5de0f-c5a1-4774-a082-6014c8bf079b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:29.351307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5de0f-c5a1-4774-a082-6014c8bf079b admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:29.351547 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5de0f-c5a1-4774-a082-6014c8bf079b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:29.351846 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5de0f-c5a1-4774-a082-6014c8bf079b admin admin] PATH_INFO: `/v3/projects/90c712d582454495b1ce9f61af7dc70a/users/f0733b3fcbd44b4383984ff4e24f5636/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:29.354523 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5de0f-c5a1-4774-a082-6014c8bf079b admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c712d582454495b1ce9f61af7dc70a, user_id=f0733b3fcbd44b4383984ff4e24f5636, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:29.358040 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5de0f-c5a1-4774-a082-6014c8bf079b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:29.384085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 923/1811] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:05:29 2022] PUT /identity/v3/projects/90c712d582454495b1ce9f61af7dc70a/users/f0733b3fcbd44b4383984ff4e24f5636/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:05:29.395440 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1a0e1-f05c-4f39-ac2a-f7a07fcfe08b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:29.396333 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1a0e1-f05c-4f39-ac2a-f7a07fcfe08b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:29.396801 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1a0e1-f05c-4f39-ac2a-f7a07fcfe08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:29.414264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:29.449385 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-44f1a0e1-f05c-4f39-ac2a-f7a07fcfe08b None None] MFA Rules not processed for user `f0733b3fcbd44b4383984ff4e24f5636`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:29.450793 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-44f1a0e1-f05c-4f39-ac2a-f7a07fcfe08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:29.663941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5de0f-c5a1-4774-a082-6014c8bf079b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:29.664203 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 889/1812] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:29 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:29.703703 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5de0f-c5a1-4774-a082-6014c8bf079b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:29.723378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e03186-3b82-4d95-b5c4-86065fb5bbdf tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0733b3fcbd44b4383984ff4e24f5636', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90c712d582454495b1ce9f61af7dc70a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:29.725441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e03186-3b82-4d95-b5c4-86065fb5bbdf tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:29.725744 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e03186-3b82-4d95-b5c4-86065fb5bbdf tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:29.726024 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e03186-3b82-4d95-b5c4-86065fb5bbdf tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:29.726785 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e03186-3b82-4d95-b5c4-86065fb5bbdf tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:05:29.727104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e03186-3b82-4d95-b5c4-86065fb5bbdf tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:29.738697 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e03186-3b82-4d95-b5c4-86065fb5bbdf tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:29.763831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e63b9-7ed8-4a3f-a5a9-1f0ebd16cfe4 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:29.764559 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e63b9-7ed8-4a3f-a5a9-1f0ebd16cfe4 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:29.765164 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e63b9-7ed8-4a3f-a5a9-1f0ebd16cfe4 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:29.768148 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 890/1813] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 19 11:05:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:05:29.773847 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 924/1814] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:05:29.775835 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e63b9-7ed8-4a3f-a5a9-1f0ebd16cfe4 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:29.788657 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ffcd3-d383-4a3b-ab38-bb83a6472192 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:29.789109 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ffcd3-d383-4a3b-ab38-bb83a6472192 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:29.789478 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ffcd3-d383-4a3b-ab38-bb83a6472192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:29.829449 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e63b9-7ed8-4a3f-a5a9-1f0ebd16cfe4 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:29.832132 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-144ffcd3-d383-4a3b-ab38-bb83a6472192 None None] MFA Rules not processed for user `3c50a821e9ef44cb9fccd49ee4af7dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:29.835607 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109a283-1db8-4189-b0d2-bf194660141a tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0733b3fcbd44b4383984ff4e24f5636', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90c712d582454495b1ce9f61af7dc70a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:29.836198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-144ffcd3-d383-4a3b-ab38-bb83a6472192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:29.836510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109a283-1db8-4189-b0d2-bf194660141a tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:29.836921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109a283-1db8-4189-b0d2-bf194660141a tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:29.837205 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109a283-1db8-4189-b0d2-bf194660141a tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:29.838191 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109a283-1db8-4189-b0d2-bf194660141a tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:29.841408 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109a283-1db8-4189-b0d2-bf194660141a tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:29.912995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 891/1815] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:05:29 2022] POST /identity/v3/projects => generated 350 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:29.917582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109a283-1db8-4189-b0d2-bf194660141a tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:30.048579 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109a283-1db8-4189-b0d2-bf194660141a tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:30.059608 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 925/1816] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 11:05:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:05:30.084052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7457a-fb5c-4b21-b601-a8f1f6767515 tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0733b3fcbd44b4383984ff4e24f5636', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90c712d582454495b1ce9f61af7dc70a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:30.086203 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7457a-fb5c-4b21-b601-a8f1f6767515 tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:30.086203 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7457a-fb5c-4b21-b601-a8f1f6767515 tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:30.086203 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7457a-fb5c-4b21-b601-a8f1f6767515 tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:30.086648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7457a-fb5c-4b21-b601-a8f1f6767515 tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:05:30.087112 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7457a-fb5c-4b21-b601-a8f1f6767515 tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:30.089041 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7457a-fb5c-4b21-b601-a8f1f6767515 tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:30.124633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 892/1817] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:05:30.249140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ffcd3-d383-4a3b-ab38-bb83a6472192 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:30.252031 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-144ffcd3-d383-4a3b-ab38-bb83a6472192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:30.362431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ffcd3-d383-4a3b-ab38-bb83a6472192 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:30.439929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46b9ec-f75c-4bfa-ac68-d2228541b7c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:30.441006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46b9ec-f75c-4bfa-ac68-d2228541b7c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:30.441549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46b9ec-f75c-4bfa-ac68-d2228541b7c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:30.442020 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46b9ec-f75c-4bfa-ac68-d2228541b7c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:30.457025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46b9ec-f75c-4bfa-ac68-d2228541b7c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:30.458914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46b9ec-f75c-4bfa-ac68-d2228541b7c8 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:30.473167 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 926/1818] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:30 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:30.758536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7457a-fb5c-4b21-b601-a8f1f6767515 tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:30.762510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1ed7457a-fb5c-4b21-b601-a8f1f6767515 tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:30.919919 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:30.942878 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7457a-fb5c-4b21-b601-a8f1f6767515 tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:30.955186 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0831cc6-17fd-4391-99ac-694c30230f01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:30.955912 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0831cc6-17fd-4391-99ac-694c30230f01 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:30.956208 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0831cc6-17fd-4391-99ac-694c30230f01 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:30.956490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0831cc6-17fd-4391-99ac-694c30230f01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:30.980586 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0831cc6-17fd-4391-99ac-694c30230f01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:30.982827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0831cc6-17fd-4391-99ac-694c30230f01 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:31.009256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 893/1819] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:31.620137 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46b9ec-f75c-4bfa-ac68-d2228541b7c8 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:31.630035 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46b9ec-f75c-4bfa-ac68-d2228541b7c8 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:31.646282 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffd82e-f854-42d2-86ce-90c08a70399f tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0733b3fcbd44b4383984ff4e24f5636', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90c712d582454495b1ce9f61af7dc70a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:31.647470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffd82e-f854-42d2-86ce-90c08a70399f tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:31.647966 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffd82e-f854-42d2-86ce-90c08a70399f tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:31.648455 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffd82e-f854-42d2-86ce-90c08a70399f tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] PATH_INFO: `/v3/projects/05195968988f472d87471527ea2e09c3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:31.653681 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fffd82e-f854-42d2-86ce-90c08a70399f tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] RBAC: Authorizing `identity:delete_project(project_id=05195968988f472d87471527ea2e09c3)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:31.656616 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fffd82e-f854-42d2-86ce-90c08a70399f tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:31.702600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:31.810168 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2fffd82e-f854-42d2-86ce-90c08a70399f tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05195968988f472d87471527ea2e09c3', 'request_id': 'req-2fffd82e-f854-42d2-86ce-90c08a70399f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:31.828853 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2fffd82e-f854-42d2-86ce-90c08a70399f tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05195968988f472d87471527ea2e09c3', 'request_id': 'req-2fffd82e-f854-42d2-86ce-90c08a70399f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:31.847923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2fffd82e-f854-42d2-86ce-90c08a70399f tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05195968988f472d87471527ea2e09c3', 'request_id': 'req-2fffd82e-f854-42d2-86ce-90c08a70399f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:31.876991 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2fffd82e-f854-42d2-86ce-90c08a70399f tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] The token cache is being invalidate because project 05195968988f472d87471527ea2e09c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:05:31.877514 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2fffd82e-f854-42d2-86ce-90c08a70399f tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:31.883310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2fffd82e-f854-42d2-86ce-90c08a70399f tempest-QuotasTest-1989458299 tempest-QuotasTest-1989458299-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:31.887003 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 927/1820] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:05:31 2022] DELETE /identity/v3/projects/05195968988f472d87471527ea2e09c3 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:33.110268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0831cc6-17fd-4391-99ac-694c30230f01 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:33.381621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0831cc6-17fd-4391-99ac-694c30230f01 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:33.531661 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd248a9-659b-4971-bfce-28cebc467857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:33.532614 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd248a9-659b-4971-bfce-28cebc467857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:33.533038 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd248a9-659b-4971-bfce-28cebc467857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:33.533379 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd248a9-659b-4971-bfce-28cebc467857 admin admin] PATH_INFO: `/v3/users/2e95de2993204aec95115c28ca374035` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:33.534973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd248a9-659b-4971-bfce-28cebc467857 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e95de2993204aec95115c28ca374035)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:33.539071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd248a9-659b-4971-bfce-28cebc467857 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:33.642645 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1dd248a9-659b-4971-bfce-28cebc467857 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e95de2993204aec95115c28ca374035'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:33.660513 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1dd248a9-659b-4971-bfce-28cebc467857 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e95de2993204aec95115c28ca374035'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:33.688200 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1dd248a9-659b-4971-bfce-28cebc467857 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e95de2993204aec95115c28ca374035'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:33.689443 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1dd248a9-659b-4971-bfce-28cebc467857 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e95de2993204aec95115c28ca374035'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:33.699664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1dd248a9-659b-4971-bfce-28cebc467857 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e95de2993204aec95115c28ca374035'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:33.708582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 894/1821] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:05:33 2022] DELETE /identity/v3/users/2e95de2993204aec95115c28ca374035 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:33.713550 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630216e3-1107-4fa5-a249-8a04d9168fc7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:33.714511 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630216e3-1107-4fa5-a249-8a04d9168fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:33.715525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630216e3-1107-4fa5-a249-8a04d9168fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:33.741131 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-630216e3-1107-4fa5-a249-8a04d9168fc7 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:33.742551 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-630216e3-1107-4fa5-a249-8a04d9168fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:33.833856 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 928/1822] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:33.898187 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd248a9-659b-4971-bfce-28cebc467857 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:33.900366 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1dd248a9-659b-4971-bfce-28cebc467857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:33.943501 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:34.014026 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd248a9-659b-4971-bfce-28cebc467857 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:34.022487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0376c3e-36c8-4fdd-9b76-917de352c4b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:34.024166 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0376c3e-36c8-4fdd-9b76-917de352c4b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:34.024852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0376c3e-36c8-4fdd-9b76-917de352c4b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:34.025341 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0376c3e-36c8-4fdd-9b76-917de352c4b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:34.049157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0376c3e-36c8-4fdd-9b76-917de352c4b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:34.051025 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0376c3e-36c8-4fdd-9b76-917de352c4b7 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:34.064364 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 895/1823] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:35.364610 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630216e3-1107-4fa5-a249-8a04d9168fc7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:35.368555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-630216e3-1107-4fa5-a249-8a04d9168fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:35.391766 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630216e3-1107-4fa5-a249-8a04d9168fc7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:35.406002 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ce5ac-d98e-49f3-bbc3-325154bbf45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:35.408572 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ce5ac-d98e-49f3-bbc3-325154bbf45d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:35.409168 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ce5ac-d98e-49f3-bbc3-325154bbf45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:35.409744 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ce5ac-d98e-49f3-bbc3-325154bbf45d admin admin] PATH_INFO: `/v3/projects/b1ff92ba1fcb4352a2535e29420709cd` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:35.419354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ce5ac-d98e-49f3-bbc3-325154bbf45d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1ff92ba1fcb4352a2535e29420709cd)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:35.421992 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ce5ac-d98e-49f3-bbc3-325154bbf45d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:35.548948 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-115ce5ac-d98e-49f3-bbc3-325154bbf45d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1ff92ba1fcb4352a2535e29420709cd', 'request_id': 'req-115ce5ac-d98e-49f3-bbc3-325154bbf45d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:35.565823 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-115ce5ac-d98e-49f3-bbc3-325154bbf45d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1ff92ba1fcb4352a2535e29420709cd', 'request_id': 'req-115ce5ac-d98e-49f3-bbc3-325154bbf45d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:35.635635 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-115ce5ac-d98e-49f3-bbc3-325154bbf45d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1ff92ba1fcb4352a2535e29420709cd', 'request_id': 'req-115ce5ac-d98e-49f3-bbc3-325154bbf45d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:35.681078 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-115ce5ac-d98e-49f3-bbc3-325154bbf45d admin admin] The token cache is being invalidate because project b1ff92ba1fcb4352a2535e29420709cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:05:35.681451 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-115ce5ac-d98e-49f3-bbc3-325154bbf45d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:35.682265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-115ce5ac-d98e-49f3-bbc3-325154bbf45d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:35.685441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 929/1824] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:05:35 2022] DELETE /identity/v3/projects/b1ff92ba1fcb4352a2535e29420709cd => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:35.689646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0376c3e-36c8-4fdd-9b76-917de352c4b7 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:35.702676 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0376c3e-36c8-4fdd-9b76-917de352c4b7 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:35.784122 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f90b9d-aee9-4cc3-a014-98145fc09953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:35.785135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f90b9d-aee9-4cc3-a014-98145fc09953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:35.785414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f90b9d-aee9-4cc3-a014-98145fc09953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:35.785687 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f90b9d-aee9-4cc3-a014-98145fc09953 admin admin] PATH_INFO: `/v3/users/f0733b3fcbd44b4383984ff4e24f5636` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:35.786953 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f90b9d-aee9-4cc3-a014-98145fc09953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0733b3fcbd44b4383984ff4e24f5636)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:35.788982 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f90b9d-aee9-4cc3-a014-98145fc09953 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:35.854238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f0f90b9d-aee9-4cc3-a014-98145fc09953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0733b3fcbd44b4383984ff4e24f5636'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:35.862643 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f0f90b9d-aee9-4cc3-a014-98145fc09953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0733b3fcbd44b4383984ff4e24f5636'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:35.881042 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f0f90b9d-aee9-4cc3-a014-98145fc09953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0733b3fcbd44b4383984ff4e24f5636'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:35.881761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f0f90b9d-aee9-4cc3-a014-98145fc09953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0733b3fcbd44b4383984ff4e24f5636'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:35.896066 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f0f90b9d-aee9-4cc3-a014-98145fc09953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0733b3fcbd44b4383984ff4e24f5636'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:35.903749 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 896/1825] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:05:35 2022] DELETE /identity/v3/users/f0733b3fcbd44b4383984ff4e24f5636 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:37.121258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ce5ac-d98e-49f3-bbc3-325154bbf45d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:37.123947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-115ce5ac-d98e-49f3-bbc3-325154bbf45d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:37.159273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ce5ac-d98e-49f3-bbc3-325154bbf45d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:37.224653 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:37.291134 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15897214-85a1-4781-b3bd-df15f7f67697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:37.292113 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15897214-85a1-4781-b3bd-df15f7f67697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:37.293210 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15897214-85a1-4781-b3bd-df15f7f67697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:37.293500 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15897214-85a1-4781-b3bd-df15f7f67697 admin admin] PATH_INFO: `/v3/projects/90c712d582454495b1ce9f61af7dc70a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:37.296109 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15897214-85a1-4781-b3bd-df15f7f67697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90c712d582454495b1ce9f61af7dc70a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:37.298220 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15897214-85a1-4781-b3bd-df15f7f67697 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:37.396431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-15897214-85a1-4781-b3bd-df15f7f67697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90c712d582454495b1ce9f61af7dc70a', 'request_id': 'req-15897214-85a1-4781-b3bd-df15f7f67697'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:37.407552 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-15897214-85a1-4781-b3bd-df15f7f67697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90c712d582454495b1ce9f61af7dc70a', 'request_id': 'req-15897214-85a1-4781-b3bd-df15f7f67697'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:37.416651 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-15897214-85a1-4781-b3bd-df15f7f67697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90c712d582454495b1ce9f61af7dc70a', 'request_id': 'req-15897214-85a1-4781-b3bd-df15f7f67697'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:37.454407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-15897214-85a1-4781-b3bd-df15f7f67697 admin admin] The token cache is being invalidate because project 90c712d582454495b1ce9f61af7dc70a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:05:37.454703 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-15897214-85a1-4781-b3bd-df15f7f67697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:37.460644 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-15897214-85a1-4781-b3bd-df15f7f67697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:37.464253 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 930/1826] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:05:37 2022] DELETE /identity/v3/projects/90c712d582454495b1ce9f61af7dc70a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:37.474573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa414e-5643-48e2-93e8-e4c0d9039504 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:37.475409 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa414e-5643-48e2-93e8-e4c0d9039504 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:37.477138 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa414e-5643-48e2-93e8-e4c0d9039504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:37.518545 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-83aa414e-5643-48e2-93e8-e4c0d9039504 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:37.522782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-83aa414e-5643-48e2-93e8-e4c0d9039504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:37.611630 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:37.678448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 897/1827] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:37.688380 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6808f-5a8d-4485-accc-b430348fe6ca None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:37.688662 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6808f-5a8d-4485-accc-b430348fe6ca None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:37.688966 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6808f-5a8d-4485-accc-b430348fe6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:37.735131 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-41a6808f-5a8d-4485-accc-b430348fe6ca None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:37.737401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-41a6808f-5a8d-4485-accc-b430348fe6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:37.748907 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 931/1828] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:37.753159 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa414e-5643-48e2-93e8-e4c0d9039504 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:37.778200 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa414e-5643-48e2-93e8-e4c0d9039504 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:37.792575 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba021f-6601-4af5-ab6b-19cc960fb529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:37.794316 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba021f-6601-4af5-ab6b-19cc960fb529 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:37.794716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba021f-6601-4af5-ab6b-19cc960fb529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:37.795105 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba021f-6601-4af5-ab6b-19cc960fb529 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:37.796841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba021f-6601-4af5-ab6b-19cc960fb529 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:05:37.797276 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba021f-6601-4af5-ab6b-19cc960fb529 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:37.801002 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba021f-6601-4af5-ab6b-19cc960fb529 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:37.843362 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 898/1829] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:05:37.849856 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6808f-5a8d-4485-accc-b430348fe6ca None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:37.888618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6808f-5a8d-4485-accc-b430348fe6ca None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:37.906045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc808f5-dd9d-4926-86fd-3fffddf8abaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:37.907822 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc808f5-dd9d-4926-86fd-3fffddf8abaf admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:37.908111 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc808f5-dd9d-4926-86fd-3fffddf8abaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:37.908391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc808f5-dd9d-4926-86fd-3fffddf8abaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:37.909163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc808f5-dd9d-4926-86fd-3fffddf8abaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:37.911188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc808f5-dd9d-4926-86fd-3fffddf8abaf admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:37.995943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba021f-6601-4af5-ab6b-19cc960fb529 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:38.006913 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 932/1830] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:05:37 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:38.011630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc808f5-dd9d-4926-86fd-3fffddf8abaf admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:38.021857 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba021f-6601-4af5-ab6b-19cc960fb529 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:38.024608 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4fc808f5-dd9d-4926-86fd-3fffddf8abaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:38.165906 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430506dd-3afa-48b5-b465-f3b2f9e237be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:38.166158 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430506dd-3afa-48b5-b465-f3b2f9e237be admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:38.166447 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430506dd-3afa-48b5-b465-f3b2f9e237be admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:38.166724 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430506dd-3afa-48b5-b465-f3b2f9e237be admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:38.167423 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430506dd-3afa-48b5-b465-f3b2f9e237be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:38.169426 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430506dd-3afa-48b5-b465-f3b2f9e237be admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:38.181452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc808f5-dd9d-4926-86fd-3fffddf8abaf admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:38.194807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e93f8-30b5-4d81-909f-bb462b200731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:38.197655 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e93f8-30b5-4d81-909f-bb462b200731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:38.198402 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e93f8-30b5-4d81-909f-bb462b200731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:38.199497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e93f8-30b5-4d81-909f-bb462b200731 admin admin] PATH_INFO: `/v3/users/d387ad98d01b4071bad7861470fceebb` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:38.203034 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e93f8-30b5-4d81-909f-bb462b200731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d387ad98d01b4071bad7861470fceebb)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:38.209384 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e93f8-30b5-4d81-909f-bb462b200731 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:38.222973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 899/1831] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:05:37 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:38.228228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430506dd-3afa-48b5-b465-f3b2f9e237be admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:38.250742 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430506dd-3afa-48b5-b465-f3b2f9e237be admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:38.262518 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67428a33-751e-43d1-8fcc-87babca202c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:38.265861 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67428a33-751e-43d1-8fcc-87babca202c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:38.265861 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67428a33-751e-43d1-8fcc-87babca202c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:38.265861 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67428a33-751e-43d1-8fcc-87babca202c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:38.265861 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67428a33-751e-43d1-8fcc-87babca202c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:38.266169 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67428a33-751e-43d1-8fcc-87babca202c0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:38.269698 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:38.286769 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 900/1832] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:05:38.291345 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67428a33-751e-43d1-8fcc-87babca202c0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:38.319377 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-561e93f8-30b5-4d81-909f-bb462b200731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd387ad98d01b4071bad7861470fceebb'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:38.319602 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67428a33-751e-43d1-8fcc-87babca202c0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:38.330745 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14389b6c-749e-43e2-a56c-610ec2bb11a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:38.332952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14389b6c-749e-43e2-a56c-610ec2bb11a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:38.333352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14389b6c-749e-43e2-a56c-610ec2bb11a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:38.335364 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14389b6c-749e-43e2-a56c-610ec2bb11a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:38.336585 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14389b6c-749e-43e2-a56c-610ec2bb11a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:38.337681 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-561e93f8-30b5-4d81-909f-bb462b200731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd387ad98d01b4071bad7861470fceebb'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:38.341032 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14389b6c-749e-43e2-a56c-610ec2bb11a6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:38.357957 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-561e93f8-30b5-4d81-909f-bb462b200731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd387ad98d01b4071bad7861470fceebb'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:38.358553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-561e93f8-30b5-4d81-909f-bb462b200731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd387ad98d01b4071bad7861470fceebb'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:38.359917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-561e93f8-30b5-4d81-909f-bb462b200731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd387ad98d01b4071bad7861470fceebb'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:38.367797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 901/1833] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:05:38.369273 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14389b6c-749e-43e2-a56c-610ec2bb11a6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:38.372915 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-14389b6c-749e-43e2-a56c-610ec2bb11a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:38.396577 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14389b6c-749e-43e2-a56c-610ec2bb11a6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:38.406163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 933/1834] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:05:38 2022] DELETE /identity/v3/users/d387ad98d01b4071bad7861470fceebb => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:38.410803 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a4703-d73e-48c0-b776-b537de8ef6af None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:38.411110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a4703-d73e-48c0-b776-b537de8ef6af None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:38.411385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a4703-d73e-48c0-b776-b537de8ef6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:38.450212 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a63a4703-d73e-48c0-b776-b537de8ef6af None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:38.450788 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a63a4703-d73e-48c0-b776-b537de8ef6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:38.542202 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 934/1835] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:38.555551 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a4703-d73e-48c0-b776-b537de8ef6af None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:38.556160 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecdce34-1d92-431c-ab2c-8be65c539951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:38.558657 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a63a4703-d73e-48c0-b776-b537de8ef6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:38.559257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdce34-1d92-431c-ab2c-8be65c539951 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:38.559538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdce34-1d92-431c-ab2c-8be65c539951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:38.559813 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdce34-1d92-431c-ab2c-8be65c539951 admin admin] PATH_INFO: `/v3/projects/32e9240a382c4757b2d0f6d75f25c647/users/6d0685c7d83e42ce8e5220d3e177ede6/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:38.604073 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecdce34-1d92-431c-ab2c-8be65c539951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32e9240a382c4757b2d0f6d75f25c647, user_id=6d0685c7d83e42ce8e5220d3e177ede6, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:38.610091 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecdce34-1d92-431c-ab2c-8be65c539951 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:38.649402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 902/1836] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:05:38 2022] PUT /identity/v3/projects/32e9240a382c4757b2d0f6d75f25c647/users/6d0685c7d83e42ce8e5220d3e177ede6/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:38.660989 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37d9b6-a80c-42a3-bd59-9277b91a09b9 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:38.661541 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37d9b6-a80c-42a3-bd59-9277b91a09b9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:38.661993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37d9b6-a80c-42a3-bd59-9277b91a09b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:38.670409 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a4703-d73e-48c0-b776-b537de8ef6af None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:38.716839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3f37d9b6-a80c-42a3-bd59-9277b91a09b9 None None] MFA Rules not processed for user `6d0685c7d83e42ce8e5220d3e177ede6`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:38.718880 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3f37d9b6-a80c-42a3-bd59-9277b91a09b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:38.732511 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:38.742161 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21156050-ac3f-48d3-bb22-26d931c1284e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:38.743050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21156050-ac3f-48d3-bb22-26d931c1284e service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:38.743386 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21156050-ac3f-48d3-bb22-26d931c1284e service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:38.743881 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21156050-ac3f-48d3-bb22-26d931c1284e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:38.760259 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:38.862797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 903/1837] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:05:38.866909 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37d9b6-a80c-42a3-bd59-9277b91a09b9 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:38.892462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21156050-ac3f-48d3-bb22-26d931c1284e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:38.894923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21156050-ac3f-48d3-bb22-26d931c1284e service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:38.909826 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 935/1838] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:39.007441 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37d9b6-a80c-42a3-bd59-9277b91a09b9 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:39.016558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc5f21-6720-407a-82ec-e3d9ae3a7ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:39.017318 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc5f21-6720-407a-82ec-e3d9ae3a7ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:39.017614 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc5f21-6720-407a-82ec-e3d9ae3a7ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:39.017895 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc5f21-6720-407a-82ec-e3d9ae3a7ac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:39.018661 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc5f21-6720-407a-82ec-e3d9ae3a7ac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:39.020702 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc5f21-6720-407a-82ec-e3d9ae3a7ac2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:39.075894 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 904/1839] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:05:38 2022] POST /identity/v3/projects => generated 377 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:05:39.080613 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21156050-ac3f-48d3-bb22-26d931c1284e service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:39.094046 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21156050-ac3f-48d3-bb22-26d931c1284e service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:39.275879 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae697ec-fb94-4a97-8d88-696f6a3c1096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:39.277861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae697ec-fb94-4a97-8d88-696f6a3c1096 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:39.281161 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae697ec-fb94-4a97-8d88-696f6a3c1096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:39.281350 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae697ec-fb94-4a97-8d88-696f6a3c1096 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:39.282302 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae697ec-fb94-4a97-8d88-696f6a3c1096 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:39.287536 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae697ec-fb94-4a97-8d88-696f6a3c1096 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:39.348862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 936/1840] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:05:39 2022] POST /identity/v3/users => generated 295 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:39.350768 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc5f21-6720-407a-82ec-e3d9ae3a7ac2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:39.381176 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc5f21-6720-407a-82ec-e3d9ae3a7ac2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:39.393764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df55de-197e-4fef-bd88-68c1a56f9f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:39.394780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df55de-197e-4fef-bd88-68c1a56f9f51 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:39.395295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df55de-197e-4fef-bd88-68c1a56f9f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:39.395664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df55de-197e-4fef-bd88-68c1a56f9f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:39.397174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df55de-197e-4fef-bd88-68c1a56f9f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:39.401794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df55de-197e-4fef-bd88-68c1a56f9f51 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:39.429197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 905/1841] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:05:39.429390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae697ec-fb94-4a97-8d88-696f6a3c1096 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:39.449695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae697ec-fb94-4a97-8d88-696f6a3c1096 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:39.464486 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a8cd2-df19-48d6-bf01-c8510f83ec02 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:39.464687 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d720c75-51ef-4116-9db6-b55a35150246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:39.464996 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a8cd2-df19-48d6-bf01-c8510f83ec02 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:39.465179 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a8cd2-df19-48d6-bf01-c8510f83ec02 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:39.465644 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d720c75-51ef-4116-9db6-b55a35150246 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:39.465928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d720c75-51ef-4116-9db6-b55a35150246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:39.466204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d720c75-51ef-4116-9db6-b55a35150246 admin admin] PATH_INFO: `/v3/projects/181869cbac684e7f8414607a2845dd19/users/10b832aff2674870a833b319795ace4b/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:39.466794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 906/1842] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 19 11:05:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:05:39.486669 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca978aa-f7c9-4cc1-b7b1-c51f0a3b5b81 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:39.487228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca978aa-f7c9-4cc1-b7b1-c51f0a3b5b81 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:39.487739 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca978aa-f7c9-4cc1-b7b1-c51f0a3b5b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:39.502140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d720c75-51ef-4116-9db6-b55a35150246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=181869cbac684e7f8414607a2845dd19, user_id=10b832aff2674870a833b319795ace4b, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:39.504969 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d720c75-51ef-4116-9db6-b55a35150246 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:39.534051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 937/1843] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:05:39 2022] PUT /identity/v3/projects/181869cbac684e7f8414607a2845dd19/users/10b832aff2674870a833b319795ace4b/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:39.534051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d720c75-51ef-4116-9db6-b55a35150246 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:39.536655 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5ca978aa-f7c9-4cc1-b7b1-c51f0a3b5b81 None None] MFA Rules not processed for user `3c50a821e9ef44cb9fccd49ee4af7dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:39.540612 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5ca978aa-f7c9-4cc1-b7b1-c51f0a3b5b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:39.648706 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d720c75-51ef-4116-9db6-b55a35150246 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:39.654608 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f614c-fa1f-49ab-b890-fd93c4e6ff29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:39.655309 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f614c-fa1f-49ab-b890-fd93c4e6ff29 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:39.655591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f614c-fa1f-49ab-b890-fd93c4e6ff29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:39.655866 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f614c-fa1f-49ab-b890-fd93c4e6ff29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:39.656837 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f614c-fa1f-49ab-b890-fd93c4e6ff29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:39.659016 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f614c-fa1f-49ab-b890-fd93c4e6ff29 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:39.708589 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 938/1844] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:05:39.711534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f614c-fa1f-49ab-b890-fd93c4e6ff29 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:39.714455 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 907/1845] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 11:05:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:39.735931 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f614c-fa1f-49ab-b890-fd93c4e6ff29 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:39.741021 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bafcb-95b4-47e0-b440-f21b953afd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:39.741961 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bafcb-95b4-47e0-b440-f21b953afd92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:39.742258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bafcb-95b4-47e0-b440-f21b953afd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:39.742517 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bafcb-95b4-47e0-b440-f21b953afd92 admin admin] PATH_INFO: `/v3/projects/181869cbac684e7f8414607a2845dd19/users/10b832aff2674870a833b319795ace4b/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:39.745025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755bafcb-95b4-47e0-b440-f21b953afd92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=181869cbac684e7f8414607a2845dd19, user_id=10b832aff2674870a833b319795ace4b, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:39.748444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755bafcb-95b4-47e0-b440-f21b953afd92 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:39.768795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:39.777251 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 939/1846] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:05:39 2022] PUT /identity/v3/projects/181869cbac684e7f8414607a2845dd19/users/10b832aff2674870a833b319795ace4b/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:39.782854 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd133432-3ffe-4b9f-9d09-67aedc5fdc81 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:39.783279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd133432-3ffe-4b9f-9d09-67aedc5fdc81 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:39.783774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd133432-3ffe-4b9f-9d09-67aedc5fdc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:39.825232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:39.839963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-bd133432-3ffe-4b9f-9d09-67aedc5fdc81 None None] MFA Rules not processed for user `10b832aff2674870a833b319795ace4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:39.842226 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bd133432-3ffe-4b9f-9d09-67aedc5fdc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:40.023384 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 908/1847] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:40.075798 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bafcb-95b4-47e0-b440-f21b953afd92 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:40.079410 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-755bafcb-95b4-47e0-b440-f21b953afd92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:40.237767 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bafcb-95b4-47e0-b440-f21b953afd92 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:40.247467 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd133432-3ffe-4b9f-9d09-67aedc5fdc81 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:40.249285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bd133432-3ffe-4b9f-9d09-67aedc5fdc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:40.250588 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666d03b-62d3-4243-a1a7-2524d1a2615a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:40.251271 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666d03b-62d3-4243-a1a7-2524d1a2615a service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:40.251607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666d03b-62d3-4243-a1a7-2524d1a2615a service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:40.251816 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666d03b-62d3-4243-a1a7-2524d1a2615a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:40.270161 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666d03b-62d3-4243-a1a7-2524d1a2615a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:40.271440 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666d03b-62d3-4243-a1a7-2524d1a2615a service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:40.283129 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 940/1848] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:40.356793 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd133432-3ffe-4b9f-9d09-67aedc5fdc81 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:40.366855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89194c-714c-4ad2-9022-f9647f344e13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:40.369462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89194c-714c-4ad2-9022-f9647f344e13 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:40.369870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89194c-714c-4ad2-9022-f9647f344e13 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:40.370244 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89194c-714c-4ad2-9022-f9647f344e13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:40.394581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89194c-714c-4ad2-9022-f9647f344e13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:40.396533 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89194c-714c-4ad2-9022-f9647f344e13 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:40.414425 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 909/1849] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:40.551924 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666d03b-62d3-4243-a1a7-2524d1a2615a service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:40.557413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d666d03b-62d3-4243-a1a7-2524d1a2615a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:40.754349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666d03b-62d3-4243-a1a7-2524d1a2615a service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:40.774416 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e924cf1-770b-4f16-9e8e-29a79c0f8014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:40.775384 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924cf1-770b-4f16-9e8e-29a79c0f8014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:40.775687 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924cf1-770b-4f16-9e8e-29a79c0f8014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:40.775988 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924cf1-770b-4f16-9e8e-29a79c0f8014 admin admin] PATH_INFO: `/v3/projects/38493b8cf46f4b94a95575ba0272dd8b` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:40.777913 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e924cf1-770b-4f16-9e8e-29a79c0f8014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38493b8cf46f4b94a95575ba0272dd8b)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:40.779844 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e924cf1-770b-4f16-9e8e-29a79c0f8014 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:40.919672 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2e924cf1-770b-4f16-9e8e-29a79c0f8014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38493b8cf46f4b94a95575ba0272dd8b', 'request_id': 'req-2e924cf1-770b-4f16-9e8e-29a79c0f8014'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:40.932225 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2e924cf1-770b-4f16-9e8e-29a79c0f8014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38493b8cf46f4b94a95575ba0272dd8b', 'request_id': 'req-2e924cf1-770b-4f16-9e8e-29a79c0f8014'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:40.967708 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2e924cf1-770b-4f16-9e8e-29a79c0f8014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38493b8cf46f4b94a95575ba0272dd8b', 'request_id': 'req-2e924cf1-770b-4f16-9e8e-29a79c0f8014'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:41.001534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2e924cf1-770b-4f16-9e8e-29a79c0f8014 admin admin] The token cache is being invalidate because project 38493b8cf46f4b94a95575ba0272dd8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:05:41.002055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2e924cf1-770b-4f16-9e8e-29a79c0f8014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:41.004057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2e924cf1-770b-4f16-9e8e-29a79c0f8014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:41.007610 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 941/1850] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:05:40 2022] DELETE /identity/v3/projects/38493b8cf46f4b94a95575ba0272dd8b => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:41.013617 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89194c-714c-4ad2-9022-f9647f344e13 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:41.030186 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89194c-714c-4ad2-9022-f9647f344e13 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:41.135195 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c2bd0-fc24-48c0-8b36-55dd12fc763e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:41.142960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c2bd0-fc24-48c0-8b36-55dd12fc763e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:41.143413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c2bd0-fc24-48c0-8b36-55dd12fc763e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:41.144637 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c2bd0-fc24-48c0-8b36-55dd12fc763e admin admin] PATH_INFO: `/v3/users/bf315aa1abf64a40920978425723f63f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:41.146690 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c2bd0-fc24-48c0-8b36-55dd12fc763e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf315aa1abf64a40920978425723f63f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:41.150180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c2bd0-fc24-48c0-8b36-55dd12fc763e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:41.186939 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:41.235419 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-684c2bd0-fc24-48c0-8b36-55dd12fc763e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf315aa1abf64a40920978425723f63f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:41.247006 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-684c2bd0-fc24-48c0-8b36-55dd12fc763e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf315aa1abf64a40920978425723f63f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:41.301043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-684c2bd0-fc24-48c0-8b36-55dd12fc763e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf315aa1abf64a40920978425723f63f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:41.302285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-684c2bd0-fc24-48c0-8b36-55dd12fc763e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf315aa1abf64a40920978425723f63f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:41.334076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-684c2bd0-fc24-48c0-8b36-55dd12fc763e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf315aa1abf64a40920978425723f63f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:41.384372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 910/1851] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:05:41 2022] DELETE /identity/v3/users/bf315aa1abf64a40920978425723f63f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:42.327171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e924cf1-770b-4f16-9e8e-29a79c0f8014 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:42.329602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2e924cf1-770b-4f16-9e8e-29a79c0f8014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:42.347083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e924cf1-770b-4f16-9e8e-29a79c0f8014 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:42.386447 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:42.421183 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41f150-96da-422d-8b51-1afd538fba25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:42.422563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41f150-96da-422d-8b51-1afd538fba25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:42.422886 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41f150-96da-422d-8b51-1afd538fba25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:42.423209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41f150-96da-422d-8b51-1afd538fba25 admin admin] PATH_INFO: `/v3/projects/efbadbdac50143ef878bd0a653fd1242` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:42.424773 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41f150-96da-422d-8b51-1afd538fba25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efbadbdac50143ef878bd0a653fd1242)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:42.427101 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41f150-96da-422d-8b51-1afd538fba25 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:42.510976 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ba41f150-96da-422d-8b51-1afd538fba25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efbadbdac50143ef878bd0a653fd1242', 'request_id': 'req-ba41f150-96da-422d-8b51-1afd538fba25'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:42.523709 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ba41f150-96da-422d-8b51-1afd538fba25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efbadbdac50143ef878bd0a653fd1242', 'request_id': 'req-ba41f150-96da-422d-8b51-1afd538fba25'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:42.536759 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ba41f150-96da-422d-8b51-1afd538fba25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efbadbdac50143ef878bd0a653fd1242', 'request_id': 'req-ba41f150-96da-422d-8b51-1afd538fba25'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:42.571327 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ba41f150-96da-422d-8b51-1afd538fba25 admin admin] The token cache is being invalidate because project efbadbdac50143ef878bd0a653fd1242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:05:42.571618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ba41f150-96da-422d-8b51-1afd538fba25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:42.572322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ba41f150-96da-422d-8b51-1afd538fba25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:42.577458 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 942/1852] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:05:42 2022] DELETE /identity/v3/projects/efbadbdac50143ef878bd0a653fd1242 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:42.579091 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d69ff3-5ec1-4d90-b460-665be4f963b2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:42.579582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d69ff3-5ec1-4d90-b460-665be4f963b2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:42.580024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d69ff3-5ec1-4d90-b460-665be4f963b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:42.609460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-18d69ff3-5ec1-4d90-b460-665be4f963b2 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:42.611137 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-18d69ff3-5ec1-4d90-b460-665be4f963b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:42.723949 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 911/1853] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:42.734712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1b3df-315c-426f-a3cd-4ccdb2354f40 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:42.734984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1b3df-315c-426f-a3cd-4ccdb2354f40 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:42.735268 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1b3df-315c-426f-a3cd-4ccdb2354f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:42.779544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5ef1b3df-315c-426f-a3cd-4ccdb2354f40 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:42.785027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5ef1b3df-315c-426f-a3cd-4ccdb2354f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:42.801242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 943/1854] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:05:42.805821 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d69ff3-5ec1-4d90-b460-665be4f963b2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:42.838729 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d69ff3-5ec1-4d90-b460-665be4f963b2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:42.854132 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72898d4c-b995-4441-b89a-5ce386df3bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:42.855124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72898d4c-b995-4441-b89a-5ce386df3bed admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:42.855597 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72898d4c-b995-4441-b89a-5ce386df3bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:42.856065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72898d4c-b995-4441-b89a-5ce386df3bed admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:42.868995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72898d4c-b995-4441-b89a-5ce386df3bed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:05:42.870552 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72898d4c-b995-4441-b89a-5ce386df3bed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:42.877576 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72898d4c-b995-4441-b89a-5ce386df3bed admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:42.901012 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 912/1855] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:05:42.905179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1b3df-315c-426f-a3cd-4ccdb2354f40 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:42.917915 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1b3df-315c-426f-a3cd-4ccdb2354f40 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:42.923528 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a048c-7a37-4873-a16d-6d479f3a451d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:42.926149 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a048c-7a37-4873-a16d-6d479f3a451d admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:42.926354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a048c-7a37-4873-a16d-6d479f3a451d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:42.926688 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a048c-7a37-4873-a16d-6d479f3a451d admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:42.927397 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a048c-7a37-4873-a16d-6d479f3a451d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:42.930220 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a048c-7a37-4873-a16d-6d479f3a451d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:42.965743 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 944/1856] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:05:42 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:05:42.971273 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72898d4c-b995-4441-b89a-5ce386df3bed admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:42.982686 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72898d4c-b995-4441-b89a-5ce386df3bed admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:43.066339 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c5208-daa8-4ad8-b915-5e12b27d3473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:43.067243 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c5208-daa8-4ad8-b915-5e12b27d3473 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:43.067540 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c5208-daa8-4ad8-b915-5e12b27d3473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:43.071373 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c5208-daa8-4ad8-b915-5e12b27d3473 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:43.072156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c5208-daa8-4ad8-b915-5e12b27d3473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:43.074528 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c5208-daa8-4ad8-b915-5e12b27d3473 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:43.119519 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 913/1857] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:05:42 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:43.123582 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a048c-7a37-4873-a16d-6d479f3a451d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:43.161502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a048c-7a37-4873-a16d-6d479f3a451d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:43.172283 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a95815-73b0-4df5-adbf-cf429e2b0f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:43.173435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a95815-73b0-4df5-adbf-cf429e2b0f74 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:43.173851 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a95815-73b0-4df5-adbf-cf429e2b0f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:43.174249 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a95815-73b0-4df5-adbf-cf429e2b0f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:43.176312 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a95815-73b0-4df5-adbf-cf429e2b0f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:43.178763 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a95815-73b0-4df5-adbf-cf429e2b0f74 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:43.209418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 945/1858] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:05:43.214242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c5208-daa8-4ad8-b915-5e12b27d3473 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:43.226398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c5208-daa8-4ad8-b915-5e12b27d3473 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:43.232538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d8177-4943-4d50-91d6-eb61d4df3890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:43.233914 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d8177-4943-4d50-91d6-eb61d4df3890 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:43.234290 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d8177-4943-4d50-91d6-eb61d4df3890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:43.234677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d8177-4943-4d50-91d6-eb61d4df3890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:43.235779 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d8177-4943-4d50-91d6-eb61d4df3890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:43.237764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d8177-4943-4d50-91d6-eb61d4df3890 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:43.256348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 914/1859] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:05:43.260776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a95815-73b0-4df5-adbf-cf429e2b0f74 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:43.276508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a95815-73b0-4df5-adbf-cf429e2b0f74 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:43.282316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eed978-1b1e-49a9-a7f3-c9931a81f7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:43.283282 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eed978-1b1e-49a9-a7f3-c9931a81f7da admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:43.283514 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eed978-1b1e-49a9-a7f3-c9931a81f7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:43.283802 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eed978-1b1e-49a9-a7f3-c9931a81f7da admin admin] PATH_INFO: `/v3/projects/8ffffc620f4a4953b1c14d6bfce66704/users/de76c75faded4b93a5ac9dfaaa72442f/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:43.305108 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eed978-1b1e-49a9-a7f3-c9931a81f7da admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ffffc620f4a4953b1c14d6bfce66704, user_id=de76c75faded4b93a5ac9dfaaa72442f, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:43.308149 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eed978-1b1e-49a9-a7f3-c9931a81f7da admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:43.337273 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936b815-f1da-4086-b624-0ce7d48566c2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:43.338156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936b815-f1da-4086-b624-0ce7d48566c2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:43.338156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936b815-f1da-4086-b624-0ce7d48566c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:43.338320 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 946/1860] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:05:43 2022] PUT /identity/v3/projects/8ffffc620f4a4953b1c14d6bfce66704/users/de76c75faded4b93a5ac9dfaaa72442f/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:43.354475 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:43.384188 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3936b815-f1da-4086-b624-0ce7d48566c2 None None] MFA Rules not processed for user `de76c75faded4b93a5ac9dfaaa72442f`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:43.385452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3936b815-f1da-4086-b624-0ce7d48566c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:43.538212 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 915/1861] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:05:43.540124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eed978-1b1e-49a9-a7f3-c9931a81f7da admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:43.624959 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:43.629851 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eed978-1b1e-49a9-a7f3-c9931a81f7da admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:43.647141 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e6c0a-e20a-4199-8875-9fd7cec25783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:43.649750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e6c0a-e20a-4199-8875-9fd7cec25783 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:43.650208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e6c0a-e20a-4199-8875-9fd7cec25783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:43.650491 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e6c0a-e20a-4199-8875-9fd7cec25783 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:43.652588 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e6c0a-e20a-4199-8875-9fd7cec25783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:43.657578 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e6c0a-e20a-4199-8875-9fd7cec25783 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:43.712205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 947/1862] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:05:43 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:43.713529 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936b815-f1da-4086-b624-0ce7d48566c2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:43.728577 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936b815-f1da-4086-b624-0ce7d48566c2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:43.825088 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664f1b8-f082-4c16-b746-dd9deb829e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:43.826296 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664f1b8-f082-4c16-b746-dd9deb829e01 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:43.826780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664f1b8-f082-4c16-b746-dd9deb829e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:43.827330 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664f1b8-f082-4c16-b746-dd9deb829e01 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:43.828804 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664f1b8-f082-4c16-b746-dd9deb829e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:43.832507 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664f1b8-f082-4c16-b746-dd9deb829e01 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:43.871197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 916/1863] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:05:43 2022] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:43.872526 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e6c0a-e20a-4199-8875-9fd7cec25783 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:43.900178 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e6c0a-e20a-4199-8875-9fd7cec25783 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:43.912038 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b210b4c-5093-4b6d-bd10-d7d5a8443a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:43.913155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b210b4c-5093-4b6d-bd10-d7d5a8443a6e admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:43.913438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b210b4c-5093-4b6d-bd10-d7d5a8443a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:43.913965 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b210b4c-5093-4b6d-bd10-d7d5a8443a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:43.915564 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b210b4c-5093-4b6d-bd10-d7d5a8443a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:43.920092 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b210b4c-5093-4b6d-bd10-d7d5a8443a6e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:43.939297 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 948/1864] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:05:43.940880 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664f1b8-f082-4c16-b746-dd9deb829e01 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:43.952415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664f1b8-f082-4c16-b746-dd9deb829e01 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:43.958866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90260e5d-a9b9-4691-85a7-6b6384fd3eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:43.959889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90260e5d-a9b9-4691-85a7-6b6384fd3eaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:43.960240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90260e5d-a9b9-4691-85a7-6b6384fd3eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:43.960607 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90260e5d-a9b9-4691-85a7-6b6384fd3eaa admin admin] PATH_INFO: `/v3/projects/1fde1f1542ab4f12981304d27b13f5b3/users/920609778ff041398c1d5f4da7ff818f/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:43.978767 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90260e5d-a9b9-4691-85a7-6b6384fd3eaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fde1f1542ab4f12981304d27b13f5b3, user_id=920609778ff041398c1d5f4da7ff818f, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:43.981491 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90260e5d-a9b9-4691-85a7-6b6384fd3eaa admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:44.001767 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 917/1865] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:05:43 2022] PUT /identity/v3/projects/1fde1f1542ab4f12981304d27b13f5b3/users/920609778ff041398c1d5f4da7ff818f/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:05:44.005716 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b210b4c-5093-4b6d-bd10-d7d5a8443a6e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:44.026019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b210b4c-5093-4b6d-bd10-d7d5a8443a6e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:44.115275 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796313fb-ed8c-4158-bc28-5564f7d47872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:44.116904 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796313fb-ed8c-4158-bc28-5564f7d47872 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:44.117190 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796313fb-ed8c-4158-bc28-5564f7d47872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:44.117464 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796313fb-ed8c-4158-bc28-5564f7d47872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:44.118311 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796313fb-ed8c-4158-bc28-5564f7d47872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:44.119854 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796313fb-ed8c-4158-bc28-5564f7d47872 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:44.132372 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 949/1866] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:05:44.137662 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90260e5d-a9b9-4691-85a7-6b6384fd3eaa admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:44.157190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90260e5d-a9b9-4691-85a7-6b6384fd3eaa admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:44.163937 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa7c37-64a4-4a19-8373-51901d96c6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:44.165269 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa7c37-64a4-4a19-8373-51901d96c6c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:44.165772 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa7c37-64a4-4a19-8373-51901d96c6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:44.166652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa7c37-64a4-4a19-8373-51901d96c6c7 admin admin] PATH_INFO: `/v3/projects/1fde1f1542ab4f12981304d27b13f5b3/users/920609778ff041398c1d5f4da7ff818f/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:44.186539 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa7c37-64a4-4a19-8373-51901d96c6c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fde1f1542ab4f12981304d27b13f5b3, user_id=920609778ff041398c1d5f4da7ff818f, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:44.197039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa7c37-64a4-4a19-8373-51901d96c6c7 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:44.227831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 918/1867] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:05:44 2022] PUT /identity/v3/projects/1fde1f1542ab4f12981304d27b13f5b3/users/920609778ff041398c1d5f4da7ff818f/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:44.238678 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e16b4-c898-4196-beaa-60a38db6680b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:44.239244 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e16b4-c898-4196-beaa-60a38db6680b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:44.240519 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e16b4-c898-4196-beaa-60a38db6680b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:44.303235 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e70e16b4-c898-4196-beaa-60a38db6680b None None] MFA Rules not processed for user `920609778ff041398c1d5f4da7ff818f`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:44.304366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e70e16b4-c898-4196-beaa-60a38db6680b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:44.497384 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 950/1868] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:44.525634 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa7c37-64a4-4a19-8373-51901d96c6c7 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:44.527857 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a5aa7c37-64a4-4a19-8373-51901d96c6c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:44.623485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:44.632491 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa7c37-64a4-4a19-8373-51901d96c6c7 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:44.637270 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f797fb-0cbd-4f19-a4f7-41ad5bd5b082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:44.638029 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f797fb-0cbd-4f19-a4f7-41ad5bd5b082 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:44.638471 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f797fb-0cbd-4f19-a4f7-41ad5bd5b082 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:44.638941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f797fb-0cbd-4f19-a4f7-41ad5bd5b082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:44.655883 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f797fb-0cbd-4f19-a4f7-41ad5bd5b082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:44.658101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f797fb-0cbd-4f19-a4f7-41ad5bd5b082 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:44.672488 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 919/1869] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:52.433530 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e16b4-c898-4196-beaa-60a38db6680b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:52.516207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:52.544381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e16b4-c898-4196-beaa-60a38db6680b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:52.554132 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89aa1c-e0b3-4823-be25-b826ab05cc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:52.555370 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89aa1c-e0b3-4823-be25-b826ab05cc5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:52.555974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89aa1c-e0b3-4823-be25-b826ab05cc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:52.556597 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89aa1c-e0b3-4823-be25-b826ab05cc5e admin admin] PATH_INFO: `/v3/users/de76c75faded4b93a5ac9dfaaa72442f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:52.560257 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89aa1c-e0b3-4823-be25-b826ab05cc5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=de76c75faded4b93a5ac9dfaaa72442f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:52.562561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89aa1c-e0b3-4823-be25-b826ab05cc5e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:52.638952 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9a89aa1c-e0b3-4823-be25-b826ab05cc5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de76c75faded4b93a5ac9dfaaa72442f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:52.654122 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9a89aa1c-e0b3-4823-be25-b826ab05cc5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de76c75faded4b93a5ac9dfaaa72442f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:52.682968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9a89aa1c-e0b3-4823-be25-b826ab05cc5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de76c75faded4b93a5ac9dfaaa72442f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:52.684196 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9a89aa1c-e0b3-4823-be25-b826ab05cc5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de76c75faded4b93a5ac9dfaaa72442f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:52.685108 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9a89aa1c-e0b3-4823-be25-b826ab05cc5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de76c75faded4b93a5ac9dfaaa72442f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:52.711916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 951/1870] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:05:52 2022] DELETE /identity/v3/users/de76c75faded4b93a5ac9dfaaa72442f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:52.718873 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef1103-bb62-4ead-8dd2-9460e521f6c7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:52.719538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef1103-bb62-4ead-8dd2-9460e521f6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:52.720498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef1103-bb62-4ead-8dd2-9460e521f6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:52.763609 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-abef1103-bb62-4ead-8dd2-9460e521f6c7 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:52.765250 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-abef1103-bb62-4ead-8dd2-9460e521f6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:52.883819 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 920/1871] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:52.929682 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89aa1c-e0b3-4823-be25-b826ab05cc5e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:52.931921 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9a89aa1c-e0b3-4823-be25-b826ab05cc5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:53.067639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89aa1c-e0b3-4823-be25-b826ab05cc5e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:53.077726 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72385854-ba56-451c-a176-8980e43c0e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:53.081771 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72385854-ba56-451c-a176-8980e43c0e8d service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:53.083408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72385854-ba56-451c-a176-8980e43c0e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:53.083994 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72385854-ba56-451c-a176-8980e43c0e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:53.109483 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72385854-ba56-451c-a176-8980e43c0e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:53.111261 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72385854-ba56-451c-a176-8980e43c0e8d service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:53.126587 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 952/1872] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:54.172748 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef1103-bb62-4ead-8dd2-9460e521f6c7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:54.192098 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef1103-bb62-4ead-8dd2-9460e521f6c7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:54.198651 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490d51b-61f0-48b0-8c8b-e3683d51bb03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:54.199981 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490d51b-61f0-48b0-8c8b-e3683d51bb03 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:54.200412 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490d51b-61f0-48b0-8c8b-e3683d51bb03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:54.201017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490d51b-61f0-48b0-8c8b-e3683d51bb03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:54.204342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d490d51b-61f0-48b0-8c8b-e3683d51bb03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:54.388512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490d51b-61f0-48b0-8c8b-e3683d51bb03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:54.390258 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490d51b-61f0-48b0-8c8b-e3683d51bb03 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:54.410056 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 921/1873] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:05:55.137883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72385854-ba56-451c-a176-8980e43c0e8d service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:55.139896 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-72385854-ba56-451c-a176-8980e43c0e8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:55.255942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72385854-ba56-451c-a176-8980e43c0e8d service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:55.281284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406359f2-4f4e-49d5-a5b5-697d7978ba7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:55.282204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406359f2-4f4e-49d5-a5b5-697d7978ba7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:55.283033 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406359f2-4f4e-49d5-a5b5-697d7978ba7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:55.283033 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406359f2-4f4e-49d5-a5b5-697d7978ba7d admin admin] PATH_INFO: `/v3/projects/8ffffc620f4a4953b1c14d6bfce66704` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:55.308709 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406359f2-4f4e-49d5-a5b5-697d7978ba7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ffffc620f4a4953b1c14d6bfce66704)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:55.313526 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406359f2-4f4e-49d5-a5b5-697d7978ba7d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:55.502936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-406359f2-4f4e-49d5-a5b5-697d7978ba7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ffffc620f4a4953b1c14d6bfce66704', 'request_id': 'req-406359f2-4f4e-49d5-a5b5-697d7978ba7d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:55.512228 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-406359f2-4f4e-49d5-a5b5-697d7978ba7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ffffc620f4a4953b1c14d6bfce66704', 'request_id': 'req-406359f2-4f4e-49d5-a5b5-697d7978ba7d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:55.519821 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-406359f2-4f4e-49d5-a5b5-697d7978ba7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ffffc620f4a4953b1c14d6bfce66704', 'request_id': 'req-406359f2-4f4e-49d5-a5b5-697d7978ba7d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:55.533135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:55.549843 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-406359f2-4f4e-49d5-a5b5-697d7978ba7d admin admin] The token cache is being invalidate because project 8ffffc620f4a4953b1c14d6bfce66704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:05:55.550150 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-406359f2-4f4e-49d5-a5b5-697d7978ba7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:55.553654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-406359f2-4f4e-49d5-a5b5-697d7978ba7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:55.561691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490d51b-61f0-48b0-8c8b-e3683d51bb03 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:55.562237 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 953/1874] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:05:55 2022] DELETE /identity/v3/projects/8ffffc620f4a4953b1c14d6bfce66704 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:55.622955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490d51b-61f0-48b0-8c8b-e3683d51bb03 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:55.760201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f926392-37d9-49b8-b2f5-65504315ea07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:55.762505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f926392-37d9-49b8-b2f5-65504315ea07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:55.762837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f926392-37d9-49b8-b2f5-65504315ea07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:55.763120 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f926392-37d9-49b8-b2f5-65504315ea07 admin admin] PATH_INFO: `/v3/users/920609778ff041398c1d5f4da7ff818f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:55.766433 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f926392-37d9-49b8-b2f5-65504315ea07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=920609778ff041398c1d5f4da7ff818f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:55.770158 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f926392-37d9-49b8-b2f5-65504315ea07 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:55.824860 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:55.869521 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2f926392-37d9-49b8-b2f5-65504315ea07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '920609778ff041398c1d5f4da7ff818f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:55.881242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2f926392-37d9-49b8-b2f5-65504315ea07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '920609778ff041398c1d5f4da7ff818f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:55.901584 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2f926392-37d9-49b8-b2f5-65504315ea07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '920609778ff041398c1d5f4da7ff818f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:55.902268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2f926392-37d9-49b8-b2f5-65504315ea07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '920609778ff041398c1d5f4da7ff818f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:55.914799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2f926392-37d9-49b8-b2f5-65504315ea07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '920609778ff041398c1d5f4da7ff818f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:55.928290 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 922/1875] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:05:55 2022] DELETE /identity/v3/users/920609778ff041398c1d5f4da7ff818f => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:56.467307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406359f2-4f4e-49d5-a5b5-697d7978ba7d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:56.468939 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-406359f2-4f4e-49d5-a5b5-697d7978ba7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:56.487127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406359f2-4f4e-49d5-a5b5-697d7978ba7d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:56.598819 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948ce32-1076-41b9-ac20-6a6f3ff7248e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:56.600932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948ce32-1076-41b9-ac20-6a6f3ff7248e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:56.601429 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948ce32-1076-41b9-ac20-6a6f3ff7248e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:56.602857 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948ce32-1076-41b9-ac20-6a6f3ff7248e admin admin] PATH_INFO: `/v3/projects/1fde1f1542ab4f12981304d27b13f5b3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:56.605540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948ce32-1076-41b9-ac20-6a6f3ff7248e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fde1f1542ab4f12981304d27b13f5b3)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:56.611617 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948ce32-1076-41b9-ac20-6a6f3ff7248e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:56.719294 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b948ce32-1076-41b9-ac20-6a6f3ff7248e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fde1f1542ab4f12981304d27b13f5b3', 'request_id': 'req-b948ce32-1076-41b9-ac20-6a6f3ff7248e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:56.788584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b948ce32-1076-41b9-ac20-6a6f3ff7248e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fde1f1542ab4f12981304d27b13f5b3', 'request_id': 'req-b948ce32-1076-41b9-ac20-6a6f3ff7248e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:56.790647 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b948ce32-1076-41b9-ac20-6a6f3ff7248e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fde1f1542ab4f12981304d27b13f5b3', 'request_id': 'req-b948ce32-1076-41b9-ac20-6a6f3ff7248e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:56.832962 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b948ce32-1076-41b9-ac20-6a6f3ff7248e admin admin] The token cache is being invalidate because project 1fde1f1542ab4f12981304d27b13f5b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:05:56.833311 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b948ce32-1076-41b9-ac20-6a6f3ff7248e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:56.834023 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b948ce32-1076-41b9-ac20-6a6f3ff7248e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:56.836466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 954/1876] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:05:56 2022] DELETE /identity/v3/projects/1fde1f1542ab4f12981304d27b13f5b3 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:56.841476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b927c-137b-4512-a938-1bbbc5dcc3a3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:56.842037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b927c-137b-4512-a938-1bbbc5dcc3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:56.842037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b927c-137b-4512-a938-1bbbc5dcc3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:56.874100 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-235b927c-137b-4512-a938-1bbbc5dcc3a3 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:56.879508 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-235b927c-137b-4512-a938-1bbbc5dcc3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:56.970902 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 923/1877] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:56.979696 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3935afc-5aa2-42a2-b9fa-1e00eef8e138 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:56.979893 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3935afc-5aa2-42a2-b9fa-1e00eef8e138 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:56.980160 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3935afc-5aa2-42a2-b9fa-1e00eef8e138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:57.003971 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d3935afc-5aa2-42a2-b9fa-1e00eef8e138 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:57.006342 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d3935afc-5aa2-42a2-b9fa-1e00eef8e138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:57.019324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 955/1878] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:57.019954 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b927c-137b-4512-a938-1bbbc5dcc3a3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:57.037675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b927c-137b-4512-a938-1bbbc5dcc3a3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:57.047914 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48190df9-487e-4866-9ff4-43dc7096a128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:57.048615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48190df9-487e-4866-9ff4-43dc7096a128 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:57.049146 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48190df9-487e-4866-9ff4-43dc7096a128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:57.049307 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48190df9-487e-4866-9ff4-43dc7096a128 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:57.050337 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48190df9-487e-4866-9ff4-43dc7096a128 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:05:57.050677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48190df9-487e-4866-9ff4-43dc7096a128 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:57.052456 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48190df9-487e-4866-9ff4-43dc7096a128 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:57.073520 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 924/1879] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:05:57.076826 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3935afc-5aa2-42a2-b9fa-1e00eef8e138 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:57.088257 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3935afc-5aa2-42a2-b9fa-1e00eef8e138 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:57.106377 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3acb5-e93d-46e3-9c4a-b557a85143d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:57.107313 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3acb5-e93d-46e3-9c4a-b557a85143d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:57.109011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3acb5-e93d-46e3-9c4a-b557a85143d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:57.109577 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3acb5-e93d-46e3-9c4a-b557a85143d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:57.110449 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3acb5-e93d-46e3-9c4a-b557a85143d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:57.118966 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3acb5-e93d-46e3-9c4a-b557a85143d4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:57.171141 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 956/1880] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:05:57 2022] POST /identity/v3/projects => generated 389 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:57.171936 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48190df9-487e-4866-9ff4-43dc7096a128 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:57.188083 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48190df9-487e-4866-9ff4-43dc7096a128 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:57.330326 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7128e7-87ef-471d-a2d8-e69ab973abef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:57.331431 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7128e7-87ef-471d-a2d8-e69ab973abef admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:57.332826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7128e7-87ef-471d-a2d8-e69ab973abef admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:57.333492 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7128e7-87ef-471d-a2d8-e69ab973abef admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:57.334447 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7128e7-87ef-471d-a2d8-e69ab973abef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:57.342026 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7128e7-87ef-471d-a2d8-e69ab973abef admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:57.440241 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 925/1881] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:05:57 2022] POST /identity/v3/users => generated 295 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:57.447917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3acb5-e93d-46e3-9c4a-b557a85143d4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:57.461163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3acb5-e93d-46e3-9c4a-b557a85143d4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:57.466615 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8aec0-4b0e-4221-b813-f95c4721c9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:57.467317 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8aec0-4b0e-4221-b813-f95c4721c9da admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:57.467981 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8aec0-4b0e-4221-b813-f95c4721c9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:57.468158 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8aec0-4b0e-4221-b813-f95c4721c9da admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:57.468999 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8aec0-4b0e-4221-b813-f95c4721c9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:57.470720 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8aec0-4b0e-4221-b813-f95c4721c9da admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:57.484778 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 957/1882] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:05:57.494766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7128e7-87ef-471d-a2d8-e69ab973abef admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:57.505729 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7128e7-87ef-471d-a2d8-e69ab973abef admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:57.513743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1ab94-5a58-4f87-9bac-2af7046b8cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:57.514449 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1ab94-5a58-4f87-9bac-2af7046b8cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:57.514738 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1ab94-5a58-4f87-9bac-2af7046b8cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:57.515029 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1ab94-5a58-4f87-9bac-2af7046b8cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:57.516250 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1ab94-5a58-4f87-9bac-2af7046b8cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:57.518282 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1ab94-5a58-4f87-9bac-2af7046b8cc7 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:57.550689 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 926/1883] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:05:57.551941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8aec0-4b0e-4221-b813-f95c4721c9da admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:57.585925 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8aec0-4b0e-4221-b813-f95c4721c9da admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:57.600065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e943c-0a35-4d00-b5a1-5d66efff958a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:57.601238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e943c-0a35-4d00-b5a1-5d66efff958a admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:57.601587 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e943c-0a35-4d00-b5a1-5d66efff958a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:57.601930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e943c-0a35-4d00-b5a1-5d66efff958a admin admin] PATH_INFO: `/v3/projects/36b91465e9f54bfd95fb4c419a2770a2/users/07fe852237194150a1b9bc09296d41b4/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:57.638916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e943c-0a35-4d00-b5a1-5d66efff958a admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b91465e9f54bfd95fb4c419a2770a2, user_id=07fe852237194150a1b9bc09296d41b4, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:57.642837 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e943c-0a35-4d00-b5a1-5d66efff958a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:57.665207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 958/1884] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:05:57 2022] PUT /identity/v3/projects/36b91465e9f54bfd95fb4c419a2770a2/users/07fe852237194150a1b9bc09296d41b4/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:57.675437 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898324a8-83a5-4920-8497-a0664cab6a5c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:57.676115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898324a8-83a5-4920-8497-a0664cab6a5c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:57.676472 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898324a8-83a5-4920-8497-a0664cab6a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:57.709379 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:57.725361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-898324a8-83a5-4920-8497-a0664cab6a5c None None] MFA Rules not processed for user `07fe852237194150a1b9bc09296d41b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:57.727005 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-898324a8-83a5-4920-8497-a0664cab6a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:57.878805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 927/1885] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:57.891284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e943c-0a35-4d00-b5a1-5d66efff958a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:57.897110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-346e943c-0a35-4d00-b5a1-5d66efff958a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:57.951546 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:58.026247 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e943c-0a35-4d00-b5a1-5d66efff958a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:58.036359 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19092e12-0b11-454b-ae12-17519ead8e1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:58.037329 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19092e12-0b11-454b-ae12-17519ead8e1b service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:58.037827 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19092e12-0b11-454b-ae12-17519ead8e1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:58.038291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19092e12-0b11-454b-ae12-17519ead8e1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:58.060280 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19092e12-0b11-454b-ae12-17519ead8e1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:58.065939 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19092e12-0b11-454b-ae12-17519ead8e1b service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:58.090506 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 959/1886] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:58.143958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898324a8-83a5-4920-8497-a0664cab6a5c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:58.305249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898324a8-83a5-4920-8497-a0664cab6a5c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:58.311219 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b0969-c42d-4a90-819e-db68401209ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:58.312148 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b0969-c42d-4a90-819e-db68401209ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:58.312448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b0969-c42d-4a90-819e-db68401209ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:58.313460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b0969-c42d-4a90-819e-db68401209ff admin admin] PATH_INFO: `/v3/users/07fe852237194150a1b9bc09296d41b4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:58.317721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b0969-c42d-4a90-819e-db68401209ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=07fe852237194150a1b9bc09296d41b4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:58.319709 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b0969-c42d-4a90-819e-db68401209ff admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:58.425055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b94b0969-c42d-4a90-819e-db68401209ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07fe852237194150a1b9bc09296d41b4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:58.438994 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b94b0969-c42d-4a90-819e-db68401209ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07fe852237194150a1b9bc09296d41b4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:58.476475 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b94b0969-c42d-4a90-819e-db68401209ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07fe852237194150a1b9bc09296d41b4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:58.476475 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b94b0969-c42d-4a90-819e-db68401209ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07fe852237194150a1b9bc09296d41b4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:58.477516 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19092e12-0b11-454b-ae12-17519ead8e1b service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:58.479535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-19092e12-0b11-454b-ae12-17519ead8e1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:58.506770 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b94b0969-c42d-4a90-819e-db68401209ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07fe852237194150a1b9bc09296d41b4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:05:58.534109 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 928/1887] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:05:58 2022] DELETE /identity/v3/users/07fe852237194150a1b9bc09296d41b4 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:05:58.535924 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c5ea8-6388-4d4c-974b-6f585ee6070a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:58.536319 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c5ea8-6388-4d4c-974b-6f585ee6070a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:58.536707 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c5ea8-6388-4d4c-974b-6f585ee6070a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:58.558083 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-dc6c5ea8-6388-4d4c-974b-6f585ee6070a None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:58.559486 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dc6c5ea8-6388-4d4c-974b-6f585ee6070a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:58.591314 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:58.668124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 929/1888] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:58.686314 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c5ea8-6388-4d4c-974b-6f585ee6070a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:58.687914 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dc6c5ea8-6388-4d4c-974b-6f585ee6070a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:58.691155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19092e12-0b11-454b-ae12-17519ead8e1b service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:58.785101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c5ea8-6388-4d4c-974b-6f585ee6070a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:58.798876 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fc367-3259-4fc6-b847-0128b595b5d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:58.799574 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fc367-3259-4fc6-b847-0128b595b5d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:58.799858 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fc367-3259-4fc6-b847-0128b595b5d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:58.801250 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fc367-3259-4fc6-b847-0128b595b5d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:58.818196 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fc367-3259-4fc6-b847-0128b595b5d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:58.819671 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fc367-3259-4fc6-b847-0128b595b5d3 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:58.822171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425c99a-3221-4d27-8f67-601128f112e3 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b832aff2674870a833b319795ace4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '181869cbac684e7f8414607a2845dd19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:58.822875 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425c99a-3221-4d27-8f67-601128f112e3 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:58.823158 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425c99a-3221-4d27-8f67-601128f112e3 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:58.823436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425c99a-3221-4d27-8f67-601128f112e3 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:58.824179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425c99a-3221-4d27-8f67-601128f112e3 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:05:58.824499 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425c99a-3221-4d27-8f67-601128f112e3 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:58.826144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425c99a-3221-4d27-8f67-601128f112e3 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:58.846114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 930/1889] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:58.848764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 960/1890] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:05:58.855921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fc367-3259-4fc6-b847-0128b595b5d3 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:58.857510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-101fc367-3259-4fc6-b847-0128b595b5d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:58.882271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fc367-3259-4fc6-b847-0128b595b5d3 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:58.903133 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7273b5-c7fa-4377-a88f-4d31fc6b1ae9 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b832aff2674870a833b319795ace4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '181869cbac684e7f8414607a2845dd19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:58.903957 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7273b5-c7fa-4377-a88f-4d31fc6b1ae9 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:58.904313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7273b5-c7fa-4377-a88f-4d31fc6b1ae9 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:58.904663 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7273b5-c7fa-4377-a88f-4d31fc6b1ae9 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:58.905502 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7273b5-c7fa-4377-a88f-4d31fc6b1ae9 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:58.908197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7273b5-c7fa-4377-a88f-4d31fc6b1ae9 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:58.954037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 931/1891] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:05:58 2022] POST /identity/v3/projects => generated 349 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:05:58.958214 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425c99a-3221-4d27-8f67-601128f112e3 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:58.984439 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425c99a-3221-4d27-8f67-601128f112e3 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:59.177477 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab090d0-e391-4695-9882-5378b06af0a5 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b832aff2674870a833b319795ace4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '181869cbac684e7f8414607a2845dd19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:59.178283 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab090d0-e391-4695-9882-5378b06af0a5 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:59.178581 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab090d0-e391-4695-9882-5378b06af0a5 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:59.178862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab090d0-e391-4695-9882-5378b06af0a5 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:59.180922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab090d0-e391-4695-9882-5378b06af0a5 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:05:59.181300 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab090d0-e391-4695-9882-5378b06af0a5 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:59.185590 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab090d0-e391-4695-9882-5378b06af0a5 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:59.254884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 961/1892] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:06:00.799748 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7273b5-c7fa-4377-a88f-4d31fc6b1ae9 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:00.801579 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2a7273b5-c7fa-4377-a88f-4d31fc6b1ae9 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:00.901945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7273b5-c7fa-4377-a88f-4d31fc6b1ae9 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:00.907042 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373df2e0-eb42-4f62-8d50-0a892a431312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:00.908252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373df2e0-eb42-4f62-8d50-0a892a431312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:00.909232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373df2e0-eb42-4f62-8d50-0a892a431312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:00.909780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373df2e0-eb42-4f62-8d50-0a892a431312 admin admin] PATH_INFO: `/v3/projects/36b91465e9f54bfd95fb4c419a2770a2` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:00.911514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373df2e0-eb42-4f62-8d50-0a892a431312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36b91465e9f54bfd95fb4c419a2770a2)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:00.914085 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373df2e0-eb42-4f62-8d50-0a892a431312 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:00.948565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab090d0-e391-4695-9882-5378b06af0a5 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:00.954686 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:00.981176 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab090d0-e391-4695-9882-5378b06af0a5 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:00.991879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:00.997801 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-373df2e0-eb42-4f62-8d50-0a892a431312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36b91465e9f54bfd95fb4c419a2770a2', 'request_id': 'req-373df2e0-eb42-4f62-8d50-0a892a431312'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:01.030296 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-373df2e0-eb42-4f62-8d50-0a892a431312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36b91465e9f54bfd95fb4c419a2770a2', 'request_id': 'req-373df2e0-eb42-4f62-8d50-0a892a431312'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:01.043660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-373df2e0-eb42-4f62-8d50-0a892a431312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36b91465e9f54bfd95fb4c419a2770a2', 'request_id': 'req-373df2e0-eb42-4f62-8d50-0a892a431312'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:01.071945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-373df2e0-eb42-4f62-8d50-0a892a431312 admin admin] The token cache is being invalidate because project 36b91465e9f54bfd95fb4c419a2770a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:06:01.072333 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-373df2e0-eb42-4f62-8d50-0a892a431312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:01.073515 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-373df2e0-eb42-4f62-8d50-0a892a431312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:01.076357 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 932/1893] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:06:00 2022] DELETE /identity/v3/projects/36b91465e9f54bfd95fb4c419a2770a2 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:01.082439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0104503-01c4-4646-b231-035082b0ed00 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:01.082439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0104503-01c4-4646-b231-035082b0ed00 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:01.082439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0104503-01c4-4646-b231-035082b0ed00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:01.122365 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b0104503-01c4-4646-b231-035082b0ed00 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:01.123918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b0104503-01c4-4646-b231-035082b0ed00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:01.129448 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcce6c-c80c-420f-acfd-cf8f1dd91718 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b832aff2674870a833b319795ace4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '181869cbac684e7f8414607a2845dd19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:01.130683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcce6c-c80c-420f-acfd-cf8f1dd91718 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:01.131122 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcce6c-c80c-420f-acfd-cf8f1dd91718 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:01.131551 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcce6c-c80c-420f-acfd-cf8f1dd91718 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] PATH_INFO: `/v3/projects/4ca4fc75423243f8b89d477f64dadd69` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:01.133375 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcce6c-c80c-420f-acfd-cf8f1dd91718 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4ca4fc75423243f8b89d477f64dadd69)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:01.137303 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcce6c-c80c-420f-acfd-cf8f1dd91718 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:01.259618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5cdcce6c-c80c-420f-acfd-cf8f1dd91718 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ca4fc75423243f8b89d477f64dadd69', 'request_id': 'req-5cdcce6c-c80c-420f-acfd-cf8f1dd91718'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:01.269158 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5cdcce6c-c80c-420f-acfd-cf8f1dd91718 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ca4fc75423243f8b89d477f64dadd69', 'request_id': 'req-5cdcce6c-c80c-420f-acfd-cf8f1dd91718'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:01.276841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5cdcce6c-c80c-420f-acfd-cf8f1dd91718 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ca4fc75423243f8b89d477f64dadd69', 'request_id': 'req-5cdcce6c-c80c-420f-acfd-cf8f1dd91718'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:01.277602 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 933/1894] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:01.286972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154e716-947c-49ab-ac97-472f1f98431e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:01.287265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154e716-947c-49ab-ac97-472f1f98431e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:01.287537 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154e716-947c-49ab-ac97-472f1f98431e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:01.293745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5cdcce6c-c80c-420f-acfd-cf8f1dd91718 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] The token cache is being invalidate because project 4ca4fc75423243f8b89d477f64dadd69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:06:01.294364 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5cdcce6c-c80c-420f-acfd-cf8f1dd91718 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:01.296640 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5cdcce6c-c80c-420f-acfd-cf8f1dd91718 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:01.303881 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 962/1895] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:06:00 2022] DELETE /identity/v3/projects/4ca4fc75423243f8b89d477f64dadd69 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:01.312221 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a154e716-947c-49ab-ac97-472f1f98431e None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:01.313547 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a154e716-947c-49ab-ac97-472f1f98431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:01.346112 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcce6c-c80c-420f-acfd-cf8f1dd91718 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:01.351446 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5cdcce6c-c80c-420f-acfd-cf8f1dd91718 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:01.398713 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 934/1896] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:01.399799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154e716-947c-49ab-ac97-472f1f98431e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:01.401846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a154e716-947c-49ab-ac97-472f1f98431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:01.416859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154e716-947c-49ab-ac97-472f1f98431e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:01.429764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3675fc-2b52-488d-b494-353f0963d800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:01.431267 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3675fc-2b52-488d-b494-353f0963d800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:01.431810 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3675fc-2b52-488d-b494-353f0963d800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:01.432304 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3675fc-2b52-488d-b494-353f0963d800 admin admin] PATH_INFO: `/v3/users/84db99d0956b4c39a6139b4a455e5606` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:01.434780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3675fc-2b52-488d-b494-353f0963d800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84db99d0956b4c39a6139b4a455e5606)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:01.437607 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3675fc-2b52-488d-b494-353f0963d800 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:01.451598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcce6c-c80c-420f-acfd-cf8f1dd91718 tempest-RoutersIpV6AdminTest-1035256675 tempest-RoutersIpV6AdminTest-1035256675-project-admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:01.457049 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013407ab-6882-4dc2-a890-626c2ac69529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:01.457863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013407ab-6882-4dc2-a890-626c2ac69529 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:01.458244 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013407ab-6882-4dc2-a890-626c2ac69529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:01.458690 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013407ab-6882-4dc2-a890-626c2ac69529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:01.461612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-013407ab-6882-4dc2-a890-626c2ac69529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:01.497946 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cf3675fc-2b52-488d-b494-353f0963d800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84db99d0956b4c39a6139b4a455e5606'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:01.508293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cf3675fc-2b52-488d-b494-353f0963d800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84db99d0956b4c39a6139b4a455e5606'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:01.518460 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:01.526316 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:01.529152 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cf3675fc-2b52-488d-b494-353f0963d800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84db99d0956b4c39a6139b4a455e5606'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:01.530281 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cf3675fc-2b52-488d-b494-353f0963d800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84db99d0956b4c39a6139b4a455e5606'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:01.536628 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013407ab-6882-4dc2-a890-626c2ac69529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:01.538464 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013407ab-6882-4dc2-a890-626c2ac69529 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:01.544298 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cf3675fc-2b52-488d-b494-353f0963d800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84db99d0956b4c39a6139b4a455e5606'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:01.549182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 963/1897] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:06:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:06:01.550149 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013407ab-6882-4dc2-a890-626c2ac69529 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:01.557269 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 935/1898] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:06:01 2022] DELETE /identity/v3/users/84db99d0956b4c39a6139b4a455e5606 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:01.559596 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386a8b3-e806-4035-ad78-df51b22b9c60 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:01.559989 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386a8b3-e806-4035-ad78-df51b22b9c60 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:01.560889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386a8b3-e806-4035-ad78-df51b22b9c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:01.563996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013407ab-6882-4dc2-a890-626c2ac69529 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:01.584885 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9386a8b3-e806-4035-ad78-df51b22b9c60 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:01.586425 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9386a8b3-e806-4035-ad78-df51b22b9c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:01.654283 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf675e3-94c0-48de-a5e5-5501d7176fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:01.655659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf675e3-94c0-48de-a5e5-5501d7176fae admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:01.656093 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf675e3-94c0-48de-a5e5-5501d7176fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:01.656577 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf675e3-94c0-48de-a5e5-5501d7176fae admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:01.657536 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf675e3-94c0-48de-a5e5-5501d7176fae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:06:01.658105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf675e3-94c0-48de-a5e5-5501d7176fae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:01.660810 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf675e3-94c0-48de-a5e5-5501d7176fae admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:01.678051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 964/1899] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:06:01.683585 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf675e3-94c0-48de-a5e5-5501d7176fae admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:01.686262 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4bf675e3-94c0-48de-a5e5-5501d7176fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:01.704294 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf675e3-94c0-48de-a5e5-5501d7176fae admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:01.710622 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeeebaa-3da9-4388-b2b5-b5db0f728b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:01.711478 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeeebaa-3da9-4388-b2b5-b5db0f728b05 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:01.711754 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeeebaa-3da9-4388-b2b5-b5db0f728b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:01.712027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeeebaa-3da9-4388-b2b5-b5db0f728b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:01.712753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeeebaa-3da9-4388-b2b5-b5db0f728b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:01.713971 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 936/1900] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:01.715217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeeebaa-3da9-4388-b2b5-b5db0f728b05 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:01.751741 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386a8b3-e806-4035-ad78-df51b22b9c60 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:01.757747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9386a8b3-e806-4035-ad78-df51b22b9c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:01.769796 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 965/1901] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:06:01 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:06:01.774816 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeeebaa-3da9-4388-b2b5-b5db0f728b05 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:01.857312 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeeebaa-3da9-4388-b2b5-b5db0f728b05 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:01.863751 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cfb23-6c1e-451b-81d7-76e1d87f9a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:01.865108 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cfb23-6c1e-451b-81d7-76e1d87f9a1f admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:01.865502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cfb23-6c1e-451b-81d7-76e1d87f9a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:01.866150 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cfb23-6c1e-451b-81d7-76e1d87f9a1f admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:01.867024 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202cfb23-6c1e-451b-81d7-76e1d87f9a1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:01.869257 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202cfb23-6c1e-451b-81d7-76e1d87f9a1f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:01.900796 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 966/1902] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:06:01 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:06:01.909114 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cfb23-6c1e-451b-81d7-76e1d87f9a1f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:01.931947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cfb23-6c1e-451b-81d7-76e1d87f9a1f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:01.934795 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386a8b3-e806-4035-ad78-df51b22b9c60 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:01.944767 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8d294-2c50-4c37-ba90-0fff07381381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:01.948393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8d294-2c50-4c37-ba90-0fff07381381 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:01.949442 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8d294-2c50-4c37-ba90-0fff07381381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:01.950648 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8d294-2c50-4c37-ba90-0fff07381381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:01.952842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8d294-2c50-4c37-ba90-0fff07381381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:01.957165 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8d294-2c50-4c37-ba90-0fff07381381 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:01.985566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 967/1903] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:06:01.988094 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8d294-2c50-4c37-ba90-0fff07381381 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:02.010580 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8d294-2c50-4c37-ba90-0fff07381381 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:02.022411 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16110534-7df1-493a-8eac-13586a6dfab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:02.023462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a6aad-ce40-4141-be93-aa27af465a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:02.024240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16110534-7df1-493a-8eac-13586a6dfab1 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:02.025066 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a6aad-ce40-4141-be93-aa27af465a05 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:02.025453 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16110534-7df1-493a-8eac-13586a6dfab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:02.025954 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a6aad-ce40-4141-be93-aa27af465a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:02.026448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16110534-7df1-493a-8eac-13586a6dfab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:02.026842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a6aad-ce40-4141-be93-aa27af465a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:02.028449 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a6aad-ce40-4141-be93-aa27af465a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:02.032279 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a6aad-ce40-4141-be93-aa27af465a05 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:02.050760 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16110534-7df1-493a-8eac-13586a6dfab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:02.052567 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16110534-7df1-493a-8eac-13586a6dfab1 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:02.064625 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 968/1904] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:06:02.069712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a6aad-ce40-4141-be93-aa27af465a05 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:02.071246 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 937/1905] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:06:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:06:02.082603 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a6aad-ce40-4141-be93-aa27af465a05 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:02.088015 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef14cf5-4f7a-40ce-bd12-16d2d00f60ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:02.089361 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef14cf5-4f7a-40ce-bd12-16d2d00f60ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:02.089562 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef14cf5-4f7a-40ce-bd12-16d2d00f60ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:02.089845 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef14cf5-4f7a-40ce-bd12-16d2d00f60ec admin admin] PATH_INFO: `/v3/projects/4c38e247a5cd46a5821b120eb79e714a/users/94e9de8a3d3b479ba8b00b10638b8d42/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:02.109742 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef14cf5-4f7a-40ce-bd12-16d2d00f60ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c38e247a5cd46a5821b120eb79e714a, user_id=94e9de8a3d3b479ba8b00b10638b8d42, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:02.113331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef14cf5-4f7a-40ce-bd12-16d2d00f60ec admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:02.130788 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 969/1906] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:06:02 2022] PUT /identity/v3/projects/4c38e247a5cd46a5821b120eb79e714a/users/94e9de8a3d3b479ba8b00b10638b8d42/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:02.143017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a8628-6715-4408-b231-cd572ac7f47a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:02.143332 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a8628-6715-4408-b231-cd572ac7f47a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:02.144415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a8628-6715-4408-b231-cd572ac7f47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:02.181911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f38a8628-6715-4408-b231-cd572ac7f47a None None] MFA Rules not processed for user `94e9de8a3d3b479ba8b00b10638b8d42`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:02.184368 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f38a8628-6715-4408-b231-cd572ac7f47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:02.238035 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:02.287355 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 938/1907] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:02.306134 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef14cf5-4f7a-40ce-bd12-16d2d00f60ec admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:02.310601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2ef14cf5-4f7a-40ce-bd12-16d2d00f60ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:02.329828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:02.448913 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef14cf5-4f7a-40ce-bd12-16d2d00f60ec admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:02.458850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fe671-73e5-4ceb-aa0d-79f38de0313f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:02.459539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fe671-73e5-4ceb-aa0d-79f38de0313f service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:02.459819 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fe671-73e5-4ceb-aa0d-79f38de0313f service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:02.460220 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fe671-73e5-4ceb-aa0d-79f38de0313f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:02.479184 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512fe671-73e5-4ceb-aa0d-79f38de0313f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:02.480646 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512fe671-73e5-4ceb-aa0d-79f38de0313f service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:02.503802 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a8628-6715-4408-b231-cd572ac7f47a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:02.504132 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 970/1908] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:06:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:06:02.507776 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f38a8628-6715-4408-b231-cd572ac7f47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:02.617089 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a8628-6715-4408-b231-cd572ac7f47a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:02.624312 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8e3c1-cdf7-45f0-863f-aa04d1b80fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:02.625529 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8e3c1-cdf7-45f0-863f-aa04d1b80fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:02.625838 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8e3c1-cdf7-45f0-863f-aa04d1b80fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:02.626124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8e3c1-cdf7-45f0-863f-aa04d1b80fc6 admin admin] PATH_INFO: `/v3/projects/d67f80e4925444c5ab5879bef937c385` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:02.627521 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8e3c1-cdf7-45f0-863f-aa04d1b80fc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d67f80e4925444c5ab5879bef937c385)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:02.630552 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8e3c1-cdf7-45f0-863f-aa04d1b80fc6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:02.731901 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3da8e3c1-cdf7-45f0-863f-aa04d1b80fc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd67f80e4925444c5ab5879bef937c385', 'request_id': 'req-3da8e3c1-cdf7-45f0-863f-aa04d1b80fc6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:02.746807 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3da8e3c1-cdf7-45f0-863f-aa04d1b80fc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd67f80e4925444c5ab5879bef937c385', 'request_id': 'req-3da8e3c1-cdf7-45f0-863f-aa04d1b80fc6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:02.756284 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3da8e3c1-cdf7-45f0-863f-aa04d1b80fc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd67f80e4925444c5ab5879bef937c385', 'request_id': 'req-3da8e3c1-cdf7-45f0-863f-aa04d1b80fc6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:02.772962 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3da8e3c1-cdf7-45f0-863f-aa04d1b80fc6 admin admin] The token cache is being invalidate because project d67f80e4925444c5ab5879bef937c385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:06:02.773266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3da8e3c1-cdf7-45f0-863f-aa04d1b80fc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:02.778953 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3da8e3c1-cdf7-45f0-863f-aa04d1b80fc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:02.783839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 939/1909] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:06:02 2022] DELETE /identity/v3/projects/d67f80e4925444c5ab5879bef937c385 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:02.788559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31807ea4-ed26-4b23-bc81-fec349dae4f4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:02.789840 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31807ea4-ed26-4b23-bc81-fec349dae4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:02.790318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31807ea4-ed26-4b23-bc81-fec349dae4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:02.811075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-31807ea4-ed26-4b23-bc81-fec349dae4f4 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:02.812312 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-31807ea4-ed26-4b23-bc81-fec349dae4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:02.899976 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 971/1910] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:02.907616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f2940-03c8-4711-a115-55e92cbd3962 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:02.908008 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f2940-03c8-4711-a115-55e92cbd3962 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:02.908293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f2940-03c8-4711-a115-55e92cbd3962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:02.936879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-179f2940-03c8-4711-a115-55e92cbd3962 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:02.938920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-179f2940-03c8-4711-a115-55e92cbd3962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:02.966923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31807ea4-ed26-4b23-bc81-fec349dae4f4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:02.973102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 940/1911] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:02.981523 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31807ea4-ed26-4b23-bc81-fec349dae4f4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:02.987119 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07e09a-b3ae-4346-a3c6-b7e56ba3b2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:02.987820 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07e09a-b3ae-4346-a3c6-b7e56ba3b2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:02.988102 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07e09a-b3ae-4346-a3c6-b7e56ba3b2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:02.988371 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07e09a-b3ae-4346-a3c6-b7e56ba3b2d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:02.989256 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07e09a-b3ae-4346-a3c6-b7e56ba3b2d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:06:02.989559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07e09a-b3ae-4346-a3c6-b7e56ba3b2d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:02.991184 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07e09a-b3ae-4346-a3c6-b7e56ba3b2d3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:03.029366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 972/1912] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:06:03.029864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f2940-03c8-4711-a115-55e92cbd3962 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:03.051739 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f2940-03c8-4711-a115-55e92cbd3962 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:03.066088 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cd319-f078-4f9a-bac6-84f9cc6e74f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:03.066977 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cd319-f078-4f9a-bac6-84f9cc6e74f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:03.067416 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cd319-f078-4f9a-bac6-84f9cc6e74f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:03.067843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cd319-f078-4f9a-bac6-84f9cc6e74f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:03.070900 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cd319-f078-4f9a-bac6-84f9cc6e74f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:03.076848 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cd319-f078-4f9a-bac6-84f9cc6e74f1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:03.123461 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 941/1913] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:06:03 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:06:03.124755 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07e09a-b3ae-4346-a3c6-b7e56ba3b2d3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:03.141319 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07e09a-b3ae-4346-a3c6-b7e56ba3b2d3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:03.206268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cd319-f078-4f9a-bac6-84f9cc6e74f1 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:03.209620 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-142cd319-f078-4f9a-bac6-84f9cc6e74f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:03.250078 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06ba7e-d5a6-4413-9f76-37cbfd713407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:03.251066 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06ba7e-d5a6-4413-9f76-37cbfd713407 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:03.251066 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06ba7e-d5a6-4413-9f76-37cbfd713407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:03.251497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06ba7e-d5a6-4413-9f76-37cbfd713407 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:03.252759 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06ba7e-d5a6-4413-9f76-37cbfd713407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:03.255927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06ba7e-d5a6-4413-9f76-37cbfd713407 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:03.291499 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 973/1914] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:06:03 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:06:03.292530 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06ba7e-d5a6-4413-9f76-37cbfd713407 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:03.306510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:03.307200 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06ba7e-d5a6-4413-9f76-37cbfd713407 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:03.314763 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbc22c-6a8c-4399-ad82-1586343e20dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:03.315838 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbc22c-6a8c-4399-ad82-1586343e20dd admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:03.318092 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbc22c-6a8c-4399-ad82-1586343e20dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:03.318628 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbc22c-6a8c-4399-ad82-1586343e20dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:03.320930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbc22c-6a8c-4399-ad82-1586343e20dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:03.325354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbc22c-6a8c-4399-ad82-1586343e20dd admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:03.344984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 974/1915] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:06:03.346539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbc22c-6a8c-4399-ad82-1586343e20dd admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:03.358861 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cd319-f078-4f9a-bac6-84f9cc6e74f1 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:03.360981 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbc22c-6a8c-4399-ad82-1586343e20dd admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:03.366691 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228eb57-4120-40d7-a039-70dcd98a8f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:03.367525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228eb57-4120-40d7-a039-70dcd98a8f44 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:03.367809 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228eb57-4120-40d7-a039-70dcd98a8f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:03.368146 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228eb57-4120-40d7-a039-70dcd98a8f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:03.369125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228eb57-4120-40d7-a039-70dcd98a8f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:03.371166 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228eb57-4120-40d7-a039-70dcd98a8f44 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:03.371926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edc4f9-8631-4b8c-932b-8e89f120331e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:03.373522 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edc4f9-8631-4b8c-932b-8e89f120331e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:03.373890 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edc4f9-8631-4b8c-932b-8e89f120331e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:03.376276 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edc4f9-8631-4b8c-932b-8e89f120331e admin admin] PATH_INFO: `/v3/users/94e9de8a3d3b479ba8b00b10638b8d42` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:03.382639 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edc4f9-8631-4b8c-932b-8e89f120331e admin admin] RBAC: Authorizing `identity:delete_user(user_id=94e9de8a3d3b479ba8b00b10638b8d42)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:03.385511 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edc4f9-8631-4b8c-932b-8e89f120331e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:03.390284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:03.406644 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 975/1916] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:06:03.409143 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228eb57-4120-40d7-a039-70dcd98a8f44 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:03.432557 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228eb57-4120-40d7-a039-70dcd98a8f44 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:03.444260 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b378777-7b79-493c-bc7c-109151777ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:03.445553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b378777-7b79-493c-bc7c-109151777ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:03.445832 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b378777-7b79-493c-bc7c-109151777ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:03.447255 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b378777-7b79-493c-bc7c-109151777ed5 admin admin] PATH_INFO: `/v3/projects/6931a7c2d76748778928a134f6672ce6/users/a531965e1c934aea83f492f011b89073/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:03.504443 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b378777-7b79-493c-bc7c-109151777ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6931a7c2d76748778928a134f6672ce6, user_id=a531965e1c934aea83f492f011b89073, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:03.510118 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-41edc4f9-8631-4b8c-932b-8e89f120331e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94e9de8a3d3b479ba8b00b10638b8d42'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:03.511928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b378777-7b79-493c-bc7c-109151777ed5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:03.528256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-41edc4f9-8631-4b8c-932b-8e89f120331e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94e9de8a3d3b479ba8b00b10638b8d42'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:03.548443 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 976/1917] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:06:03 2022] PUT /identity/v3/projects/6931a7c2d76748778928a134f6672ce6/users/a531965e1c934aea83f492f011b89073/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:03.559500 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ce305-2104-481f-b61e-0753b0a88ebf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:03.559788 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ce305-2104-481f-b61e-0753b0a88ebf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:03.560063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ce305-2104-481f-b61e-0753b0a88ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:03.576005 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-41edc4f9-8631-4b8c-932b-8e89f120331e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94e9de8a3d3b479ba8b00b10638b8d42'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:03.576868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-41edc4f9-8631-4b8c-932b-8e89f120331e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94e9de8a3d3b479ba8b00b10638b8d42'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:03.593464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-41edc4f9-8631-4b8c-932b-8e89f120331e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94e9de8a3d3b479ba8b00b10638b8d42'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:03.594621 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8b9ce305-2104-481f-b61e-0753b0a88ebf None None] MFA Rules not processed for user `a531965e1c934aea83f492f011b89073`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:03.595960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8b9ce305-2104-481f-b61e-0753b0a88ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:03.604056 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 942/1918] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:06:03 2022] DELETE /identity/v3/users/94e9de8a3d3b479ba8b00b10638b8d42 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:06:03.609002 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb52bc-0fdf-41b8-9362-b77962473447 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:03.610032 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb52bc-0fdf-41b8-9362-b77962473447 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:03.610402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb52bc-0fdf-41b8-9362-b77962473447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:03.666680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f1eb52bc-0fdf-41b8-9362-b77962473447 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:03.668789 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f1eb52bc-0fdf-41b8-9362-b77962473447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:03.728955 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 977/1919] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:03.766473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ce305-2104-481f-b61e-0753b0a88ebf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:03.770195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8b9ce305-2104-481f-b61e-0753b0a88ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:03.802711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 943/1920] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:03.856216 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ce305-2104-481f-b61e-0753b0a88ebf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:03.906413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb52bc-0fdf-41b8-9362-b77962473447 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:03.909383 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f1eb52bc-0fdf-41b8-9362-b77962473447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:03.915870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf7227-8e70-4330-b4fd-33d939c68847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:03.916667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf7227-8e70-4330-b4fd-33d939c68847 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:03.917119 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf7227-8e70-4330-b4fd-33d939c68847 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:03.917545 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf7227-8e70-4330-b4fd-33d939c68847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:03.932958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb52bc-0fdf-41b8-9362-b77962473447 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:03.937745 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f723cd-b5eb-462b-84c8-612c93d205af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:03.939571 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f723cd-b5eb-462b-84c8-612c93d205af service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:03.940004 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f723cd-b5eb-462b-84c8-612c93d205af service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:03.940689 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f723cd-b5eb-462b-84c8-612c93d205af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:03.967345 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f723cd-b5eb-462b-84c8-612c93d205af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:03.972899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f723cd-b5eb-462b-84c8-612c93d205af service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:03.986610 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:03.991689 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 944/1921] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:06:04.029806 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf7227-8e70-4330-b4fd-33d939c68847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:04.032984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf7227-8e70-4330-b4fd-33d939c68847 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:04.046803 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 978/1922] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:06:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:06:05.008358 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f723cd-b5eb-462b-84c8-612c93d205af service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:05.010649 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-13f723cd-b5eb-462b-84c8-612c93d205af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:05.026853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f723cd-b5eb-462b-84c8-612c93d205af service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:05.036278 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f0326-ec25-455d-86cd-17c7d12f6c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:05.038639 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f0326-ec25-455d-86cd-17c7d12f6c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:05.039014 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f0326-ec25-455d-86cd-17c7d12f6c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:05.039383 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f0326-ec25-455d-86cd-17c7d12f6c5a admin admin] PATH_INFO: `/v3/projects/4c38e247a5cd46a5821b120eb79e714a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:05.041297 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f0326-ec25-455d-86cd-17c7d12f6c5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c38e247a5cd46a5821b120eb79e714a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:05.043318 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f0326-ec25-455d-86cd-17c7d12f6c5a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:05.114917 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:05.131129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-330f0326-ec25-455d-86cd-17c7d12f6c5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c38e247a5cd46a5821b120eb79e714a', 'request_id': 'req-330f0326-ec25-455d-86cd-17c7d12f6c5a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:05.144602 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-330f0326-ec25-455d-86cd-17c7d12f6c5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c38e247a5cd46a5821b120eb79e714a', 'request_id': 'req-330f0326-ec25-455d-86cd-17c7d12f6c5a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:05.157889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-330f0326-ec25-455d-86cd-17c7d12f6c5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c38e247a5cd46a5821b120eb79e714a', 'request_id': 'req-330f0326-ec25-455d-86cd-17c7d12f6c5a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:05.180853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-330f0326-ec25-455d-86cd-17c7d12f6c5a admin admin] The token cache is being invalidate because project 4c38e247a5cd46a5821b120eb79e714a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:06:05.181461 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-330f0326-ec25-455d-86cd-17c7d12f6c5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:05.183102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-330f0326-ec25-455d-86cd-17c7d12f6c5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:05.186458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 945/1923] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:06:05 2022] DELETE /identity/v3/projects/4c38e247a5cd46a5821b120eb79e714a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:05.191993 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34b106-d9f8-4fc3-9d87-af86fb00b31f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:05.192576 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34b106-d9f8-4fc3-9d87-af86fb00b31f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:05.192679 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34b106-d9f8-4fc3-9d87-af86fb00b31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:05.225115 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4c34b106-d9f8-4fc3-9d87-af86fb00b31f None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:05.227758 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4c34b106-d9f8-4fc3-9d87-af86fb00b31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:05.364638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 979/1924] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:05.375117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17797c-59db-4db4-9257-f8866528d468 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:05.375570 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17797c-59db-4db4-9257-f8866528d468 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:05.375860 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17797c-59db-4db4-9257-f8866528d468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:05.400153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2d17797c-59db-4db4-9257-f8866528d468 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:05.402029 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2d17797c-59db-4db4-9257-f8866528d468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:05.410950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 946/1925] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:05.415529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34b106-d9f8-4fc3-9d87-af86fb00b31f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:05.421518 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17797c-59db-4db4-9257-f8866528d468 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:05.425051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2d17797c-59db-4db4-9257-f8866528d468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:05.426788 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34b106-d9f8-4fc3-9d87-af86fb00b31f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:05.434041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d779c2-deef-403e-8a71-44ab5b8aa07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:05.435287 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d779c2-deef-403e-8a71-44ab5b8aa07b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:05.435672 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d779c2-deef-403e-8a71-44ab5b8aa07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:05.436004 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d779c2-deef-403e-8a71-44ab5b8aa07b admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:05.436995 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d779c2-deef-403e-8a71-44ab5b8aa07b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:06:05.437309 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d779c2-deef-403e-8a71-44ab5b8aa07b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:05.444508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d779c2-deef-403e-8a71-44ab5b8aa07b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:05.454976 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 980/1926] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:06:05.459301 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d779c2-deef-403e-8a71-44ab5b8aa07b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:05.472530 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d779c2-deef-403e-8a71-44ab5b8aa07b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:05.481087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b9942-9ec9-454b-bde5-05bc340aaa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:05.482727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b9942-9ec9-454b-bde5-05bc340aaa3e admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:05.483645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b9942-9ec9-454b-bde5-05bc340aaa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:05.484110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b9942-9ec9-454b-bde5-05bc340aaa3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:05.485053 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b9942-9ec9-454b-bde5-05bc340aaa3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:05.487792 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b9942-9ec9-454b-bde5-05bc340aaa3e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:05.514124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17797c-59db-4db4-9257-f8866528d468 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:05.519412 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec81d6-dead-46cb-ba1d-2adea8386ec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:05.520500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec81d6-dead-46cb-ba1d-2adea8386ec7 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:05.521032 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec81d6-dead-46cb-ba1d-2adea8386ec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:05.521462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec81d6-dead-46cb-ba1d-2adea8386ec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:05.524413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d2ec81d6-dead-46cb-ba1d-2adea8386ec7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:05.527321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 981/1927] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:06:05 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:06:05.531055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b9942-9ec9-454b-bde5-05bc340aaa3e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:05.617635 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b9942-9ec9-454b-bde5-05bc340aaa3e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:05.618774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec81d6-dead-46cb-ba1d-2adea8386ec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:05.620601 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec81d6-dead-46cb-ba1d-2adea8386ec7 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:05.623905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b45fd-6603-4a0e-9c89-7c9bbab6c3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:05.624874 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b45fd-6603-4a0e-9c89-7c9bbab6c3c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:05.625614 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b45fd-6603-4a0e-9c89-7c9bbab6c3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:05.626040 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b45fd-6603-4a0e-9c89-7c9bbab6c3c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:05.626954 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b45fd-6603-4a0e-9c89-7c9bbab6c3c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:05.628994 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b45fd-6603-4a0e-9c89-7c9bbab6c3c2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:05.633248 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 947/1928] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:06:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:06:05.656288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 982/1929] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:06:05 2022] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:06:05.657635 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec81d6-dead-46cb-ba1d-2adea8386ec7 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:05.669407 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec81d6-dead-46cb-ba1d-2adea8386ec7 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:05.674801 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5067f-15d1-4673-b530-31603568a007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:05.675671 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5067f-15d1-4673-b530-31603568a007 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:05.675956 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5067f-15d1-4673-b530-31603568a007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:05.676230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5067f-15d1-4673-b530-31603568a007 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:05.677206 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5067f-15d1-4673-b530-31603568a007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:05.679113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5067f-15d1-4673-b530-31603568a007 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:05.692200 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 948/1930] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:06:05.696686 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b45fd-6603-4a0e-9c89-7c9bbab6c3c2 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:05.708972 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b45fd-6603-4a0e-9c89-7c9bbab6c3c2 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:05.714457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf52eb-f7f1-4090-b0d5-8f36c629e600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:05.715218 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf52eb-f7f1-4090-b0d5-8f36c629e600 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:05.715424 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf52eb-f7f1-4090-b0d5-8f36c629e600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:05.715725 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf52eb-f7f1-4090-b0d5-8f36c629e600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:05.716748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf52eb-f7f1-4090-b0d5-8f36c629e600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:05.718221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf52eb-f7f1-4090-b0d5-8f36c629e600 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:05.733043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 983/1931] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:06:05.736380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5067f-15d1-4673-b530-31603568a007 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:05.747667 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5067f-15d1-4673-b530-31603568a007 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:05.754500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c728b3-5cb2-4b75-bb0d-177d6afd2a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:05.754978 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c728b3-5cb2-4b75-bb0d-177d6afd2a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:05.754978 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c728b3-5cb2-4b75-bb0d-177d6afd2a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:05.755418 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c728b3-5cb2-4b75-bb0d-177d6afd2a17 admin admin] PATH_INFO: `/v3/projects/8cad4a9fbba946faa78732c9b0017dbf/users/df4dac11851440c6a37dcca360c2356c/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:05.793063 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c728b3-5cb2-4b75-bb0d-177d6afd2a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cad4a9fbba946faa78732c9b0017dbf, user_id=df4dac11851440c6a37dcca360c2356c, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:05.796041 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c728b3-5cb2-4b75-bb0d-177d6afd2a17 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:05.816133 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 949/1932] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:06:05 2022] PUT /identity/v3/projects/8cad4a9fbba946faa78732c9b0017dbf/users/df4dac11851440c6a37dcca360c2356c/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:05.828562 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a98fb1-922c-4a13-95ac-f334d9b4ae4c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:05.828883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a98fb1-922c-4a13-95ac-f334d9b4ae4c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:05.829165 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a98fb1-922c-4a13-95ac-f334d9b4ae4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:05.867976 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-99a98fb1-922c-4a13-95ac-f334d9b4ae4c None None] MFA Rules not processed for user `df4dac11851440c6a37dcca360c2356c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:05.874725 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-99a98fb1-922c-4a13-95ac-f334d9b4ae4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:05.883653 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:05.961714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 984/1933] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:05.980358 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c728b3-5cb2-4b75-bb0d-177d6afd2a17 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:06.033205 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:06.056975 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c728b3-5cb2-4b75-bb0d-177d6afd2a17 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:06.067412 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95266785-58a6-4530-b187-aec1b0103ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:06.068366 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95266785-58a6-4530-b187-aec1b0103ccb service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:06.068782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95266785-58a6-4530-b187-aec1b0103ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:06.069230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95266785-58a6-4530-b187-aec1b0103ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:06.080485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95266785-58a6-4530-b187-aec1b0103ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:06.082313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95266785-58a6-4530-b187-aec1b0103ccb service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:06.095110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 950/1934] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:06:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:06:15.957167 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=23 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:16.088805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=9 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:20.677975 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a98fb1-922c-4a13-95ac-f334d9b4ae4c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:20.679804 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-99a98fb1-922c-4a13-95ac-f334d9b4ae4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:20.884521 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a98fb1-922c-4a13-95ac-f334d9b4ae4c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:20.891520 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9f62b-295b-4181-a147-98814880ee55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:20.893159 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9f62b-295b-4181-a147-98814880ee55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:20.893702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9f62b-295b-4181-a147-98814880ee55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:20.894228 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9f62b-295b-4181-a147-98814880ee55 admin admin] PATH_INFO: `/v3/users/a531965e1c934aea83f492f011b89073` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:20.895895 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9f62b-295b-4181-a147-98814880ee55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a531965e1c934aea83f492f011b89073)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:20.899490 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9f62b-295b-4181-a147-98814880ee55 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:21.077438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1cc9f62b-295b-4181-a147-98814880ee55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a531965e1c934aea83f492f011b89073'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:21.097797 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1cc9f62b-295b-4181-a147-98814880ee55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a531965e1c934aea83f492f011b89073'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:21.117188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1cc9f62b-295b-4181-a147-98814880ee55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a531965e1c934aea83f492f011b89073'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:21.118070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1cc9f62b-295b-4181-a147-98814880ee55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a531965e1c934aea83f492f011b89073'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:21.118779 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1cc9f62b-295b-4181-a147-98814880ee55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a531965e1c934aea83f492f011b89073'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:21.171240 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 985/1935] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:06:20 2022] DELETE /identity/v3/users/a531965e1c934aea83f492f011b89073 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:21.178180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bd70a-b68b-44db-8b28-a841a6f25333 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:21.179291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bd70a-b68b-44db-8b28-a841a6f25333 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:21.183760 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bd70a-b68b-44db-8b28-a841a6f25333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:21.211785 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-309bd70a-b68b-44db-8b28-a841a6f25333 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:21.216598 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-309bd70a-b68b-44db-8b28-a841a6f25333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:21.356221 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 951/1936] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:21.384897 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9f62b-295b-4181-a147-98814880ee55 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:21.388408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1cc9f62b-295b-4181-a147-98814880ee55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:21.539020 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9f62b-295b-4181-a147-98814880ee55 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:21.549129 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550693b1-c4e9-457f-bdf9-5bd1a883ebc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:21.550243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550693b1-c4e9-457f-bdf9-5bd1a883ebc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:21.551162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550693b1-c4e9-457f-bdf9-5bd1a883ebc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:21.551590 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550693b1-c4e9-457f-bdf9-5bd1a883ebc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:21.566373 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550693b1-c4e9-457f-bdf9-5bd1a883ebc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:21.568463 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550693b1-c4e9-457f-bdf9-5bd1a883ebc2 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:21.584370 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 986/1937] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:06:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:06:21.850268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309bd70a-b68b-44db-8b28-a841a6f25333 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:21.852480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-309bd70a-b68b-44db-8b28-a841a6f25333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:21.873095 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309bd70a-b68b-44db-8b28-a841a6f25333 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:21.879064 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec84c9-4a7a-410d-a3a0-a295c3ad1ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:21.880259 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec84c9-4a7a-410d-a3a0-a295c3ad1ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:21.880856 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec84c9-4a7a-410d-a3a0-a295c3ad1ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:21.881238 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec84c9-4a7a-410d-a3a0-a295c3ad1ef4 admin admin] PATH_INFO: `/v3/projects/6931a7c2d76748778928a134f6672ce6` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:21.882680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec84c9-4a7a-410d-a3a0-a295c3ad1ef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6931a7c2d76748778928a134f6672ce6)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:21.885917 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec84c9-4a7a-410d-a3a0-a295c3ad1ef4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:21.985187 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-78ec84c9-4a7a-410d-a3a0-a295c3ad1ef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6931a7c2d76748778928a134f6672ce6', 'request_id': 'req-78ec84c9-4a7a-410d-a3a0-a295c3ad1ef4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:21.997414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-78ec84c9-4a7a-410d-a3a0-a295c3ad1ef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6931a7c2d76748778928a134f6672ce6', 'request_id': 'req-78ec84c9-4a7a-410d-a3a0-a295c3ad1ef4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:22.004976 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-78ec84c9-4a7a-410d-a3a0-a295c3ad1ef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6931a7c2d76748778928a134f6672ce6', 'request_id': 'req-78ec84c9-4a7a-410d-a3a0-a295c3ad1ef4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:22.018567 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-78ec84c9-4a7a-410d-a3a0-a295c3ad1ef4 admin admin] The token cache is being invalidate because project 6931a7c2d76748778928a134f6672ce6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:06:22.019248 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-78ec84c9-4a7a-410d-a3a0-a295c3ad1ef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:22.020787 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-78ec84c9-4a7a-410d-a3a0-a295c3ad1ef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:22.024241 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 952/1938] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:06:21 2022] DELETE /identity/v3/projects/6931a7c2d76748778928a134f6672ce6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:22.031310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f01314-bd9d-4420-a51d-0305a3c87560 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:22.031922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f01314-bd9d-4420-a51d-0305a3c87560 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:22.032795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f01314-bd9d-4420-a51d-0305a3c87560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:22.053182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e0f01314-bd9d-4420-a51d-0305a3c87560 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:22.056414 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e0f01314-bd9d-4420-a51d-0305a3c87560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:22.086172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:22.174535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 987/1939] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:22.183977 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de4170-1ad7-4872-81d5-c740e969f6ff None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:22.184911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de4170-1ad7-4872-81d5-c740e969f6ff None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:22.185409 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de4170-1ad7-4872-81d5-c740e969f6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:22.213227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-80de4170-1ad7-4872-81d5-c740e969f6ff None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:22.215193 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-80de4170-1ad7-4872-81d5-c740e969f6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:22.234586 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f01314-bd9d-4420-a51d-0305a3c87560 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:22.254210 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 953/1940] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:22.258832 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f01314-bd9d-4420-a51d-0305a3c87560 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:22.267138 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e0cc1-84aa-4b35-a81e-b1492224f944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:22.268197 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e0cc1-84aa-4b35-a81e-b1492224f944 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:22.268793 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e0cc1-84aa-4b35-a81e-b1492224f944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:22.269226 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e0cc1-84aa-4b35-a81e-b1492224f944 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:22.270121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e0cc1-84aa-4b35-a81e-b1492224f944 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:06:22.270596 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e0cc1-84aa-4b35-a81e-b1492224f944 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:22.272705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e0cc1-84aa-4b35-a81e-b1492224f944 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:22.295178 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de4170-1ad7-4872-81d5-c740e969f6ff None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:22.306456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 988/1941] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:06:22.309270 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de4170-1ad7-4872-81d5-c740e969f6ff None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:22.322399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b8086-e7c9-4f9b-9623-924b3bda838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:22.323437 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b8086-e7c9-4f9b-9623-924b3bda838c admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:22.323913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b8086-e7c9-4f9b-9623-924b3bda838c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:22.324371 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b8086-e7c9-4f9b-9623-924b3bda838c admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:22.325493 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b8086-e7c9-4f9b-9623-924b3bda838c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:22.327726 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b8086-e7c9-4f9b-9623-924b3bda838c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:22.368298 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 954/1942] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:06:22 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:06:22.373754 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e0cc1-84aa-4b35-a81e-b1492224f944 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:22.396737 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e0cc1-84aa-4b35-a81e-b1492224f944 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:22.581930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed5bcb-c68f-48c8-b000-25ddf79f13d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:22.583441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed5bcb-c68f-48c8-b000-25ddf79f13d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:22.583983 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed5bcb-c68f-48c8-b000-25ddf79f13d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:22.584528 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed5bcb-c68f-48c8-b000-25ddf79f13d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:22.586619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed5bcb-c68f-48c8-b000-25ddf79f13d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:22.589150 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed5bcb-c68f-48c8-b000-25ddf79f13d2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:22.636143 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 989/1943] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:06:22 2022] POST /identity/v3/users => generated 288 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:06:22.640629 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b8086-e7c9-4f9b-9623-924b3bda838c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:22.669161 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b8086-e7c9-4f9b-9623-924b3bda838c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:22.680146 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13b8d3-2cbe-4fea-8968-c12705657a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:22.681174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13b8d3-2cbe-4fea-8968-c12705657a99 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:22.681764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13b8d3-2cbe-4fea-8968-c12705657a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:22.682186 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13b8d3-2cbe-4fea-8968-c12705657a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:22.683549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13b8d3-2cbe-4fea-8968-c12705657a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:22.687654 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13b8d3-2cbe-4fea-8968-c12705657a99 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:22.702970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 955/1944] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:06:22.707324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed5bcb-c68f-48c8-b000-25ddf79f13d2 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:22.720694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed5bcb-c68f-48c8-b000-25ddf79f13d2 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:22.730081 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83547d1-da44-4f14-9ea7-e3c639510e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:22.730746 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83547d1-da44-4f14-9ea7-e3c639510e25 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:22.731025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83547d1-da44-4f14-9ea7-e3c639510e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:22.731354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83547d1-da44-4f14-9ea7-e3c639510e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:22.732111 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83547d1-da44-4f14-9ea7-e3c639510e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:22.733802 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83547d1-da44-4f14-9ea7-e3c639510e25 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:22.746179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 990/1945] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:06:22.750328 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13b8d3-2cbe-4fea-8968-c12705657a99 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:22.766173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13b8d3-2cbe-4fea-8968-c12705657a99 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:22.772842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687dea9-a4fd-4026-98b6-ca82b4e31e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:22.773835 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687dea9-a4fd-4026-98b6-ca82b4e31e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:22.774116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687dea9-a4fd-4026-98b6-ca82b4e31e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:22.774394 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687dea9-a4fd-4026-98b6-ca82b4e31e09 admin admin] PATH_INFO: `/v3/projects/430242a2daa244108944494f0f658bfe/users/25bd376ff6254886a3582ccb72c09efa/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:22.802273 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687dea9-a4fd-4026-98b6-ca82b4e31e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=430242a2daa244108944494f0f658bfe, user_id=25bd376ff6254886a3582ccb72c09efa, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:22.805123 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687dea9-a4fd-4026-98b6-ca82b4e31e09 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:22.827306 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 956/1946] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:06:22 2022] PUT /identity/v3/projects/430242a2daa244108944494f0f658bfe/users/25bd376ff6254886a3582ccb72c09efa/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:22.838307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb996f-4f32-47f2-af7d-98575ca35184 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:22.838687 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb996f-4f32-47f2-af7d-98575ca35184 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:22.838938 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb996f-4f32-47f2-af7d-98575ca35184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:22.878687 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d8eb996f-4f32-47f2-af7d-98575ca35184 None None] MFA Rules not processed for user `25bd376ff6254886a3582ccb72c09efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:22.880085 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d8eb996f-4f32-47f2-af7d-98575ca35184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:22.982815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 991/1947] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:23.006101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687dea9-a4fd-4026-98b6-ca82b4e31e09 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:23.008036 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5687dea9-a4fd-4026-98b6-ca82b4e31e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:23.071310 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:23.153537 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687dea9-a4fd-4026-98b6-ca82b4e31e09 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:23.157757 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f523fbf-ab81-4738-88a7-97c4f58113f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:23.158434 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f523fbf-ab81-4738-88a7-97c4f58113f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:23.158717 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f523fbf-ab81-4738-88a7-97c4f58113f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:23.158992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f523fbf-ab81-4738-88a7-97c4f58113f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:23.175188 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f523fbf-ab81-4738-88a7-97c4f58113f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:23.176911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f523fbf-ab81-4738-88a7-97c4f58113f9 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:23.190258 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 957/1948] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:06:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:06:24.509761 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb996f-4f32-47f2-af7d-98575ca35184 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:24.513540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d8eb996f-4f32-47f2-af7d-98575ca35184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:24.558250 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:24.655086 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb996f-4f32-47f2-af7d-98575ca35184 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:24.661055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956359de-3070-4d86-8be9-5c1c7b5bf94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:24.662476 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956359de-3070-4d86-8be9-5c1c7b5bf94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:24.663286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956359de-3070-4d86-8be9-5c1c7b5bf94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:24.663727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956359de-3070-4d86-8be9-5c1c7b5bf94c admin admin] PATH_INFO: `/v3/users/62a420cae1104b3087c7735ece1f59f2` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:24.666346 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956359de-3070-4d86-8be9-5c1c7b5bf94c admin admin] RBAC: Authorizing `identity:delete_user(user_id=62a420cae1104b3087c7735ece1f59f2)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:24.668822 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956359de-3070-4d86-8be9-5c1c7b5bf94c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:24.758269 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-956359de-3070-4d86-8be9-5c1c7b5bf94c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62a420cae1104b3087c7735ece1f59f2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:24.772869 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-956359de-3070-4d86-8be9-5c1c7b5bf94c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62a420cae1104b3087c7735ece1f59f2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:24.788080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-956359de-3070-4d86-8be9-5c1c7b5bf94c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62a420cae1104b3087c7735ece1f59f2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:24.788880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-956359de-3070-4d86-8be9-5c1c7b5bf94c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62a420cae1104b3087c7735ece1f59f2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:24.789490 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-956359de-3070-4d86-8be9-5c1c7b5bf94c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62a420cae1104b3087c7735ece1f59f2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:24.822681 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 992/1949] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:06:24 2022] DELETE /identity/v3/users/62a420cae1104b3087c7735ece1f59f2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:24.824765 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7fd08-e60a-422b-802c-a96621ab444c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:24.825338 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7fd08-e60a-422b-802c-a96621ab444c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:24.825338 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7fd08-e60a-422b-802c-a96621ab444c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:24.844830 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c2b7fd08-e60a-422b-802c-a96621ab444c None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:24.847074 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c2b7fd08-e60a-422b-802c-a96621ab444c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:24.971895 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 958/1950] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:24.998937 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956359de-3070-4d86-8be9-5c1c7b5bf94c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:25.002481 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-956359de-3070-4d86-8be9-5c1c7b5bf94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:25.260185 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956359de-3070-4d86-8be9-5c1c7b5bf94c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:25.265889 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64960e13-b0d9-4140-a005-5d1a351a00f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:25.266649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64960e13-b0d9-4140-a005-5d1a351a00f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:25.266949 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64960e13-b0d9-4140-a005-5d1a351a00f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:25.267110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64960e13-b0d9-4140-a005-5d1a351a00f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:25.291979 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64960e13-b0d9-4140-a005-5d1a351a00f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:25.297337 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64960e13-b0d9-4140-a005-5d1a351a00f3 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:25.323011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 993/1951] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:06:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:06:26.192167 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7fd08-e60a-422b-802c-a96621ab444c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:26.195737 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c2b7fd08-e60a-422b-802c-a96621ab444c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:26.212764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7fd08-e60a-422b-802c-a96621ab444c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:26.218986 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee1b0d-9504-477e-8e60-565d6755e2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:26.222235 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee1b0d-9504-477e-8e60-565d6755e2b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:26.222822 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee1b0d-9504-477e-8e60-565d6755e2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:26.223365 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee1b0d-9504-477e-8e60-565d6755e2b1 admin admin] PATH_INFO: `/v3/projects/7d911926d760413b835abf584757c1f0` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:26.226304 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee1b0d-9504-477e-8e60-565d6755e2b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d911926d760413b835abf584757c1f0)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:26.228945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee1b0d-9504-477e-8e60-565d6755e2b1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:26.318498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ceee1b0d-9504-477e-8e60-565d6755e2b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d911926d760413b835abf584757c1f0', 'request_id': 'req-ceee1b0d-9504-477e-8e60-565d6755e2b1'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:26.332050 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ceee1b0d-9504-477e-8e60-565d6755e2b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d911926d760413b835abf584757c1f0', 'request_id': 'req-ceee1b0d-9504-477e-8e60-565d6755e2b1'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:26.343969 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ceee1b0d-9504-477e-8e60-565d6755e2b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d911926d760413b835abf584757c1f0', 'request_id': 'req-ceee1b0d-9504-477e-8e60-565d6755e2b1'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:26.367031 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ceee1b0d-9504-477e-8e60-565d6755e2b1 admin admin] The token cache is being invalidate because project 7d911926d760413b835abf584757c1f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:06:26.367593 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ceee1b0d-9504-477e-8e60-565d6755e2b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:26.368901 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ceee1b0d-9504-477e-8e60-565d6755e2b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:26.371143 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 959/1952] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:06:26 2022] DELETE /identity/v3/projects/7d911926d760413b835abf584757c1f0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:26.375861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64960e13-b0d9-4140-a005-5d1a351a00f3 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:26.394871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64960e13-b0d9-4140-a005-5d1a351a00f3 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:26.473601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:26.511566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d6ef8-2d70-46eb-8b1c-946e67ac663f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:26.512907 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d6ef8-2d70-46eb-8b1c-946e67ac663f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:26.517372 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d6ef8-2d70-46eb-8b1c-946e67ac663f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:26.522389 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d6ef8-2d70-46eb-8b1c-946e67ac663f admin admin] PATH_INFO: `/v3/users/e5f8defe0b684dafbf561b74563d3e40` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:26.524366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d6ef8-2d70-46eb-8b1c-946e67ac663f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5f8defe0b684dafbf561b74563d3e40)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:26.528786 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d6ef8-2d70-46eb-8b1c-946e67ac663f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:26.646422 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5f7d6ef8-2d70-46eb-8b1c-946e67ac663f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5f8defe0b684dafbf561b74563d3e40'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:26.658183 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5f7d6ef8-2d70-46eb-8b1c-946e67ac663f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5f8defe0b684dafbf561b74563d3e40'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:26.680443 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5f7d6ef8-2d70-46eb-8b1c-946e67ac663f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5f8defe0b684dafbf561b74563d3e40'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:26.684535 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5f7d6ef8-2d70-46eb-8b1c-946e67ac663f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5f8defe0b684dafbf561b74563d3e40'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:26.685427 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5f7d6ef8-2d70-46eb-8b1c-946e67ac663f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5f8defe0b684dafbf561b74563d3e40'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:26.738230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 994/1953] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:06:26 2022] DELETE /identity/v3/users/e5f8defe0b684dafbf561b74563d3e40 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:06:27.901367 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee1b0d-9504-477e-8e60-565d6755e2b1 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:27.903718 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ceee1b0d-9504-477e-8e60-565d6755e2b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:27.950336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee1b0d-9504-477e-8e60-565d6755e2b1 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:28.089445 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:28.123186 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c2615-158c-4528-8d16-3562a2b22435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:28.124026 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c2615-158c-4528-8d16-3562a2b22435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:28.126485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c2615-158c-4528-8d16-3562a2b22435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:28.127011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c2615-158c-4528-8d16-3562a2b22435 admin admin] PATH_INFO: `/v3/projects/0347e1d7b913450a9e861d05bd4b0ea8` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:28.130089 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c2615-158c-4528-8d16-3562a2b22435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0347e1d7b913450a9e861d05bd4b0ea8)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:28.135487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c2615-158c-4528-8d16-3562a2b22435 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:28.259520 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-771c2615-158c-4528-8d16-3562a2b22435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0347e1d7b913450a9e861d05bd4b0ea8', 'request_id': 'req-771c2615-158c-4528-8d16-3562a2b22435'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:28.276517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-771c2615-158c-4528-8d16-3562a2b22435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0347e1d7b913450a9e861d05bd4b0ea8', 'request_id': 'req-771c2615-158c-4528-8d16-3562a2b22435'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:28.286499 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-771c2615-158c-4528-8d16-3562a2b22435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0347e1d7b913450a9e861d05bd4b0ea8', 'request_id': 'req-771c2615-158c-4528-8d16-3562a2b22435'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:28.314943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-771c2615-158c-4528-8d16-3562a2b22435 admin admin] The token cache is being invalidate because project 0347e1d7b913450a9e861d05bd4b0ea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:06:28.317113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-771c2615-158c-4528-8d16-3562a2b22435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:28.317995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-771c2615-158c-4528-8d16-3562a2b22435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:28.331124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 960/1954] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:06:27 2022] DELETE /identity/v3/projects/0347e1d7b913450a9e861d05bd4b0ea8 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:28.335273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d6ef8-2d70-46eb-8b1c-946e67ac663f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:28.336814 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5f7d6ef8-2d70-46eb-8b1c-946e67ac663f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:28.360502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d6ef8-2d70-46eb-8b1c-946e67ac663f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:28.490462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ef6d1-00ac-4cc2-8a18-5f237c72b081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:28.491385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ef6d1-00ac-4cc2-8a18-5f237c72b081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:28.491670 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ef6d1-00ac-4cc2-8a18-5f237c72b081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:28.491943 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ef6d1-00ac-4cc2-8a18-5f237c72b081 admin admin] PATH_INFO: `/v3/users/2afed7b688ed4af39d674a5a147c709e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:28.493939 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ef6d1-00ac-4cc2-8a18-5f237c72b081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2afed7b688ed4af39d674a5a147c709e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:28.495908 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ef6d1-00ac-4cc2-8a18-5f237c72b081 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:28.602723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-114ef6d1-00ac-4cc2-8a18-5f237c72b081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2afed7b688ed4af39d674a5a147c709e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:28.614900 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-114ef6d1-00ac-4cc2-8a18-5f237c72b081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2afed7b688ed4af39d674a5a147c709e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:28.627824 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:28.634134 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-114ef6d1-00ac-4cc2-8a18-5f237c72b081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2afed7b688ed4af39d674a5a147c709e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:28.634977 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-114ef6d1-00ac-4cc2-8a18-5f237c72b081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2afed7b688ed4af39d674a5a147c709e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:28.636607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-114ef6d1-00ac-4cc2-8a18-5f237c72b081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2afed7b688ed4af39d674a5a147c709e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:28.683823 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 995/1955] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:06:28 2022] DELETE /identity/v3/users/2afed7b688ed4af39d674a5a147c709e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:29.745717 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c2615-158c-4528-8d16-3562a2b22435 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:29.747287 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-771c2615-158c-4528-8d16-3562a2b22435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:29.775368 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c2615-158c-4528-8d16-3562a2b22435 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:29.920587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d41b0c-57a7-44cb-98a2-fb8ecfaf502d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:29.920587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d41b0c-57a7-44cb-98a2-fb8ecfaf502d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:29.920587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d41b0c-57a7-44cb-98a2-fb8ecfaf502d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:29.920587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d41b0c-57a7-44cb-98a2-fb8ecfaf502d admin admin] PATH_INFO: `/v3/projects/eff4fdb45e194b2ab24356cb33b436e5` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:29.922693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d41b0c-57a7-44cb-98a2-fb8ecfaf502d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eff4fdb45e194b2ab24356cb33b436e5)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:29.925026 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d41b0c-57a7-44cb-98a2-fb8ecfaf502d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:30.005637 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-58d41b0c-57a7-44cb-98a2-fb8ecfaf502d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eff4fdb45e194b2ab24356cb33b436e5', 'request_id': 'req-58d41b0c-57a7-44cb-98a2-fb8ecfaf502d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:30.027848 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-58d41b0c-57a7-44cb-98a2-fb8ecfaf502d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eff4fdb45e194b2ab24356cb33b436e5', 'request_id': 'req-58d41b0c-57a7-44cb-98a2-fb8ecfaf502d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:30.041418 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-58d41b0c-57a7-44cb-98a2-fb8ecfaf502d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eff4fdb45e194b2ab24356cb33b436e5', 'request_id': 'req-58d41b0c-57a7-44cb-98a2-fb8ecfaf502d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:30.115984 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-58d41b0c-57a7-44cb-98a2-fb8ecfaf502d admin admin] The token cache is being invalidate because project eff4fdb45e194b2ab24356cb33b436e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:06:30.116278 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-58d41b0c-57a7-44cb-98a2-fb8ecfaf502d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:30.117265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-58d41b0c-57a7-44cb-98a2-fb8ecfaf502d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:30.124099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 961/1956] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:06:29 2022] DELETE /identity/v3/projects/eff4fdb45e194b2ab24356cb33b436e5 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:30.125549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ee32b-4f3f-43da-8d9e-0fd18760cb02 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:30.126003 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ee32b-4f3f-43da-8d9e-0fd18760cb02 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:30.126003 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ee32b-4f3f-43da-8d9e-0fd18760cb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:30.147627 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0b0ee32b-4f3f-43da-8d9e-0fd18760cb02 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:30.149077 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0b0ee32b-4f3f-43da-8d9e-0fd18760cb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:30.271400 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 996/1957] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:06:30.274809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90157eb4-cba8-4be0-8d75-10f2c24ee33d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:30.275437 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90157eb4-cba8-4be0-8d75-10f2c24ee33d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:30.275723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90157eb4-cba8-4be0-8d75-10f2c24ee33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:30.311988 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:30.325693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-90157eb4-cba8-4be0-8d75-10f2c24ee33d None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:30.327795 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-90157eb4-cba8-4be0-8d75-10f2c24ee33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:30.380974 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 962/1958] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:06:30.401220 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ee32b-4f3f-43da-8d9e-0fd18760cb02 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:30.424171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ee32b-4f3f-43da-8d9e-0fd18760cb02 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:30.432200 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5c923-ced9-4b5e-9a8e-d8dd2d2613c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:30.433355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5c923-ced9-4b5e-9a8e-d8dd2d2613c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:30.434765 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5c923-ced9-4b5e-9a8e-d8dd2d2613c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:30.435272 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5c923-ced9-4b5e-9a8e-d8dd2d2613c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:30.437043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5c923-ced9-4b5e-9a8e-d8dd2d2613c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:06:30.441261 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5c923-ced9-4b5e-9a8e-d8dd2d2613c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:30.443713 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5c923-ced9-4b5e-9a8e-d8dd2d2613c1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:30.467433 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 997/1959] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:06:30.471750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90157eb4-cba8-4be0-8d75-10f2c24ee33d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:30.485097 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90157eb4-cba8-4be0-8d75-10f2c24ee33d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:30.491344 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb49566-86e9-427b-83e4-cf1cb05b5dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:30.492389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb49566-86e9-427b-83e4-cf1cb05b5dac admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:30.492918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb49566-86e9-427b-83e4-cf1cb05b5dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:30.493396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb49566-86e9-427b-83e4-cf1cb05b5dac admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:30.494891 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb49566-86e9-427b-83e4-cf1cb05b5dac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:30.497357 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb49566-86e9-427b-83e4-cf1cb05b5dac admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:30.542029 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 963/1960] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:06:30 2022] POST /identity/v3/projects => generated 399 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:06:30.542647 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5c923-ced9-4b5e-9a8e-d8dd2d2613c1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:30.558998 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5c923-ced9-4b5e-9a8e-d8dd2d2613c1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:30.666892 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a02bb-0682-4b65-af11-758e25b1f894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:30.667681 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a02bb-0682-4b65-af11-758e25b1f894 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:30.667964 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a02bb-0682-4b65-af11-758e25b1f894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:30.668237 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a02bb-0682-4b65-af11-758e25b1f894 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:30.668996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a02bb-0682-4b65-af11-758e25b1f894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:30.671175 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a02bb-0682-4b65-af11-758e25b1f894 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:30.718572 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 998/1961] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:06:30 2022] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:06:30.723669 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb49566-86e9-427b-83e4-cf1cb05b5dac admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:30.736776 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb49566-86e9-427b-83e4-cf1cb05b5dac admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:30.742336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598cb39-4929-4ba8-929d-d7fb51f7e8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:30.743041 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598cb39-4929-4ba8-929d-d7fb51f7e8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:30.743371 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598cb39-4929-4ba8-929d-d7fb51f7e8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:30.743762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598cb39-4929-4ba8-929d-d7fb51f7e8f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:30.744664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598cb39-4929-4ba8-929d-d7fb51f7e8f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:30.746547 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598cb39-4929-4ba8-929d-d7fb51f7e8f3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:30.782068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a02bb-0682-4b65-af11-758e25b1f894 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:30.788658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 964/1962] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:06:30.795640 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a02bb-0682-4b65-af11-758e25b1f894 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:30.802026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07702b27-dc00-4719-8ad3-b9fa7540c902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:30.802971 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07702b27-dc00-4719-8ad3-b9fa7540c902 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:30.803330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07702b27-dc00-4719-8ad3-b9fa7540c902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:30.803683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07702b27-dc00-4719-8ad3-b9fa7540c902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:30.804540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07702b27-dc00-4719-8ad3-b9fa7540c902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:30.806595 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07702b27-dc00-4719-8ad3-b9fa7540c902 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:30.821579 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 999/1963] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:06:30.826262 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598cb39-4929-4ba8-929d-d7fb51f7e8f3 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:30.838667 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598cb39-4929-4ba8-929d-d7fb51f7e8f3 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:30.844043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d150af-13a5-40dc-84d5-54bba4154f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:30.845268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d150af-13a5-40dc-84d5-54bba4154f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:30.845796 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d150af-13a5-40dc-84d5-54bba4154f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:30.846284 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d150af-13a5-40dc-84d5-54bba4154f90 admin admin] PATH_INFO: `/v3/projects/082465f4eaa94cff8ac3c5cfc6dd0b24/users/15c4b056bc524504b536c446ce30211f/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:30.866373 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d150af-13a5-40dc-84d5-54bba4154f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=082465f4eaa94cff8ac3c5cfc6dd0b24, user_id=15c4b056bc524504b536c446ce30211f, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:30.870528 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d150af-13a5-40dc-84d5-54bba4154f90 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:30.909930 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 965/1964] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:06:30 2022] PUT /identity/v3/projects/082465f4eaa94cff8ac3c5cfc6dd0b24/users/15c4b056bc524504b536c446ce30211f/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:30.924364 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac222960-6780-46cd-8149-fa0d919caad9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:30.924735 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac222960-6780-46cd-8149-fa0d919caad9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:30.925052 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac222960-6780-46cd-8149-fa0d919caad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:30.969278 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ac222960-6780-46cd-8149-fa0d919caad9 None None] MFA Rules not processed for user `15c4b056bc524504b536c446ce30211f`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:30.970421 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ac222960-6780-46cd-8149-fa0d919caad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:31.052664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:31.104150 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1000/1965] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:06:31.109064 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d150af-13a5-40dc-84d5-54bba4154f90 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:31.211673 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d150af-13a5-40dc-84d5-54bba4154f90 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:31.218730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646cd6f-2fef-422d-89e1-0156733c1cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:31.219742 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646cd6f-2fef-422d-89e1-0156733c1cdf admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:31.220094 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646cd6f-2fef-422d-89e1-0156733c1cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:31.220476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646cd6f-2fef-422d-89e1-0156733c1cdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:31.221368 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646cd6f-2fef-422d-89e1-0156733c1cdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:31.223428 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646cd6f-2fef-422d-89e1-0156733c1cdf admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:31.266399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 966/1966] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:06:31 2022] POST /identity/v3/projects => generated 399 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:06:31.266976 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac222960-6780-46cd-8149-fa0d919caad9 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:31.284397 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac222960-6780-46cd-8149-fa0d919caad9 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:31.355252 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85a869-be00-4a12-972a-d302aa9f43fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:31.355960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85a869-be00-4a12-972a-d302aa9f43fd admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:31.356277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85a869-be00-4a12-972a-d302aa9f43fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:31.356548 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85a869-be00-4a12-972a-d302aa9f43fd admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:31.357492 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85a869-be00-4a12-972a-d302aa9f43fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:31.359892 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85a869-be00-4a12-972a-d302aa9f43fd admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:31.407887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1001/1967] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:06:31 2022] POST /identity/v3/users => generated 306 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:06:31.413977 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646cd6f-2fef-422d-89e1-0156733c1cdf admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:31.430273 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646cd6f-2fef-422d-89e1-0156733c1cdf admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:31.439265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220c6c2-fa08-4246-b441-6f528c6f65b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:31.440500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220c6c2-fa08-4246-b441-6f528c6f65b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:31.440977 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220c6c2-fa08-4246-b441-6f528c6f65b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:31.441269 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220c6c2-fa08-4246-b441-6f528c6f65b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:31.442040 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220c6c2-fa08-4246-b441-6f528c6f65b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:31.445835 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220c6c2-fa08-4246-b441-6f528c6f65b2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:31.465967 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 967/1968] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:06:31.467386 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85a869-be00-4a12-972a-d302aa9f43fd admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:31.480156 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85a869-be00-4a12-972a-d302aa9f43fd admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:31.485397 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e078457-4f9b-4bd3-8ccb-e10a8cca832a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:31.486411 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e078457-4f9b-4bd3-8ccb-e10a8cca832a admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:31.486752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e078457-4f9b-4bd3-8ccb-e10a8cca832a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:31.487095 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e078457-4f9b-4bd3-8ccb-e10a8cca832a admin admin] PATH_INFO: `/v3/projects/e5e043e57f4a41048921c2669469d3ca/users/70e1c146cfc74ed38aa5c5b065641c0a/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:31.503967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e078457-4f9b-4bd3-8ccb-e10a8cca832a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e043e57f4a41048921c2669469d3ca, user_id=70e1c146cfc74ed38aa5c5b065641c0a, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:31.506741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e078457-4f9b-4bd3-8ccb-e10a8cca832a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:31.523500 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1002/1969] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:06:31 2022] PUT /identity/v3/projects/e5e043e57f4a41048921c2669469d3ca/users/70e1c146cfc74ed38aa5c5b065641c0a/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:31.528296 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220c6c2-fa08-4246-b441-6f528c6f65b2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:31.545722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220c6c2-fa08-4246-b441-6f528c6f65b2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:31.627971 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b3566-64e4-4db4-8fbd-c5a888a6f29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:31.628691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b3566-64e4-4db4-8fbd-c5a888a6f29c admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:31.629018 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b3566-64e4-4db4-8fbd-c5a888a6f29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:31.629290 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b3566-64e4-4db4-8fbd-c5a888a6f29c admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:31.630071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b3566-64e4-4db4-8fbd-c5a888a6f29c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:31.631915 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b3566-64e4-4db4-8fbd-c5a888a6f29c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:31.655645 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 968/1970] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:06:31.657746 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e078457-4f9b-4bd3-8ccb-e10a8cca832a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:31.678957 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e078457-4f9b-4bd3-8ccb-e10a8cca832a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:31.687862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db28c7-3968-421d-9cc0-a0408a2c80f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:31.689473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db28c7-3968-421d-9cc0-a0408a2c80f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:31.689473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db28c7-3968-421d-9cc0-a0408a2c80f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:31.689473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db28c7-3968-421d-9cc0-a0408a2c80f3 admin admin] PATH_INFO: `/v3/projects/e5e043e57f4a41048921c2669469d3ca/users/70e1c146cfc74ed38aa5c5b065641c0a/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:31.693352 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db28c7-3968-421d-9cc0-a0408a2c80f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e043e57f4a41048921c2669469d3ca, user_id=70e1c146cfc74ed38aa5c5b065641c0a, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:31.696537 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db28c7-3968-421d-9cc0-a0408a2c80f3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:31.716825 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1003/1971] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:06:31 2022] PUT /identity/v3/projects/e5e043e57f4a41048921c2669469d3ca/users/70e1c146cfc74ed38aa5c5b065641c0a/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:31.725025 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e2f44-710d-429b-b98e-d01f8e9daac7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:31.725699 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e2f44-710d-429b-b98e-d01f8e9daac7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:31.726145 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e2f44-710d-429b-b98e-d01f8e9daac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:31.770722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:31.777411 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e67e2f44-710d-429b-b98e-d01f8e9daac7 None None] MFA Rules not processed for user `70e1c146cfc74ed38aa5c5b065641c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:31.779826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e67e2f44-710d-429b-b98e-d01f8e9daac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:31.878251 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 969/1972] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:31 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:31.896466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db28c7-3968-421d-9cc0-a0408a2c80f3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:31.898788 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-01db28c7-3968-421d-9cc0-a0408a2c80f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:32.031460 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db28c7-3968-421d-9cc0-a0408a2c80f3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:32.042750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cdd2a-32f6-466c-87bb-ec3ba8aadd47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:32.043438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cdd2a-32f6-466c-87bb-ec3ba8aadd47 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:32.043715 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cdd2a-32f6-466c-87bb-ec3ba8aadd47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:32.043985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cdd2a-32f6-466c-87bb-ec3ba8aadd47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:32.153846 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:32.196254 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cdd2a-32f6-466c-87bb-ec3ba8aadd47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:32.201062 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cdd2a-32f6-466c-87bb-ec3ba8aadd47 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:32.214264 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1004/1973] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:06:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:06:33.005315 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e2f44-710d-429b-b98e-d01f8e9daac7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:33.007756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e67e2f44-710d-429b-b98e-d01f8e9daac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:33.180165 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e2f44-710d-429b-b98e-d01f8e9daac7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:33.200919 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d9e94-1adc-42bc-a08b-79261b044141 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:33.201606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d9e94-1adc-42bc-a08b-79261b044141 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:33.202046 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d9e94-1adc-42bc-a08b-79261b044141 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:33.202452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d9e94-1adc-42bc-a08b-79261b044141 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:33.233807 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d9e94-1adc-42bc-a08b-79261b044141 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:33.235574 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d9e94-1adc-42bc-a08b-79261b044141 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:33.271155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 970/1974] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:06:33 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:06:36.040140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cdd2a-32f6-466c-87bb-ec3ba8aadd47 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:36.041658 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b24cdd2a-32f6-466c-87bb-ec3ba8aadd47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:36.136650 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cdd2a-32f6-466c-87bb-ec3ba8aadd47 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:36.144496 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e98a32-a77e-4937-a2de-af735a027e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:36.148063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e98a32-a77e-4937-a2de-af735a027e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:36.148578 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e98a32-a77e-4937-a2de-af735a027e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:36.149083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e98a32-a77e-4937-a2de-af735a027e1f admin admin] PATH_INFO: `/v3/users/25bd376ff6254886a3582ccb72c09efa` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:36.151575 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e98a32-a77e-4937-a2de-af735a027e1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=25bd376ff6254886a3582ccb72c09efa)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:36.155156 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e98a32-a77e-4937-a2de-af735a027e1f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:36.233316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-33e98a32-a77e-4937-a2de-af735a027e1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25bd376ff6254886a3582ccb72c09efa'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:36.245372 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-33e98a32-a77e-4937-a2de-af735a027e1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25bd376ff6254886a3582ccb72c09efa'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:36.254133 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-33e98a32-a77e-4937-a2de-af735a027e1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25bd376ff6254886a3582ccb72c09efa'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:36.254907 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-33e98a32-a77e-4937-a2de-af735a027e1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25bd376ff6254886a3582ccb72c09efa'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:36.255534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-33e98a32-a77e-4937-a2de-af735a027e1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25bd376ff6254886a3582ccb72c09efa'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:36.284070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1005/1975] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:06:36 2022] DELETE /identity/v3/users/25bd376ff6254886a3582ccb72c09efa => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:36.291150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d02eb-44bd-4b01-9177-138f92aa649a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:36.291648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d02eb-44bd-4b01-9177-138f92aa649a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:36.291858 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d02eb-44bd-4b01-9177-138f92aa649a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:36.320207 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-382d02eb-44bd-4b01-9177-138f92aa649a None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:36.323710 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-382d02eb-44bd-4b01-9177-138f92aa649a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:36.422359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 971/1976] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:06:36.436072 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e98a32-a77e-4937-a2de-af735a027e1f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:36.440201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-33e98a32-a77e-4937-a2de-af735a027e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:36.565075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e98a32-a77e-4937-a2de-af735a027e1f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:36.570455 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d11e13-fb84-46c4-b166-9e527a81953d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:36.571305 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d11e13-fb84-46c4-b166-9e527a81953d service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:36.571672 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d11e13-fb84-46c4-b166-9e527a81953d service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:36.572014 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d11e13-fb84-46c4-b166-9e527a81953d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:36.590151 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d11e13-fb84-46c4-b166-9e527a81953d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:36.592174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d11e13-fb84-46c4-b166-9e527a81953d service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:36.605827 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1006/1977] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:06:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:06:37.533914 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d02eb-44bd-4b01-9177-138f92aa649a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:37.535940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-382d02eb-44bd-4b01-9177-138f92aa649a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:37.554832 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d02eb-44bd-4b01-9177-138f92aa649a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:37.583846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3ac71-d338-47e9-af5d-bc7670b5f830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:37.586992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3ac71-d338-47e9-af5d-bc7670b5f830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:37.587292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3ac71-d338-47e9-af5d-bc7670b5f830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:37.587573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3ac71-d338-47e9-af5d-bc7670b5f830 admin admin] PATH_INFO: `/v3/projects/430242a2daa244108944494f0f658bfe` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:37.589375 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3ac71-d338-47e9-af5d-bc7670b5f830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=430242a2daa244108944494f0f658bfe)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:37.595783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3ac71-d338-47e9-af5d-bc7670b5f830 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:37.659626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:37.738039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a8b3ac71-d338-47e9-af5d-bc7670b5f830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '430242a2daa244108944494f0f658bfe', 'request_id': 'req-a8b3ac71-d338-47e9-af5d-bc7670b5f830'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:37.749582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a8b3ac71-d338-47e9-af5d-bc7670b5f830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '430242a2daa244108944494f0f658bfe', 'request_id': 'req-a8b3ac71-d338-47e9-af5d-bc7670b5f830'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:37.767856 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a8b3ac71-d338-47e9-af5d-bc7670b5f830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '430242a2daa244108944494f0f658bfe', 'request_id': 'req-a8b3ac71-d338-47e9-af5d-bc7670b5f830'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:37.819430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a8b3ac71-d338-47e9-af5d-bc7670b5f830 admin admin] The token cache is being invalidate because project 430242a2daa244108944494f0f658bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:06:37.820125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a8b3ac71-d338-47e9-af5d-bc7670b5f830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:37.820810 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a8b3ac71-d338-47e9-af5d-bc7670b5f830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:37.822919 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 972/1978] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:06:37 2022] DELETE /identity/v3/projects/430242a2daa244108944494f0f658bfe => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:37.829390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e570db6-af79-41bd-a0bf-2769296d038f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:37.832104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e570db6-af79-41bd-a0bf-2769296d038f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:37.832824 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e570db6-af79-41bd-a0bf-2769296d038f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:37.840854 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:37.870225 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0e570db6-af79-41bd-a0bf-2769296d038f None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:37.870225 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0e570db6-af79-41bd-a0bf-2769296d038f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:37.986557 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5142c-9ba8-41ab-94c0-c213972cb918 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:37.986932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1007/1979] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:37.987246 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5142c-9ba8-41ab-94c0-c213972cb918 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:37.987698 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5142c-9ba8-41ab-94c0-c213972cb918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:38.027045 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c8a5142c-9ba8-41ab-94c0-c213972cb918 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:38.028319 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c8a5142c-9ba8-41ab-94c0-c213972cb918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:38.040060 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 973/1980] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:38.044323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e570db6-af79-41bd-a0bf-2769296d038f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:38.065697 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e570db6-af79-41bd-a0bf-2769296d038f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:38.078336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81a9fb-bd9a-4a16-b5f0-89fa2e0e47e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:38.079053 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81a9fb-bd9a-4a16-b5f0-89fa2e0e47e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:38.079588 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81a9fb-bd9a-4a16-b5f0-89fa2e0e47e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:38.079809 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81a9fb-bd9a-4a16-b5f0-89fa2e0e47e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:38.080558 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81a9fb-bd9a-4a16-b5f0-89fa2e0e47e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:06:38.080940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81a9fb-bd9a-4a16-b5f0-89fa2e0e47e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:38.082582 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81a9fb-bd9a-4a16-b5f0-89fa2e0e47e8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:38.120153 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1008/1981] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:06:38.121092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5142c-9ba8-41ab-94c0-c213972cb918 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:38.134578 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5142c-9ba8-41ab-94c0-c213972cb918 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:38.149848 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed9727-26b0-44c3-ab01-675a0a6aeae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:38.150660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed9727-26b0-44c3-ab01-675a0a6aeae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:38.151020 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed9727-26b0-44c3-ab01-675a0a6aeae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:38.151466 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed9727-26b0-44c3-ab01-675a0a6aeae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:38.152252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed9727-26b0-44c3-ab01-675a0a6aeae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:38.154412 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed9727-26b0-44c3-ab01-675a0a6aeae0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:38.212627 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 974/1982] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:06:38 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:06:38.216694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81a9fb-bd9a-4a16-b5f0-89fa2e0e47e8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:38.230533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81a9fb-bd9a-4a16-b5f0-89fa2e0e47e8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:38.322194 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e44474-ccda-4d17-808f-94cf5231c8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:38.322996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e44474-ccda-4d17-808f-94cf5231c8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:38.323282 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e44474-ccda-4d17-808f-94cf5231c8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:38.323557 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e44474-ccda-4d17-808f-94cf5231c8d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:38.324331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e44474-ccda-4d17-808f-94cf5231c8d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:38.326455 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e44474-ccda-4d17-808f-94cf5231c8d5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:38.360446 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1009/1983] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:06:38 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:06:38.364281 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed9727-26b0-44c3-ab01-675a0a6aeae0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:38.394812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed9727-26b0-44c3-ab01-675a0a6aeae0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:38.403766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87108954-5c19-4396-8144-faea1b9bb292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:38.404625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87108954-5c19-4396-8144-faea1b9bb292 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:38.405075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87108954-5c19-4396-8144-faea1b9bb292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:38.405454 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87108954-5c19-4396-8144-faea1b9bb292 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:38.406499 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87108954-5c19-4396-8144-faea1b9bb292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:38.408269 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87108954-5c19-4396-8144-faea1b9bb292 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:38.425923 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 975/1984] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:06:38.427191 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e44474-ccda-4d17-808f-94cf5231c8d5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:38.445014 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e44474-ccda-4d17-808f-94cf5231c8d5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:38.461492 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38723a-00ed-4fd6-bfad-2c60c9963526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:38.461876 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38723a-00ed-4fd6-bfad-2c60c9963526 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:38.462071 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38723a-00ed-4fd6-bfad-2c60c9963526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:38.462345 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38723a-00ed-4fd6-bfad-2c60c9963526 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:38.463636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38723a-00ed-4fd6-bfad-2c60c9963526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:38.465088 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38723a-00ed-4fd6-bfad-2c60c9963526 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:38.490143 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1010/1985] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:06:38.491737 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87108954-5c19-4396-8144-faea1b9bb292 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:38.508369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87108954-5c19-4396-8144-faea1b9bb292 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:38.521452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d086d-f77a-4519-957d-f25dc9390cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:38.522547 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d086d-f77a-4519-957d-f25dc9390cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:38.523131 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d086d-f77a-4519-957d-f25dc9390cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:38.523293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d086d-f77a-4519-957d-f25dc9390cb3 admin admin] PATH_INFO: `/v3/projects/d8d66eb2395b43bba630b2ddfda90862/users/94ece3256c4d400eb6fa7938c1a24c6f/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:38.556557 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d086d-f77a-4519-957d-f25dc9390cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8d66eb2395b43bba630b2ddfda90862, user_id=94ece3256c4d400eb6fa7938c1a24c6f, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:38.562655 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d086d-f77a-4519-957d-f25dc9390cb3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:38.601376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 976/1986] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:06:38 2022] PUT /identity/v3/projects/d8d66eb2395b43bba630b2ddfda90862/users/94ece3256c4d400eb6fa7938c1a24c6f/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:38.612436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fadde-39a4-4239-a3b4-24c776568559 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:38.612761 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fadde-39a4-4239-a3b4-24c776568559 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:38.613132 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fadde-39a4-4239-a3b4-24c776568559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:38.691346 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-075fadde-39a4-4239-a3b4-24c776568559 None None] MFA Rules not processed for user `94ece3256c4d400eb6fa7938c1a24c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:38.698667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-075fadde-39a4-4239-a3b4-24c776568559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:38.805679 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:38.820302 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1011/1987] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:38.861529 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d086d-f77a-4519-957d-f25dc9390cb3 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:38.863385 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9e8d086d-f77a-4519-957d-f25dc9390cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:39.099372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d086d-f77a-4519-957d-f25dc9390cb3 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:39.105269 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a5c9e-83e6-4856-adb3-7ca790cce4e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:39.106242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a5c9e-83e6-4856-adb3-7ca790cce4e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:39.106538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a5c9e-83e6-4856-adb3-7ca790cce4e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:39.106803 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a5c9e-83e6-4856-adb3-7ca790cce4e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:39.119056 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a5c9e-83e6-4856-adb3-7ca790cce4e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:39.123246 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a5c9e-83e6-4856-adb3-7ca790cce4e9 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:39.139286 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 977/1988] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:06:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:06:39.284707 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075fadde-39a4-4239-a3b4-24c776568559 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:39.382578 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075fadde-39a4-4239-a3b4-24c776568559 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:39.400454 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d1b76-ca4e-464b-b461-7088ad66eb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:39.401659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d1b76-ca4e-464b-b461-7088ad66eb9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:39.402171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d1b76-ca4e-464b-b461-7088ad66eb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:39.402693 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d1b76-ca4e-464b-b461-7088ad66eb9b admin admin] PATH_INFO: `/v3/users/94ece3256c4d400eb6fa7938c1a24c6f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:39.406413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d1b76-ca4e-464b-b461-7088ad66eb9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=94ece3256c4d400eb6fa7938c1a24c6f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:39.410109 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d1b76-ca4e-464b-b461-7088ad66eb9b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:39.533363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-787d1b76-ca4e-464b-b461-7088ad66eb9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94ece3256c4d400eb6fa7938c1a24c6f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:39.552162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-787d1b76-ca4e-464b-b461-7088ad66eb9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94ece3256c4d400eb6fa7938c1a24c6f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:39.571041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-787d1b76-ca4e-464b-b461-7088ad66eb9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94ece3256c4d400eb6fa7938c1a24c6f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:39.572469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-787d1b76-ca4e-464b-b461-7088ad66eb9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94ece3256c4d400eb6fa7938c1a24c6f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:39.574832 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-787d1b76-ca4e-464b-b461-7088ad66eb9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94ece3256c4d400eb6fa7938c1a24c6f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:39.629964 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1012/1989] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:06:39 2022] DELETE /identity/v3/users/94ece3256c4d400eb6fa7938c1a24c6f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:39.642849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828df00-6544-4032-99c4-21341e757142 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:39.645259 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828df00-6544-4032-99c4-21341e757142 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:39.648146 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828df00-6544-4032-99c4-21341e757142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:39.681392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5828df00-6544-4032-99c4-21341e757142 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:39.682988 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5828df00-6544-4032-99c4-21341e757142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:39.768889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:39.807833 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 978/1990] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:39.819674 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d1b76-ca4e-464b-b461-7088ad66eb9b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:39.821379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-787d1b76-ca4e-464b-b461-7088ad66eb9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:39.941549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d1b76-ca4e-464b-b461-7088ad66eb9b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:39.954325 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47253799-d755-41a1-a309-72e08a84013e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:39.955691 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47253799-d755-41a1-a309-72e08a84013e service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:39.956117 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47253799-d755-41a1-a309-72e08a84013e service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:39.956548 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47253799-d755-41a1-a309-72e08a84013e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:39.970063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47253799-d755-41a1-a309-72e08a84013e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:39.971814 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47253799-d755-41a1-a309-72e08a84013e service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:39.996771 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1013/1991] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:06:40.896819 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828df00-6544-4032-99c4-21341e757142 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:40.898358 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5828df00-6544-4032-99c4-21341e757142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:40.944308 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828df00-6544-4032-99c4-21341e757142 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:40.954504 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61059ce-7509-4781-a038-73558005e62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:40.956341 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61059ce-7509-4781-a038-73558005e62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:40.957418 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61059ce-7509-4781-a038-73558005e62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:40.958185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61059ce-7509-4781-a038-73558005e62f admin admin] PATH_INFO: `/v3/projects/d8d66eb2395b43bba630b2ddfda90862` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:40.960418 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61059ce-7509-4781-a038-73558005e62f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8d66eb2395b43bba630b2ddfda90862)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:40.962619 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61059ce-7509-4781-a038-73558005e62f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:41.059399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e61059ce-7509-4781-a038-73558005e62f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8d66eb2395b43bba630b2ddfda90862', 'request_id': 'req-e61059ce-7509-4781-a038-73558005e62f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:41.070921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e61059ce-7509-4781-a038-73558005e62f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8d66eb2395b43bba630b2ddfda90862', 'request_id': 'req-e61059ce-7509-4781-a038-73558005e62f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:41.078921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e61059ce-7509-4781-a038-73558005e62f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8d66eb2395b43bba630b2ddfda90862', 'request_id': 'req-e61059ce-7509-4781-a038-73558005e62f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:41.109691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e61059ce-7509-4781-a038-73558005e62f admin admin] The token cache is being invalidate because project d8d66eb2395b43bba630b2ddfda90862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:06:41.110429 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e61059ce-7509-4781-a038-73558005e62f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:41.111380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e61059ce-7509-4781-a038-73558005e62f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:41.114104 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 979/1992] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:06:40 2022] DELETE /identity/v3/projects/d8d66eb2395b43bba630b2ddfda90862 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:41.119681 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98396060-5aeb-4035-974c-b3650b7759dc None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:41.120207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98396060-5aeb-4035-974c-b3650b7759dc None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:41.120425 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98396060-5aeb-4035-974c-b3650b7759dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:41.141462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-98396060-5aeb-4035-974c-b3650b7759dc None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:41.144809 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-98396060-5aeb-4035-974c-b3650b7759dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:41.179056 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:41.301868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1014/1993] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:41.309537 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de73d0-b674-4776-82d3-776d088e8963 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:41.309826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de73d0-b674-4776-82d3-776d088e8963 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:41.310285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de73d0-b674-4776-82d3-776d088e8963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:41.342798 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-79de73d0-b674-4776-82d3-776d088e8963 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:41.345417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-79de73d0-b674-4776-82d3-776d088e8963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:41.370344 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 980/1994] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:41.372449 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98396060-5aeb-4035-974c-b3650b7759dc None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:41.386760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98396060-5aeb-4035-974c-b3650b7759dc None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:41.409584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cee20-4f01-4132-94bd-ea4baf64ba35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:41.410988 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cee20-4f01-4132-94bd-ea4baf64ba35 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:41.411695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cee20-4f01-4132-94bd-ea4baf64ba35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:41.411972 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cee20-4f01-4132-94bd-ea4baf64ba35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:41.413129 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cee20-4f01-4132-94bd-ea4baf64ba35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:06:41.413540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cee20-4f01-4132-94bd-ea4baf64ba35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:41.415411 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cee20-4f01-4132-94bd-ea4baf64ba35 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:41.439292 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1015/1995] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:06:41.439716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de73d0-b674-4776-82d3-776d088e8963 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:41.453585 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de73d0-b674-4776-82d3-776d088e8963 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:41.467021 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee7d34-ede7-4ca9-883c-afd313eb79a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:41.472444 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee7d34-ede7-4ca9-883c-afd313eb79a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:41.474940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee7d34-ede7-4ca9-883c-afd313eb79a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:41.475457 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee7d34-ede7-4ca9-883c-afd313eb79a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:41.495885 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee7d34-ede7-4ca9-883c-afd313eb79a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:41.500984 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee7d34-ede7-4ca9-883c-afd313eb79a6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:41.580690 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cee20-4f01-4132-94bd-ea4baf64ba35 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:41.599868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 981/1996] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:06:41 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:06:41.607599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cee20-4f01-4132-94bd-ea4baf64ba35 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:41.754948 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1661d-bae5-44e9-a571-44dc72b68fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:41.756553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1661d-bae5-44e9-a571-44dc72b68fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:41.757533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1661d-bae5-44e9-a571-44dc72b68fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:41.758020 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1661d-bae5-44e9-a571-44dc72b68fe3 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:41.759152 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1661d-bae5-44e9-a571-44dc72b68fe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:41.762707 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1661d-bae5-44e9-a571-44dc72b68fe3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:41.797937 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1016/1997] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:06:41 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:06:41.802648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee7d34-ede7-4ca9-883c-afd313eb79a6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:41.826053 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee7d34-ede7-4ca9-883c-afd313eb79a6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:41.831014 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda554a4-456c-47c3-8041-2c6649ae38bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:41.831711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda554a4-456c-47c3-8041-2c6649ae38bb admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:41.832148 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda554a4-456c-47c3-8041-2c6649ae38bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:41.832432 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda554a4-456c-47c3-8041-2c6649ae38bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:41.833224 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda554a4-456c-47c3-8041-2c6649ae38bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:41.834905 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda554a4-456c-47c3-8041-2c6649ae38bb admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:41.867085 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 982/1998] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:06:41.867907 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1661d-bae5-44e9-a571-44dc72b68fe3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:41.885667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1661d-bae5-44e9-a571-44dc72b68fe3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:41.893926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512b58b-cd42-409f-a933-6a240b485616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:41.895263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512b58b-cd42-409f-a933-6a240b485616 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:41.896038 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512b58b-cd42-409f-a933-6a240b485616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:41.897554 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512b58b-cd42-409f-a933-6a240b485616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:41.898784 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512b58b-cd42-409f-a933-6a240b485616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:41.902266 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512b58b-cd42-409f-a933-6a240b485616 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:41.941385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1017/1999] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:06:41.943022 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda554a4-456c-47c3-8041-2c6649ae38bb admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:41.955765 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda554a4-456c-47c3-8041-2c6649ae38bb admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:41.965298 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c300942-056b-4025-81cf-50f66b9f08e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:41.966439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c300942-056b-4025-81cf-50f66b9f08e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:41.967028 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c300942-056b-4025-81cf-50f66b9f08e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:41.967513 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c300942-056b-4025-81cf-50f66b9f08e9 admin admin] PATH_INFO: `/v3/projects/0d5b48ca7a3146ee9e1f53551e0fe89a/users/de863c4f29e64e32b1488b988d9457d7/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:42.000354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c300942-056b-4025-81cf-50f66b9f08e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d5b48ca7a3146ee9e1f53551e0fe89a, user_id=de863c4f29e64e32b1488b988d9457d7, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:42.009018 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c300942-056b-4025-81cf-50f66b9f08e9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:42.029175 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 983/2000] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:06:41 2022] PUT /identity/v3/projects/0d5b48ca7a3146ee9e1f53551e0fe89a/users/de863c4f29e64e32b1488b988d9457d7/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:42.036692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73097795-ca72-4d0d-8262-7aafc6d3976a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:42.037672 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73097795-ca72-4d0d-8262-7aafc6d3976a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:42.038228 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73097795-ca72-4d0d-8262-7aafc6d3976a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:42.065542 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-73097795-ca72-4d0d-8262-7aafc6d3976a None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:42.068137 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-73097795-ca72-4d0d-8262-7aafc6d3976a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:42.222626 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1018/2001] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:42.255744 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c300942-056b-4025-81cf-50f66b9f08e9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:42.259174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4c300942-056b-4025-81cf-50f66b9f08e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:42.382104 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c300942-056b-4025-81cf-50f66b9f08e9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:42.386298 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5419d-f98b-49ad-bb96-632ed669684c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:42.387164 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5419d-f98b-49ad-bb96-632ed669684c service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:42.387451 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5419d-f98b-49ad-bb96-632ed669684c service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:42.387725 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5419d-f98b-49ad-bb96-632ed669684c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:42.399421 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5419d-f98b-49ad-bb96-632ed669684c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:42.400651 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5419d-f98b-49ad-bb96-632ed669684c service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:42.416019 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 984/2002] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:06:44.971016 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed85a0c-468b-4547-b48e-ae01c05ef754 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:44.971639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed85a0c-468b-4547-b48e-ae01c05ef754 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:44.971728 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed85a0c-468b-4547-b48e-ae01c05ef754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:45.030977 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5ed85a0c-468b-4547-b48e-ae01c05ef754 None None] MFA Rules not processed for user `de863c4f29e64e32b1488b988d9457d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:45.032863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5ed85a0c-468b-4547-b48e-ae01c05ef754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:45.083069 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:45.218669 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1019/2003] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:45.223073 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5419d-f98b-49ad-bb96-632ed669684c service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:45.251248 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5419d-f98b-49ad-bb96-632ed669684c service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:45.259009 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e0c50-b6be-4eda-89cf-3beea4360875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:45.261027 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e0c50-b6be-4eda-89cf-3beea4360875 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:45.262425 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e0c50-b6be-4eda-89cf-3beea4360875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:45.262926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e0c50-b6be-4eda-89cf-3beea4360875 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:45.263869 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e0c50-b6be-4eda-89cf-3beea4360875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:45.267931 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e0c50-b6be-4eda-89cf-3beea4360875 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:45.274568 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:45.348599 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 985/2004] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:06:45 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:06:45.353101 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed85a0c-468b-4547-b48e-ae01c05ef754 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:45.390609 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed85a0c-468b-4547-b48e-ae01c05ef754 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:45.508883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27c51a-5d15-43ea-95c7-e91c8013d3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:45.509586 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27c51a-5d15-43ea-95c7-e91c8013d3fa admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:45.509866 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27c51a-5d15-43ea-95c7-e91c8013d3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:45.510140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27c51a-5d15-43ea-95c7-e91c8013d3fa admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:45.511944 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27c51a-5d15-43ea-95c7-e91c8013d3fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:45.517266 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27c51a-5d15-43ea-95c7-e91c8013d3fa admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:45.585464 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1020/2005] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:06:45 2022] POST /identity/v3/users => generated 295 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:06:45.589590 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e0c50-b6be-4eda-89cf-3beea4360875 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:45.613706 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e0c50-b6be-4eda-89cf-3beea4360875 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:45.623485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01388b8-192a-4148-aa72-340e0b8663b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:45.624313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01388b8-192a-4148-aa72-340e0b8663b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:45.624782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01388b8-192a-4148-aa72-340e0b8663b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:45.625074 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01388b8-192a-4148-aa72-340e0b8663b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:45.626169 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01388b8-192a-4148-aa72-340e0b8663b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:45.628043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01388b8-192a-4148-aa72-340e0b8663b9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:45.646544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 986/2006] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:06:45.650864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27c51a-5d15-43ea-95c7-e91c8013d3fa admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:45.664939 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27c51a-5d15-43ea-95c7-e91c8013d3fa admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:45.672155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f661ab9-9d20-45bc-87d4-f2aa7640d06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:45.673099 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f661ab9-9d20-45bc-87d4-f2aa7640d06c admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:45.673685 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f661ab9-9d20-45bc-87d4-f2aa7640d06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:45.674083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f661ab9-9d20-45bc-87d4-f2aa7640d06c admin admin] PATH_INFO: `/v3/projects/8b3fa50ba7c74b29be36b2b495f67c0f/users/56825a3adce04968b02135a59db68385/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:45.702068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f661ab9-9d20-45bc-87d4-f2aa7640d06c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b3fa50ba7c74b29be36b2b495f67c0f, user_id=56825a3adce04968b02135a59db68385, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:45.705989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f661ab9-9d20-45bc-87d4-f2aa7640d06c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:45.727358 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1021/2007] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:06:45 2022] PUT /identity/v3/projects/8b3fa50ba7c74b29be36b2b495f67c0f/users/56825a3adce04968b02135a59db68385/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:45.731185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01388b8-192a-4148-aa72-340e0b8663b9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:45.758002 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01388b8-192a-4148-aa72-340e0b8663b9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:45.868929 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73dcbc-f68d-4427-a723-8f33c4d76b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:45.870146 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73dcbc-f68d-4427-a723-8f33c4d76b02 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:45.870631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73dcbc-f68d-4427-a723-8f33c4d76b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:45.871144 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73dcbc-f68d-4427-a723-8f33c4d76b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:45.872165 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e73dcbc-f68d-4427-a723-8f33c4d76b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:45.874325 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e73dcbc-f68d-4427-a723-8f33c4d76b02 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:45.889158 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 987/2008] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:06:45.893551 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f661ab9-9d20-45bc-87d4-f2aa7640d06c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:45.907727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f661ab9-9d20-45bc-87d4-f2aa7640d06c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:45.923876 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf80337-906a-432b-ad32-0b9983972e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:45.925653 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf80337-906a-432b-ad32-0b9983972e37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:45.926330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf80337-906a-432b-ad32-0b9983972e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:45.926857 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf80337-906a-432b-ad32-0b9983972e37 admin admin] PATH_INFO: `/v3/projects/8b3fa50ba7c74b29be36b2b495f67c0f/users/56825a3adce04968b02135a59db68385/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:45.930245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf80337-906a-432b-ad32-0b9983972e37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b3fa50ba7c74b29be36b2b495f67c0f, user_id=56825a3adce04968b02135a59db68385, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:45.933970 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf80337-906a-432b-ad32-0b9983972e37 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:45.961756 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1022/2009] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:06:45 2022] PUT /identity/v3/projects/8b3fa50ba7c74b29be36b2b495f67c0f/users/56825a3adce04968b02135a59db68385/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:47.839801 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6044b48-d67a-4b35-bd66-f841f7aaefc8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:47.840813 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6044b48-d67a-4b35-bd66-f841f7aaefc8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:47.841299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6044b48-d67a-4b35-bd66-f841f7aaefc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:47.902480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b6044b48-d67a-4b35-bd66-f841f7aaefc8 None None] MFA Rules not processed for user `56825a3adce04968b02135a59db68385`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:47.907083 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b6044b48-d67a-4b35-bd66-f841f7aaefc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:48.008253 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 988/2010] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:48.020170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8fd61-c241-4a5f-a93c-553c10196d05 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:48.021917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8fd61-c241-4a5f-a93c-553c10196d05 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:48.022931 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8fd61-c241-4a5f-a93c-553c10196d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:48.062532 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-43e8fd61-c241-4a5f-a93c-553c10196d05 None None] MFA Rules not processed for user `de863c4f29e64e32b1488b988d9457d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:48.063453 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-43e8fd61-c241-4a5f-a93c-553c10196d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:48.140165 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1023/2011] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:48.153144 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6044b48-d67a-4b35-bd66-f841f7aaefc8 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:48.155307 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b6044b48-d67a-4b35-bd66-f841f7aaefc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:48.294473 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:48.327347 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6044b48-d67a-4b35-bd66-f841f7aaefc8 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:48.334551 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d0ffd-42b4-4872-af81-b1983cb7d8e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:48.335426 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d0ffd-42b4-4872-af81-b1983cb7d8e2 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:48.335838 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d0ffd-42b4-4872-af81-b1983cb7d8e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:48.336212 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d0ffd-42b4-4872-af81-b1983cb7d8e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:48.350578 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d0ffd-42b4-4872-af81-b1983cb7d8e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:48.352988 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d0ffd-42b4-4872-af81-b1983cb7d8e2 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:48.379375 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 989/2012] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:06:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:06:48.578403 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8fd61-c241-4a5f-a93c-553c10196d05 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:48.583692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-43e8fd61-c241-4a5f-a93c-553c10196d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:48.613802 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:48.704634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8fd61-c241-4a5f-a93c-553c10196d05 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:48.714598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dc029-5e37-4400-a442-b71b89a219e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:48.715829 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dc029-5e37-4400-a442-b71b89a219e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:48.716257 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dc029-5e37-4400-a442-b71b89a219e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:48.717021 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dc029-5e37-4400-a442-b71b89a219e8 admin admin] PATH_INFO: `/v3/users/15c4b056bc524504b536c446ce30211f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:48.719037 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45dc029-5e37-4400-a442-b71b89a219e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15c4b056bc524504b536c446ce30211f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:48.721225 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45dc029-5e37-4400-a442-b71b89a219e8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:48.824638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f45dc029-5e37-4400-a442-b71b89a219e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15c4b056bc524504b536c446ce30211f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:48.837910 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f45dc029-5e37-4400-a442-b71b89a219e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15c4b056bc524504b536c446ce30211f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:48.847288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f45dc029-5e37-4400-a442-b71b89a219e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15c4b056bc524504b536c446ce30211f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:48.849136 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f45dc029-5e37-4400-a442-b71b89a219e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15c4b056bc524504b536c446ce30211f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:48.850214 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f45dc029-5e37-4400-a442-b71b89a219e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15c4b056bc524504b536c446ce30211f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:48.882380 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1024/2013] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:06:48 2022] DELETE /identity/v3/users/15c4b056bc524504b536c446ce30211f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:48.887340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d86cbf-eff7-4399-9197-ae2dd864b968 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:48.887833 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d86cbf-eff7-4399-9197-ae2dd864b968 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:48.887833 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d86cbf-eff7-4399-9197-ae2dd864b968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:48.915145 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e6d86cbf-eff7-4399-9197-ae2dd864b968 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:48.916806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e6d86cbf-eff7-4399-9197-ae2dd864b968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:49.004372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 990/2014] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:49.058129 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dc029-5e37-4400-a442-b71b89a219e8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:49.060288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f45dc029-5e37-4400-a442-b71b89a219e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:49.154153 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dc029-5e37-4400-a442-b71b89a219e8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:49.160309 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906515e9-f4d7-435e-95a6-542eea7fb12d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:49.162099 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906515e9-f4d7-435e-95a6-542eea7fb12d service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:49.162755 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906515e9-f4d7-435e-95a6-542eea7fb12d service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:49.163199 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906515e9-f4d7-435e-95a6-542eea7fb12d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:49.180589 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906515e9-f4d7-435e-95a6-542eea7fb12d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:49.182291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906515e9-f4d7-435e-95a6-542eea7fb12d service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:49.194892 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1025/2015] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:06:50.177827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d86cbf-eff7-4399-9197-ae2dd864b968 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:50.179969 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e6d86cbf-eff7-4399-9197-ae2dd864b968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:50.208173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d86cbf-eff7-4399-9197-ae2dd864b968 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:50.240452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff385be2-1d6e-4498-a849-10d0fbfdbceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:50.255100 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff385be2-1d6e-4498-a849-10d0fbfdbceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:50.258792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff385be2-1d6e-4498-a849-10d0fbfdbceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:50.259144 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff385be2-1d6e-4498-a849-10d0fbfdbceb admin admin] PATH_INFO: `/v3/projects/082465f4eaa94cff8ac3c5cfc6dd0b24` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:50.263432 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff385be2-1d6e-4498-a849-10d0fbfdbceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=082465f4eaa94cff8ac3c5cfc6dd0b24)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:50.265824 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff385be2-1d6e-4498-a849-10d0fbfdbceb admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:50.401431 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ff385be2-1d6e-4498-a849-10d0fbfdbceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '082465f4eaa94cff8ac3c5cfc6dd0b24', 'request_id': 'req-ff385be2-1d6e-4498-a849-10d0fbfdbceb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:50.418990 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ff385be2-1d6e-4498-a849-10d0fbfdbceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '082465f4eaa94cff8ac3c5cfc6dd0b24', 'request_id': 'req-ff385be2-1d6e-4498-a849-10d0fbfdbceb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:50.435243 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ff385be2-1d6e-4498-a849-10d0fbfdbceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '082465f4eaa94cff8ac3c5cfc6dd0b24', 'request_id': 'req-ff385be2-1d6e-4498-a849-10d0fbfdbceb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:50.456154 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ff385be2-1d6e-4498-a849-10d0fbfdbceb admin admin] The token cache is being invalidate because project 082465f4eaa94cff8ac3c5cfc6dd0b24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:06:50.456454 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ff385be2-1d6e-4498-a849-10d0fbfdbceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:50.457424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ff385be2-1d6e-4498-a849-10d0fbfdbceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:50.459792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 991/2016] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:06:50 2022] DELETE /identity/v3/projects/082465f4eaa94cff8ac3c5cfc6dd0b24 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:50.463849 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906515e9-f4d7-435e-95a6-542eea7fb12d service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:50.474695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906515e9-f4d7-435e-95a6-542eea7fb12d service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:50.510929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:50.569129 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4d9bd-edd2-40b6-a471-2044bbf590cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:50.570446 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4d9bd-edd2-40b6-a471-2044bbf590cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:50.570774 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4d9bd-edd2-40b6-a471-2044bbf590cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:50.571050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4d9bd-edd2-40b6-a471-2044bbf590cd admin admin] PATH_INFO: `/v3/users/70e1c146cfc74ed38aa5c5b065641c0a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:50.573606 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4d9bd-edd2-40b6-a471-2044bbf590cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=70e1c146cfc74ed38aa5c5b065641c0a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:50.575562 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4d9bd-edd2-40b6-a471-2044bbf590cd admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:50.679810 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1dc4d9bd-edd2-40b6-a471-2044bbf590cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70e1c146cfc74ed38aa5c5b065641c0a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:50.695394 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1dc4d9bd-edd2-40b6-a471-2044bbf590cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70e1c146cfc74ed38aa5c5b065641c0a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:50.713400 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1dc4d9bd-edd2-40b6-a471-2044bbf590cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70e1c146cfc74ed38aa5c5b065641c0a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:50.714745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1dc4d9bd-edd2-40b6-a471-2044bbf590cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70e1c146cfc74ed38aa5c5b065641c0a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:50.715688 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1dc4d9bd-edd2-40b6-a471-2044bbf590cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70e1c146cfc74ed38aa5c5b065641c0a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:50.744308 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1026/2017] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:06:50 2022] DELETE /identity/v3/users/70e1c146cfc74ed38aa5c5b065641c0a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:51.134477 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff385be2-1d6e-4498-a849-10d0fbfdbceb admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:51.136584 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ff385be2-1d6e-4498-a849-10d0fbfdbceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:51.160350 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff385be2-1d6e-4498-a849-10d0fbfdbceb admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:51.254027 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492763e0-1807-411d-b461-1d57564ab1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:51.255054 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492763e0-1807-411d-b461-1d57564ab1fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:51.255398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492763e0-1807-411d-b461-1d57564ab1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:51.255997 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492763e0-1807-411d-b461-1d57564ab1fb admin admin] PATH_INFO: `/v3/projects/e5e043e57f4a41048921c2669469d3ca` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:51.258018 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492763e0-1807-411d-b461-1d57564ab1fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5e043e57f4a41048921c2669469d3ca)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:51.260167 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492763e0-1807-411d-b461-1d57564ab1fb admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:51.271764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:51.395045 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-492763e0-1807-411d-b461-1d57564ab1fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5e043e57f4a41048921c2669469d3ca', 'request_id': 'req-492763e0-1807-411d-b461-1d57564ab1fb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:51.410205 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-492763e0-1807-411d-b461-1d57564ab1fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5e043e57f4a41048921c2669469d3ca', 'request_id': 'req-492763e0-1807-411d-b461-1d57564ab1fb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:51.420852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-492763e0-1807-411d-b461-1d57564ab1fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5e043e57f4a41048921c2669469d3ca', 'request_id': 'req-492763e0-1807-411d-b461-1d57564ab1fb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:51.482565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-492763e0-1807-411d-b461-1d57564ab1fb admin admin] The token cache is being invalidate because project e5e043e57f4a41048921c2669469d3ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:06:51.482971 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-492763e0-1807-411d-b461-1d57564ab1fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:51.485574 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-492763e0-1807-411d-b461-1d57564ab1fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:06:51.487801 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 992/2018] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:06:51 2022] DELETE /identity/v3/projects/e5e043e57f4a41048921c2669469d3ca => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:51.492530 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e7d1f-2c00-47c9-974d-02a1b9ef413d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:51.493043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e7d1f-2c00-47c9-974d-02a1b9ef413d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:51.493419 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e7d1f-2c00-47c9-974d-02a1b9ef413d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:51.517861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dd0e7d1f-2c00-47c9-974d-02a1b9ef413d None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:51.521490 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dd0e7d1f-2c00-47c9-974d-02a1b9ef413d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:51.607944 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1027/2019] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:51.615746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b80ac6-aa86-4fce-bc81-7e5eb65379ad None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:51.616446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b80ac6-aa86-4fce-bc81-7e5eb65379ad None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:51.616690 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b80ac6-aa86-4fce-bc81-7e5eb65379ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:51.646068 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-12b80ac6-aa86-4fce-bc81-7e5eb65379ad None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:51.647515 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-12b80ac6-aa86-4fce-bc81-7e5eb65379ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:51.669046 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 993/2020] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:51.673190 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e7d1f-2c00-47c9-974d-02a1b9ef413d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:51.684296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e7d1f-2c00-47c9-974d-02a1b9ef413d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:51.695327 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa3dbe-13af-412e-bfc4-cb9c74c9895a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:51.696173 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa3dbe-13af-412e-bfc4-cb9c74c9895a admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:51.696545 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa3dbe-13af-412e-bfc4-cb9c74c9895a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:51.697067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa3dbe-13af-412e-bfc4-cb9c74c9895a admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:51.698018 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa3dbe-13af-412e-bfc4-cb9c74c9895a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:06:51.698834 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa3dbe-13af-412e-bfc4-cb9c74c9895a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:51.701068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa3dbe-13af-412e-bfc4-cb9c74c9895a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:51.718449 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1028/2021] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:06:51.722641 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b80ac6-aa86-4fce-bc81-7e5eb65379ad None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:51.769244 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b80ac6-aa86-4fce-bc81-7e5eb65379ad None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:51.774388 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d18692-43b5-41dc-847b-e50d7ca823c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:51.775097 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d18692-43b5-41dc-847b-e50d7ca823c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:51.775384 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d18692-43b5-41dc-847b-e50d7ca823c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:51.775663 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d18692-43b5-41dc-847b-e50d7ca823c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:51.776384 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d18692-43b5-41dc-847b-e50d7ca823c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:51.778476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d18692-43b5-41dc-847b-e50d7ca823c5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:51.844888 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 994/2022] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:06:51 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:06:51.849098 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa3dbe-13af-412e-bfc4-cb9c74c9895a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:51.864969 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa3dbe-13af-412e-bfc4-cb9c74c9895a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:51.974266 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:52.005784 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721265b-378c-49fe-b2a9-0fbca7b59ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:52.006802 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721265b-378c-49fe-b2a9-0fbca7b59ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:52.007233 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721265b-378c-49fe-b2a9-0fbca7b59ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:52.007650 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721265b-378c-49fe-b2a9-0fbca7b59ea1 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:52.008516 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721265b-378c-49fe-b2a9-0fbca7b59ea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:52.013867 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721265b-378c-49fe-b2a9-0fbca7b59ea1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:52.072910 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1029/2023] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:06:51 2022] POST /identity/v3/users => generated 285 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:06:52.076291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d18692-43b5-41dc-847b-e50d7ca823c5 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:52.097249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d18692-43b5-41dc-847b-e50d7ca823c5 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:52.110480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f397d4f-e05d-42ee-8733-0194bdbd8e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:52.112995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f397d4f-e05d-42ee-8733-0194bdbd8e3e admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:52.114222 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f397d4f-e05d-42ee-8733-0194bdbd8e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:52.114821 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f397d4f-e05d-42ee-8733-0194bdbd8e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:52.116830 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f397d4f-e05d-42ee-8733-0194bdbd8e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:52.123412 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f397d4f-e05d-42ee-8733-0194bdbd8e3e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:52.154221 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 995/2024] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:06:52.157992 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721265b-378c-49fe-b2a9-0fbca7b59ea1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:52.176646 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721265b-378c-49fe-b2a9-0fbca7b59ea1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:52.189466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70163805-0657-46e5-88b7-9911f3afa7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:52.191934 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70163805-0657-46e5-88b7-9911f3afa7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:52.194124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70163805-0657-46e5-88b7-9911f3afa7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:52.194595 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70163805-0657-46e5-88b7-9911f3afa7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:52.196453 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70163805-0657-46e5-88b7-9911f3afa7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:52.198838 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70163805-0657-46e5-88b7-9911f3afa7b7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:52.216694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1030/2025] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:06:52.224500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f397d4f-e05d-42ee-8733-0194bdbd8e3e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:52.246907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f397d4f-e05d-42ee-8733-0194bdbd8e3e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:52.256284 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5d6bb-3a91-48ca-9f07-282fa6da007f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:52.258984 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5d6bb-3a91-48ca-9f07-282fa6da007f admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:52.259479 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5d6bb-3a91-48ca-9f07-282fa6da007f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:52.259999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5d6bb-3a91-48ca-9f07-282fa6da007f admin admin] PATH_INFO: `/v3/projects/764069a29a7f4a2381c4eac510298c1c/users/f1b307a9384144eb96892f0b63f6da6c/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:52.307207 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5d6bb-3a91-48ca-9f07-282fa6da007f admin admin] RBAC: Authorizing `identity:create_grant(project_id=764069a29a7f4a2381c4eac510298c1c, user_id=f1b307a9384144eb96892f0b63f6da6c, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:52.311882 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5d6bb-3a91-48ca-9f07-282fa6da007f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:52.346002 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 996/2026] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:06:52 2022] PUT /identity/v3/projects/764069a29a7f4a2381c4eac510298c1c/users/f1b307a9384144eb96892f0b63f6da6c/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:06:52.356300 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491d636-4be2-449d-bc22-e1efc9de77b4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:52.356670 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491d636-4be2-449d-bc22-e1efc9de77b4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:52.357077 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491d636-4be2-449d-bc22-e1efc9de77b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:52.400612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0491d636-4be2-449d-bc22-e1efc9de77b4 None None] MFA Rules not processed for user `f1b307a9384144eb96892f0b63f6da6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:52.401975 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0491d636-4be2-449d-bc22-e1efc9de77b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:52.514322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1031/2027] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:06:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:52.623482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5d6bb-3a91-48ca-9f07-282fa6da007f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:52.625604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bdc5d6bb-3a91-48ca-9f07-282fa6da007f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:52.746429 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5d6bb-3a91-48ca-9f07-282fa6da007f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:52.752429 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2be1a4-f93d-492e-af72-5f14a290604e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:52.753333 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2be1a4-f93d-492e-af72-5f14a290604e service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:52.753720 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2be1a4-f93d-492e-af72-5f14a290604e service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:52.754141 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2be1a4-f93d-492e-af72-5f14a290604e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:52.765880 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2be1a4-f93d-492e-af72-5f14a290604e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:52.767511 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2be1a4-f93d-492e-af72-5f14a290604e service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:52.779626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 997/2028] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:06:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:07:02.215142 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491d636-4be2-449d-bc22-e1efc9de77b4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:02.217005 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0491d636-4be2-449d-bc22-e1efc9de77b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:02.330329 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491d636-4be2-449d-bc22-e1efc9de77b4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:02.341010 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fe5ee-dc94-447d-ad3b-a0b5ff4b132d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:02.341988 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fe5ee-dc94-447d-ad3b-a0b5ff4b132d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:02.342273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fe5ee-dc94-447d-ad3b-a0b5ff4b132d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:02.343744 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fe5ee-dc94-447d-ad3b-a0b5ff4b132d admin admin] PATH_INFO: `/v3/users/6d0685c7d83e42ce8e5220d3e177ede6` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:02.347266 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fe5ee-dc94-447d-ad3b-a0b5ff4b132d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d0685c7d83e42ce8e5220d3e177ede6)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:02.349407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fe5ee-dc94-447d-ad3b-a0b5ff4b132d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:02.458929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-de0fe5ee-dc94-447d-ad3b-a0b5ff4b132d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d0685c7d83e42ce8e5220d3e177ede6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:02.464021 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:02.473744 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-de0fe5ee-dc94-447d-ad3b-a0b5ff4b132d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d0685c7d83e42ce8e5220d3e177ede6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:02.494289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-de0fe5ee-dc94-447d-ad3b-a0b5ff4b132d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d0685c7d83e42ce8e5220d3e177ede6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:02.496408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-de0fe5ee-dc94-447d-ad3b-a0b5ff4b132d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d0685c7d83e42ce8e5220d3e177ede6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:02.499883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-de0fe5ee-dc94-447d-ad3b-a0b5ff4b132d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d0685c7d83e42ce8e5220d3e177ede6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:02.544086 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1032/2029] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:07:02 2022] DELETE /identity/v3/users/6d0685c7d83e42ce8e5220d3e177ede6 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:02.546838 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e7ee-b0db-4187-8569-c7ba8edd2d33 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:02.547869 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e7ee-b0db-4187-8569-c7ba8edd2d33 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:02.547869 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e7ee-b0db-4187-8569-c7ba8edd2d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:02.622985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fdb4e7ee-b0db-4187-8569-c7ba8edd2d33 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:07:02.625149 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fdb4e7ee-b0db-4187-8569-c7ba8edd2d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:02.695966 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:02.776916 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 998/2030] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:07:02.794940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fe5ee-dc94-447d-ad3b-a0b5ff4b132d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:02.797270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-de0fe5ee-dc94-447d-ad3b-a0b5ff4b132d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:02.898252 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fe5ee-dc94-447d-ad3b-a0b5ff4b132d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:02.902337 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf447f-a68a-444c-b49c-611f2c4db835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:02.903038 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf447f-a68a-444c-b49c-611f2c4db835 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:02.903573 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf447f-a68a-444c-b49c-611f2c4db835 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:02.903857 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf447f-a68a-444c-b49c-611f2c4db835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:02.918010 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf447f-a68a-444c-b49c-611f2c4db835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:02.919617 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf447f-a68a-444c-b49c-611f2c4db835 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:02.932495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1033/2031] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:07:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:07:03.436427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4e7ee-b0db-4187-8569-c7ba8edd2d33 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:03.438144 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fdb4e7ee-b0db-4187-8569-c7ba8edd2d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:03.454867 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4e7ee-b0db-4187-8569-c7ba8edd2d33 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:03.460670 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48d75e-980f-4e32-bfdf-859749defe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:03.461694 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48d75e-980f-4e32-bfdf-859749defe99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:03.462050 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48d75e-980f-4e32-bfdf-859749defe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:03.462397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48d75e-980f-4e32-bfdf-859749defe99 admin admin] PATH_INFO: `/v3/projects/32e9240a382c4757b2d0f6d75f25c647` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:03.463709 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48d75e-980f-4e32-bfdf-859749defe99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32e9240a382c4757b2d0f6d75f25c647)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:03.465829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48d75e-980f-4e32-bfdf-859749defe99 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:03.520354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1d48d75e-980f-4e32-bfdf-859749defe99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32e9240a382c4757b2d0f6d75f25c647', 'request_id': 'req-1d48d75e-980f-4e32-bfdf-859749defe99'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:03.531385 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1d48d75e-980f-4e32-bfdf-859749defe99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32e9240a382c4757b2d0f6d75f25c647', 'request_id': 'req-1d48d75e-980f-4e32-bfdf-859749defe99'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:03.538899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1d48d75e-980f-4e32-bfdf-859749defe99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32e9240a382c4757b2d0f6d75f25c647', 'request_id': 'req-1d48d75e-980f-4e32-bfdf-859749defe99'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:03.552912 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1d48d75e-980f-4e32-bfdf-859749defe99 admin admin] The token cache is being invalidate because project 32e9240a382c4757b2d0f6d75f25c647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:07:03.553617 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1d48d75e-980f-4e32-bfdf-859749defe99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:03.554111 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1d48d75e-980f-4e32-bfdf-859749defe99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:03.555812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 999/2032] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:07:03 2022] DELETE /identity/v3/projects/32e9240a382c4757b2d0f6d75f25c647 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:07:03.560017 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf447f-a68a-444c-b49c-611f2c4db835 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:03.571728 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf447f-a68a-444c-b49c-611f2c4db835 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:03.660877 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fca78-e265-4659-9bf2-c1a801eb32c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:03.662394 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fca78-e265-4659-9bf2-c1a801eb32c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:03.662858 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fca78-e265-4659-9bf2-c1a801eb32c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:03.663281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fca78-e265-4659-9bf2-c1a801eb32c9 admin admin] PATH_INFO: `/v3/users/10b832aff2674870a833b319795ace4b` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:03.664911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6fca78-e265-4659-9bf2-c1a801eb32c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b832aff2674870a833b319795ace4b)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:03.668155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6fca78-e265-4659-9bf2-c1a801eb32c9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:03.756505 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cf6fca78-e265-4659-9bf2-c1a801eb32c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b832aff2674870a833b319795ace4b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:03.769664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cf6fca78-e265-4659-9bf2-c1a801eb32c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b832aff2674870a833b319795ace4b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:03.786342 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cf6fca78-e265-4659-9bf2-c1a801eb32c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b832aff2674870a833b319795ace4b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:03.789165 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cf6fca78-e265-4659-9bf2-c1a801eb32c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b832aff2674870a833b319795ace4b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:03.790213 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cf6fca78-e265-4659-9bf2-c1a801eb32c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b832aff2674870a833b319795ace4b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:03.810540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:03.837279 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1034/2033] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:07:03 2022] DELETE /identity/v3/users/10b832aff2674870a833b319795ace4b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:07:04.577399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48d75e-980f-4e32-bfdf-859749defe99 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:04.579178 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1d48d75e-980f-4e32-bfdf-859749defe99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:04.600297 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48d75e-980f-4e32-bfdf-859749defe99 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:04.743718 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c96fa6-682c-48ad-902e-122629c0f2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:04.744776 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c96fa6-682c-48ad-902e-122629c0f2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:04.745156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c96fa6-682c-48ad-902e-122629c0f2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:04.745897 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c96fa6-682c-48ad-902e-122629c0f2ac admin admin] PATH_INFO: `/v3/projects/181869cbac684e7f8414607a2845dd19` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:04.747514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c96fa6-682c-48ad-902e-122629c0f2ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=181869cbac684e7f8414607a2845dd19)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:04.750024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c96fa6-682c-48ad-902e-122629c0f2ac admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:04.864999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-18c96fa6-682c-48ad-902e-122629c0f2ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '181869cbac684e7f8414607a2845dd19', 'request_id': 'req-18c96fa6-682c-48ad-902e-122629c0f2ac'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:04.876603 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-18c96fa6-682c-48ad-902e-122629c0f2ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '181869cbac684e7f8414607a2845dd19', 'request_id': 'req-18c96fa6-682c-48ad-902e-122629c0f2ac'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:04.890593 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:04.895783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-18c96fa6-682c-48ad-902e-122629c0f2ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '181869cbac684e7f8414607a2845dd19', 'request_id': 'req-18c96fa6-682c-48ad-902e-122629c0f2ac'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:04.941988 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-18c96fa6-682c-48ad-902e-122629c0f2ac admin admin] The token cache is being invalidate because project 181869cbac684e7f8414607a2845dd19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:07:04.942978 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-18c96fa6-682c-48ad-902e-122629c0f2ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:04.945806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-18c96fa6-682c-48ad-902e-122629c0f2ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:04.948665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1000/2034] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:07:04 2022] DELETE /identity/v3/projects/181869cbac684e7f8414607a2845dd19 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:04.953909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfcdca-1bea-4e3a-8c8d-d477eab9f300 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:04.954428 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfcdca-1bea-4e3a-8c8d-d477eab9f300 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:04.954777 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfcdca-1bea-4e3a-8c8d-d477eab9f300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:04.996282 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-eccfcdca-1bea-4e3a-8c8d-d477eab9f300 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:07:05.003572 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-eccfcdca-1bea-4e3a-8c8d-d477eab9f300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:05.203839 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1035/2035] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:07:05.215498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39cd8d-9c55-45a9-9f39-c4763b6224c5 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:05.216131 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39cd8d-9c55-45a9-9f39-c4763b6224c5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:05.216633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39cd8d-9c55-45a9-9f39-c4763b6224c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:05.262555 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ed39cd8d-9c55-45a9-9f39-c4763b6224c5 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:07:05.264044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ed39cd8d-9c55-45a9-9f39-c4763b6224c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:05.277722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1001/2036] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:07:05.278736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfcdca-1bea-4e3a-8c8d-d477eab9f300 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:05.288927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfcdca-1bea-4e3a-8c8d-d477eab9f300 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:05.310490 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77645f8-0e5d-45ac-b676-a109f9c05701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:05.311117 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77645f8-0e5d-45ac-b676-a109f9c05701 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:05.311394 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77645f8-0e5d-45ac-b676-a109f9c05701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:05.311663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77645f8-0e5d-45ac-b676-a109f9c05701 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:05.313062 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77645f8-0e5d-45ac-b676-a109f9c05701 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:07:05.313062 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77645f8-0e5d-45ac-b676-a109f9c05701 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:05.314360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77645f8-0e5d-45ac-b676-a109f9c05701 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:05.339357 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1036/2037] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:07:05.343445 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39cd8d-9c55-45a9-9f39-c4763b6224c5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:05.380874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39cd8d-9c55-45a9-9f39-c4763b6224c5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:05.389246 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e90514-e4a0-468d-8c36-bd0eecdc10d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:05.390193 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e90514-e4a0-468d-8c36-bd0eecdc10d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:05.390467 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e90514-e4a0-468d-8c36-bd0eecdc10d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:05.390733 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e90514-e4a0-468d-8c36-bd0eecdc10d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:05.391468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e90514-e4a0-468d-8c36-bd0eecdc10d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:05.393702 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e90514-e4a0-468d-8c36-bd0eecdc10d5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:05.463592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1002/2038] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:07:05 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:07:05.468171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77645f8-0e5d-45ac-b676-a109f9c05701 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:05.485205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77645f8-0e5d-45ac-b676-a109f9c05701 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:05.642663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d580dc3-fa7d-4321-b428-70c523880959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:05.643383 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d580dc3-fa7d-4321-b428-70c523880959 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:05.643675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d580dc3-fa7d-4321-b428-70c523880959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:05.643916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d580dc3-fa7d-4321-b428-70c523880959 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:05.644817 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d580dc3-fa7d-4321-b428-70c523880959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:05.646938 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d580dc3-fa7d-4321-b428-70c523880959 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:05.702031 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1037/2039] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:07:05 2022] POST /identity/v3/users => generated 283 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:07:05.703603 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e90514-e4a0-468d-8c36-bd0eecdc10d5 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:05.718461 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e90514-e4a0-468d-8c36-bd0eecdc10d5 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:05.730557 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390eb941-0409-4311-84b5-dff993e8edf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:05.731252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390eb941-0409-4311-84b5-dff993e8edf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:05.732326 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390eb941-0409-4311-84b5-dff993e8edf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:05.732326 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390eb941-0409-4311-84b5-dff993e8edf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:05.732912 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390eb941-0409-4311-84b5-dff993e8edf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:05.738828 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390eb941-0409-4311-84b5-dff993e8edf8 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:05.756055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1003/2040] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:07:05.760306 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d580dc3-fa7d-4321-b428-70c523880959 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:05.778451 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d580dc3-fa7d-4321-b428-70c523880959 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:05.785679 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688d84c-3591-4503-b8a3-dc8b50df3d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:05.786805 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688d84c-3591-4503-b8a3-dc8b50df3d2b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:05.787253 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688d84c-3591-4503-b8a3-dc8b50df3d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:05.787667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688d84c-3591-4503-b8a3-dc8b50df3d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:05.788586 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688d84c-3591-4503-b8a3-dc8b50df3d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:05.791679 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688d84c-3591-4503-b8a3-dc8b50df3d2b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:05.808067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1038/2041] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:07:05.812262 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390eb941-0409-4311-84b5-dff993e8edf8 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:05.826824 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390eb941-0409-4311-84b5-dff993e8edf8 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:05.837656 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f5cee-5141-49f0-b362-89b4f307aff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:05.839439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f5cee-5141-49f0-b362-89b4f307aff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:05.840211 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f5cee-5141-49f0-b362-89b4f307aff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:05.841151 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f5cee-5141-49f0-b362-89b4f307aff1 admin admin] PATH_INFO: `/v3/projects/74ae04c17e6e44958a15398bd1805099/users/f4bc9c7dc1a142acab696dd8aabe7814/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:05.879412 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f5cee-5141-49f0-b362-89b4f307aff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ae04c17e6e44958a15398bd1805099, user_id=f4bc9c7dc1a142acab696dd8aabe7814, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:05.885730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f5cee-5141-49f0-b362-89b4f307aff1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:05.922596 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1004/2042] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:07:05 2022] PUT /identity/v3/projects/74ae04c17e6e44958a15398bd1805099/users/f4bc9c7dc1a142acab696dd8aabe7814/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:05.931941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01e042-c48d-4439-8339-dd03d8627032 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:05.932167 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01e042-c48d-4439-8339-dd03d8627032 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:05.932386 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01e042-c48d-4439-8339-dd03d8627032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:05.979703 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1f01e042-c48d-4439-8339-dd03d8627032 None None] MFA Rules not processed for user `f4bc9c7dc1a142acab696dd8aabe7814`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:07:05.981120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1f01e042-c48d-4439-8339-dd03d8627032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:06.078311 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:06.116429 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1039/2043] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:07:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:07:06.121006 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f5cee-5141-49f0-b362-89b4f307aff1 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:06.293309 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f5cee-5141-49f0-b362-89b4f307aff1 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:06.314684 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe444c4b-9764-4487-b5fc-5dc786961e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:06.314684 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe444c4b-9764-4487-b5fc-5dc786961e3d admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:06.314684 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe444c4b-9764-4487-b5fc-5dc786961e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:06.314684 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe444c4b-9764-4487-b5fc-5dc786961e3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:06.315191 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe444c4b-9764-4487-b5fc-5dc786961e3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:06.328152 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe444c4b-9764-4487-b5fc-5dc786961e3d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:06.470690 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1005/2044] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:07:06 2022] POST /identity/v3/projects => generated 363 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:07:06.477179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01e042-c48d-4439-8339-dd03d8627032 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:06.500219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01e042-c48d-4439-8339-dd03d8627032 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:06.661193 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee995b-64a1-4314-a1d7-1b6e0003e1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:06.661900 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee995b-64a1-4314-a1d7-1b6e0003e1d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:06.662182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee995b-64a1-4314-a1d7-1b6e0003e1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:06.662456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee995b-64a1-4314-a1d7-1b6e0003e1d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:06.663164 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee995b-64a1-4314-a1d7-1b6e0003e1d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:06.665273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee995b-64a1-4314-a1d7-1b6e0003e1d3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:06.699207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1040/2045] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:07:06 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:07:06.705402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe444c4b-9764-4487-b5fc-5dc786961e3d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:06.736456 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe444c4b-9764-4487-b5fc-5dc786961e3d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:06.755670 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab1c4d-2882-48a0-8b68-bda2ca3c24da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:06.757245 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab1c4d-2882-48a0-8b68-bda2ca3c24da admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:06.759359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab1c4d-2882-48a0-8b68-bda2ca3c24da admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:06.759943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab1c4d-2882-48a0-8b68-bda2ca3c24da admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:06.763118 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab1c4d-2882-48a0-8b68-bda2ca3c24da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:06.767057 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab1c4d-2882-48a0-8b68-bda2ca3c24da admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:06.781368 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1006/2046] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:07:06.787377 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee995b-64a1-4314-a1d7-1b6e0003e1d3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:06.803950 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee995b-64a1-4314-a1d7-1b6e0003e1d3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:06.818121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6323419-c3b8-4755-890d-78deb10ad2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:06.819061 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6323419-c3b8-4755-890d-78deb10ad2f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:06.819343 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6323419-c3b8-4755-890d-78deb10ad2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:06.819621 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6323419-c3b8-4755-890d-78deb10ad2f1 admin admin] PATH_INFO: `/v3/projects/8396b799fced456386647a040ed7ee9f/users/3470dab902824875840426f3f869af25/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:06.860667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6323419-c3b8-4755-890d-78deb10ad2f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8396b799fced456386647a040ed7ee9f, user_id=3470dab902824875840426f3f869af25, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:06.863748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6323419-c3b8-4755-890d-78deb10ad2f1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:06.904822 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1041/2047] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:07:06 2022] PUT /identity/v3/projects/8396b799fced456386647a040ed7ee9f/users/3470dab902824875840426f3f869af25/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:06.910422 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab1c4d-2882-48a0-8b68-bda2ca3c24da admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:06.929433 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab1c4d-2882-48a0-8b68-bda2ca3c24da admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:07.097517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334308ce-9ebb-49fe-a4d0-0b41d9689e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:07.100976 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334308ce-9ebb-49fe-a4d0-0b41d9689e04 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:07.101905 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334308ce-9ebb-49fe-a4d0-0b41d9689e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:07.102668 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334308ce-9ebb-49fe-a4d0-0b41d9689e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:07.104179 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334308ce-9ebb-49fe-a4d0-0b41d9689e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:07.106428 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334308ce-9ebb-49fe-a4d0-0b41d9689e04 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:07.109036 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:07.125507 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1007/2048] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:07:07.130043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6323419-c3b8-4755-890d-78deb10ad2f1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:07.147851 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6323419-c3b8-4755-890d-78deb10ad2f1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:07.161810 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85994e-6393-4885-8d7a-c071f765a185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:07.163467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85994e-6393-4885-8d7a-c071f765a185 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:07.163966 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85994e-6393-4885-8d7a-c071f765a185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:07.164694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85994e-6393-4885-8d7a-c071f765a185 admin admin] PATH_INFO: `/v3/projects/8396b799fced456386647a040ed7ee9f/users/3470dab902824875840426f3f869af25/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:07.167325 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85994e-6393-4885-8d7a-c071f765a185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8396b799fced456386647a040ed7ee9f, user_id=3470dab902824875840426f3f869af25, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:07.172623 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85994e-6393-4885-8d7a-c071f765a185 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:07.189473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1042/2049] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:07:07 2022] PUT /identity/v3/projects/8396b799fced456386647a040ed7ee9f/users/3470dab902824875840426f3f869af25/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:07.201367 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b8bc-d1a8-40ce-8afb-e12723bde36d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:07.202918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b8bc-d1a8-40ce-8afb-e12723bde36d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:07.203429 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b8bc-d1a8-40ce-8afb-e12723bde36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:07.239660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-acf9b8bc-d1a8-40ce-8afb-e12723bde36d None None] MFA Rules not processed for user `3470dab902824875840426f3f869af25`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:07:07.241261 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-acf9b8bc-d1a8-40ce-8afb-e12723bde36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:07.347639 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1008/2050] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:07:07 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:07:07.399389 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85994e-6393-4885-8d7a-c071f765a185 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:07.401926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4f85994e-6393-4885-8d7a-c071f765a185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:07.566480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85994e-6393-4885-8d7a-c071f765a185 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:07.582326 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0810c7d-1a8e-467a-ab7f-86ab223f8ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:07.583204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0810c7d-1a8e-467a-ab7f-86ab223f8ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:07.583848 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0810c7d-1a8e-467a-ab7f-86ab223f8ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:07.584497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0810c7d-1a8e-467a-ab7f-86ab223f8ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:07.603108 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0810c7d-1a8e-467a-ab7f-86ab223f8ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:07.604984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0810c7d-1a8e-467a-ab7f-86ab223f8ff8 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:07.633944 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1043/2051] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:07:07 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:07:14.679046 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9b8bc-d1a8-40ce-8afb-e12723bde36d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:14.707389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9b8bc-d1a8-40ce-8afb-e12723bde36d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:14.729081 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a994bd5-9605-4b0e-9957-fc4f652e4325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:14.730661 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a994bd5-9605-4b0e-9957-fc4f652e4325 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:14.731458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a994bd5-9605-4b0e-9957-fc4f652e4325 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:14.732274 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a994bd5-9605-4b0e-9957-fc4f652e4325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:14.902811 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a994bd5-9605-4b0e-9957-fc4f652e4325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:14.906128 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a994bd5-9605-4b0e-9957-fc4f652e4325 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:14.947116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1009/2052] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:07:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:07:17.619591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=76,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:18.437009 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0810c7d-1a8e-467a-ab7f-86ab223f8ff8 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:18.615948 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0810c7d-1a8e-467a-ab7f-86ab223f8ff8 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:18.626937 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347ee13-a9d0-464d-a78f-b920a020a0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:18.628591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347ee13-a9d0-464d-a78f-b920a020a0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:18.629121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347ee13-a9d0-464d-a78f-b920a020a0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:18.629685 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347ee13-a9d0-464d-a78f-b920a020a0d0 admin admin] PATH_INFO: `/v3/users/f4bc9c7dc1a142acab696dd8aabe7814` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:18.632091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347ee13-a9d0-464d-a78f-b920a020a0d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4bc9c7dc1a142acab696dd8aabe7814)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:18.634607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347ee13-a9d0-464d-a78f-b920a020a0d0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:18.771942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b347ee13-a9d0-464d-a78f-b920a020a0d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4bc9c7dc1a142acab696dd8aabe7814'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:18.800510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b347ee13-a9d0-464d-a78f-b920a020a0d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4bc9c7dc1a142acab696dd8aabe7814'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:18.832838 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b347ee13-a9d0-464d-a78f-b920a020a0d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4bc9c7dc1a142acab696dd8aabe7814'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:18.833827 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b347ee13-a9d0-464d-a78f-b920a020a0d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4bc9c7dc1a142acab696dd8aabe7814'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:18.834673 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b347ee13-a9d0-464d-a78f-b920a020a0d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4bc9c7dc1a142acab696dd8aabe7814'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:18.919817 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1044/2053] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:07:18 2022] DELETE /identity/v3/users/f4bc9c7dc1a142acab696dd8aabe7814 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:18.926512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702c02f-3636-48b5-a89e-3ff99434bb70 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:18.927532 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702c02f-3636-48b5-a89e-3ff99434bb70 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:18.927532 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702c02f-3636-48b5-a89e-3ff99434bb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:19.050465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2702c02f-3636-48b5-a89e-3ff99434bb70 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:07:19.056523 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2702c02f-3636-48b5-a89e-3ff99434bb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:19.365552 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1010/2054] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:07:19.389562 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347ee13-a9d0-464d-a78f-b920a020a0d0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:19.391049 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b347ee13-a9d0-464d-a78f-b920a020a0d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:19.504921 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347ee13-a9d0-464d-a78f-b920a020a0d0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:19.512229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bc298-027f-44b6-af94-826a76c0fc8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:19.513351 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bc298-027f-44b6-af94-826a76c0fc8a service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:19.513868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bc298-027f-44b6-af94-826a76c0fc8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:19.514211 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bc298-027f-44b6-af94-826a76c0fc8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:19.529775 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bc298-027f-44b6-af94-826a76c0fc8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:19.532952 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bc298-027f-44b6-af94-826a76c0fc8a service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:19.566146 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1045/2055] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:07:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:07:21.087417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702c02f-3636-48b5-a89e-3ff99434bb70 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:21.089506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2702c02f-3636-48b5-a89e-3ff99434bb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:21.157975 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702c02f-3636-48b5-a89e-3ff99434bb70 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:21.182833 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b5ea3-d23b-4de2-8d8a-92f51305e602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:21.183793 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b5ea3-d23b-4de2-8d8a-92f51305e602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:21.184043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b5ea3-d23b-4de2-8d8a-92f51305e602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:21.184530 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b5ea3-d23b-4de2-8d8a-92f51305e602 admin admin] PATH_INFO: `/v3/projects/74ae04c17e6e44958a15398bd1805099` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:21.185976 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b5ea3-d23b-4de2-8d8a-92f51305e602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74ae04c17e6e44958a15398bd1805099)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:21.188075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b5ea3-d23b-4de2-8d8a-92f51305e602 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:21.227474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:21.295398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-603b5ea3-d23b-4de2-8d8a-92f51305e602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74ae04c17e6e44958a15398bd1805099', 'request_id': 'req-603b5ea3-d23b-4de2-8d8a-92f51305e602'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:21.336853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-603b5ea3-d23b-4de2-8d8a-92f51305e602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74ae04c17e6e44958a15398bd1805099', 'request_id': 'req-603b5ea3-d23b-4de2-8d8a-92f51305e602'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:21.374988 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-603b5ea3-d23b-4de2-8d8a-92f51305e602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74ae04c17e6e44958a15398bd1805099', 'request_id': 'req-603b5ea3-d23b-4de2-8d8a-92f51305e602'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:21.423092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-603b5ea3-d23b-4de2-8d8a-92f51305e602 admin admin] The token cache is being invalidate because project 74ae04c17e6e44958a15398bd1805099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:07:21.423092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-603b5ea3-d23b-4de2-8d8a-92f51305e602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:21.437604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-603b5ea3-d23b-4de2-8d8a-92f51305e602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:21.452156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1011/2056] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:07:21 2022] DELETE /identity/v3/projects/74ae04c17e6e44958a15398bd1805099 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:21.461176 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bc298-027f-44b6-af94-826a76c0fc8a service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:21.532510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bc298-027f-44b6-af94-826a76c0fc8a service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:21.614462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:21.681046 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfb04e-8caf-40d0-88d2-14f81058bc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:21.681985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfb04e-8caf-40d0-88d2-14f81058bc6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:21.682303 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfb04e-8caf-40d0-88d2-14f81058bc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:21.682577 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfb04e-8caf-40d0-88d2-14f81058bc6b admin admin] PATH_INFO: `/v3/users/3470dab902824875840426f3f869af25` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:21.684087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfb04e-8caf-40d0-88d2-14f81058bc6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3470dab902824875840426f3f869af25)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:21.686334 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfb04e-8caf-40d0-88d2-14f81058bc6b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:21.759132 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a5dfb04e-8caf-40d0-88d2-14f81058bc6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3470dab902824875840426f3f869af25'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:21.771525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a5dfb04e-8caf-40d0-88d2-14f81058bc6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3470dab902824875840426f3f869af25'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:21.800264 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a5dfb04e-8caf-40d0-88d2-14f81058bc6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3470dab902824875840426f3f869af25'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:21.801427 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a5dfb04e-8caf-40d0-88d2-14f81058bc6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3470dab902824875840426f3f869af25'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:21.803180 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a5dfb04e-8caf-40d0-88d2-14f81058bc6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3470dab902824875840426f3f869af25'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:21.837651 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1046/2057] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:07:21 2022] DELETE /identity/v3/users/3470dab902824875840426f3f869af25 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:23.434732 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b5ea3-d23b-4de2-8d8a-92f51305e602 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:23.438574 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-603b5ea3-d23b-4de2-8d8a-92f51305e602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:23.465898 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b5ea3-d23b-4de2-8d8a-92f51305e602 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:23.547038 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0495b-f0a3-48aa-9f69-9722fdbc814d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:23.549497 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0495b-f0a3-48aa-9f69-9722fdbc814d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:23.550039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0495b-f0a3-48aa-9f69-9722fdbc814d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:23.550608 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0495b-f0a3-48aa-9f69-9722fdbc814d admin admin] PATH_INFO: `/v3/projects/8396b799fced456386647a040ed7ee9f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:23.552243 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0495b-f0a3-48aa-9f69-9722fdbc814d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8396b799fced456386647a040ed7ee9f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:23.554703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0495b-f0a3-48aa-9f69-9722fdbc814d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:23.633748 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-07a0495b-f0a3-48aa-9f69-9722fdbc814d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8396b799fced456386647a040ed7ee9f', 'request_id': 'req-07a0495b-f0a3-48aa-9f69-9722fdbc814d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:23.646256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-07a0495b-f0a3-48aa-9f69-9722fdbc814d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8396b799fced456386647a040ed7ee9f', 'request_id': 'req-07a0495b-f0a3-48aa-9f69-9722fdbc814d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:23.656125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-07a0495b-f0a3-48aa-9f69-9722fdbc814d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8396b799fced456386647a040ed7ee9f', 'request_id': 'req-07a0495b-f0a3-48aa-9f69-9722fdbc814d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:23.673993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-07a0495b-f0a3-48aa-9f69-9722fdbc814d admin admin] The token cache is being invalidate because project 8396b799fced456386647a040ed7ee9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:07:23.674476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-07a0495b-f0a3-48aa-9f69-9722fdbc814d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:23.676064 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-07a0495b-f0a3-48aa-9f69-9722fdbc814d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:23.682126 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1012/2058] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:07:23 2022] DELETE /identity/v3/projects/8396b799fced456386647a040ed7ee9f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:23.684194 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116836d-a404-4538-b6d1-4e993ae12224 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:23.684754 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116836d-a404-4538-b6d1-4e993ae12224 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:23.684754 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116836d-a404-4538-b6d1-4e993ae12224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:23.707652 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5116836d-a404-4538-b6d1-4e993ae12224 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:07:23.709110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5116836d-a404-4538-b6d1-4e993ae12224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:23.801640 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1047/2059] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:07:23.809209 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365cf53-d76e-450f-b445-4dff3cc6ccaa None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:23.809510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365cf53-d76e-450f-b445-4dff3cc6ccaa None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:23.809794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365cf53-d76e-450f-b445-4dff3cc6ccaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:23.869251 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c365cf53-d76e-450f-b445-4dff3cc6ccaa None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:07:23.880126 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c365cf53-d76e-450f-b445-4dff3cc6ccaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:23.891534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1013/2060] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:07:23.896164 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116836d-a404-4538-b6d1-4e993ae12224 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:23.913261 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116836d-a404-4538-b6d1-4e993ae12224 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:23.942826 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d181714-d7d0-438b-8a3e-3b6fc08ce9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:23.943545 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d181714-d7d0-438b-8a3e-3b6fc08ce9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:23.943831 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d181714-d7d0-438b-8a3e-3b6fc08ce9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:23.945218 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d181714-d7d0-438b-8a3e-3b6fc08ce9c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:23.946005 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d181714-d7d0-438b-8a3e-3b6fc08ce9c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:07:23.946362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d181714-d7d0-438b-8a3e-3b6fc08ce9c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:23.951584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d181714-d7d0-438b-8a3e-3b6fc08ce9c1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:23.984934 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1048/2061] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:07:23.988996 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365cf53-d76e-450f-b445-4dff3cc6ccaa None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:24.001472 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365cf53-d76e-450f-b445-4dff3cc6ccaa None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:24.007014 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ffc69-d103-49dc-947e-e19f3d5af434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:24.008111 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ffc69-d103-49dc-947e-e19f3d5af434 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:24.008444 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ffc69-d103-49dc-947e-e19f3d5af434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:24.008868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ffc69-d103-49dc-947e-e19f3d5af434 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:24.009689 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ffc69-d103-49dc-947e-e19f3d5af434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:24.013558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ffc69-d103-49dc-947e-e19f3d5af434 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:24.057523 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1014/2062] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:07:23 2022] POST /identity/v3/projects => generated 357 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:07:24.062117 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d181714-d7d0-438b-8a3e-3b6fc08ce9c1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:24.076494 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d181714-d7d0-438b-8a3e-3b6fc08ce9c1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:24.127759 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:24.196566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad27426-c6e7-437d-9b80-3f92aee24ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:24.197526 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad27426-c6e7-437d-9b80-3f92aee24ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:24.197808 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad27426-c6e7-437d-9b80-3f92aee24ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:24.198082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad27426-c6e7-437d-9b80-3f92aee24ae6 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:24.198970 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad27426-c6e7-437d-9b80-3f92aee24ae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:24.201944 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad27426-c6e7-437d-9b80-3f92aee24ae6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:24.268559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1049/2063] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:07:24 2022] POST /identity/v3/users => generated 279 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:07:24.272568 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ffc69-d103-49dc-947e-e19f3d5af434 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:24.281925 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:24.299315 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ffc69-d103-49dc-947e-e19f3d5af434 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:24.306939 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1caf9-0761-4f94-9c13-3b200c5fe908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:24.307941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1caf9-0761-4f94-9c13-3b200c5fe908 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:24.308297 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1caf9-0761-4f94-9c13-3b200c5fe908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:24.308640 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1caf9-0761-4f94-9c13-3b200c5fe908 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:24.309551 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1caf9-0761-4f94-9c13-3b200c5fe908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:24.311422 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1caf9-0761-4f94-9c13-3b200c5fe908 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:24.335874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1015/2064] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:07:24.339919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad27426-c6e7-437d-9b80-3f92aee24ae6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:24.355781 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad27426-c6e7-437d-9b80-3f92aee24ae6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:24.364693 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255bd0c-04a8-4d16-8297-a2cef99aebe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:24.365213 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255bd0c-04a8-4d16-8297-a2cef99aebe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:24.365713 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255bd0c-04a8-4d16-8297-a2cef99aebe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:24.366149 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255bd0c-04a8-4d16-8297-a2cef99aebe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:24.366973 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255bd0c-04a8-4d16-8297-a2cef99aebe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:24.369152 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255bd0c-04a8-4d16-8297-a2cef99aebe9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:24.389540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1050/2065] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:07:24.395056 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1caf9-0761-4f94-9c13-3b200c5fe908 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:24.413646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1caf9-0761-4f94-9c13-3b200c5fe908 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:24.435949 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523812b9-ee94-417a-996d-1585783b2a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:24.436769 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523812b9-ee94-417a-996d-1585783b2a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:24.436769 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523812b9-ee94-417a-996d-1585783b2a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:24.436945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523812b9-ee94-417a-996d-1585783b2a45 admin admin] PATH_INFO: `/v3/projects/0d8b101e89a54bd5b89e8834d8feedff/users/73efc34b6a9149b98d8b586b760190a7/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:24.492597 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523812b9-ee94-417a-996d-1585783b2a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8b101e89a54bd5b89e8834d8feedff, user_id=73efc34b6a9149b98d8b586b760190a7, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:24.504492 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523812b9-ee94-417a-996d-1585783b2a45 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:24.536240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1016/2066] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:07:24 2022] PUT /identity/v3/projects/0d8b101e89a54bd5b89e8834d8feedff/users/73efc34b6a9149b98d8b586b760190a7/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:24.547861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18b853-4bf6-480d-8528-a39a55968798 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:24.548500 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18b853-4bf6-480d-8528-a39a55968798 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:24.549031 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18b853-4bf6-480d-8528-a39a55968798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:24.600969 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1f18b853-4bf6-480d-8528-a39a55968798 None None] MFA Rules not processed for user `73efc34b6a9149b98d8b586b760190a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:07:24.602870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1f18b853-4bf6-480d-8528-a39a55968798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:24.721309 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1051/2067] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:07:24 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:07:24.780321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523812b9-ee94-417a-996d-1585783b2a45 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:24.782803 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-523812b9-ee94-417a-996d-1585783b2a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:24.962269 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523812b9-ee94-417a-996d-1585783b2a45 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:24.972128 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb3e5e-9014-488c-b82d-4d59259452e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:24.976059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb3e5e-9014-488c-b82d-4d59259452e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:24.976505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb3e5e-9014-488c-b82d-4d59259452e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:24.977644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb3e5e-9014-488c-b82d-4d59259452e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:24.998865 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb3e5e-9014-488c-b82d-4d59259452e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:25.000498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb3e5e-9014-488c-b82d-4d59259452e7 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:25.014649 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1017/2068] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:07:24 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:07:34.716845 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:35.007996 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:36.847008 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18b853-4bf6-480d-8528-a39a55968798 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:36.855805 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1f18b853-4bf6-480d-8528-a39a55968798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:37.116559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18b853-4bf6-480d-8528-a39a55968798 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:37.124983 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275713d9-4065-4f19-a7b5-f05978a57cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:37.126140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275713d9-4065-4f19-a7b5-f05978a57cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:37.126420 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275713d9-4065-4f19-a7b5-f05978a57cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:37.126803 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275713d9-4065-4f19-a7b5-f05978a57cbf admin admin] PATH_INFO: `/v3/users/02696270934b4ea3a6e83746599f64ee` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:37.128528 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275713d9-4065-4f19-a7b5-f05978a57cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=02696270934b4ea3a6e83746599f64ee)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:37.131435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275713d9-4065-4f19-a7b5-f05978a57cbf admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:37.238975 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-275713d9-4065-4f19-a7b5-f05978a57cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02696270934b4ea3a6e83746599f64ee'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:37.260670 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-275713d9-4065-4f19-a7b5-f05978a57cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02696270934b4ea3a6e83746599f64ee'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:37.279888 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-275713d9-4065-4f19-a7b5-f05978a57cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02696270934b4ea3a6e83746599f64ee'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:37.280669 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-275713d9-4065-4f19-a7b5-f05978a57cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02696270934b4ea3a6e83746599f64ee'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:37.281334 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-275713d9-4065-4f19-a7b5-f05978a57cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02696270934b4ea3a6e83746599f64ee'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:37.330653 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1052/2069] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:07:36 2022] DELETE /identity/v3/users/02696270934b4ea3a6e83746599f64ee => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:38.556762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb3e5e-9014-488c-b82d-4d59259452e7 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:38.613515 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb3e5e-9014-488c-b82d-4d59259452e7 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:38.848298 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa85f7-38d2-4ea1-8c79-59e350dbe060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:38.849518 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa85f7-38d2-4ea1-8c79-59e350dbe060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:38.849802 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa85f7-38d2-4ea1-8c79-59e350dbe060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:38.850077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa85f7-38d2-4ea1-8c79-59e350dbe060 admin admin] PATH_INFO: `/v3/projects/f2bf7039ef6241cf84fccf53c92e5d86` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:38.858336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa85f7-38d2-4ea1-8c79-59e350dbe060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2bf7039ef6241cf84fccf53c92e5d86)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:38.860302 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa85f7-38d2-4ea1-8c79-59e350dbe060 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:39.049626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c3aa85f7-38d2-4ea1-8c79-59e350dbe060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2bf7039ef6241cf84fccf53c92e5d86', 'request_id': 'req-c3aa85f7-38d2-4ea1-8c79-59e350dbe060'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:39.068777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c3aa85f7-38d2-4ea1-8c79-59e350dbe060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2bf7039ef6241cf84fccf53c92e5d86', 'request_id': 'req-c3aa85f7-38d2-4ea1-8c79-59e350dbe060'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:39.077583 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c3aa85f7-38d2-4ea1-8c79-59e350dbe060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2bf7039ef6241cf84fccf53c92e5d86', 'request_id': 'req-c3aa85f7-38d2-4ea1-8c79-59e350dbe060'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:39.107438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c3aa85f7-38d2-4ea1-8c79-59e350dbe060 admin admin] The token cache is being invalidate because project f2bf7039ef6241cf84fccf53c92e5d86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:07:39.107885 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c3aa85f7-38d2-4ea1-8c79-59e350dbe060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:39.109080 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c3aa85f7-38d2-4ea1-8c79-59e350dbe060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:39.118428 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1018/2070] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:07:38 2022] DELETE /identity/v3/projects/f2bf7039ef6241cf84fccf53c92e5d86 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:39.120359 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be769e9-9ae6-4f11-bb14-14047cef2cf7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:39.121993 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be769e9-9ae6-4f11-bb14-14047cef2cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:39.122446 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be769e9-9ae6-4f11-bb14-14047cef2cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:39.169803 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3be769e9-9ae6-4f11-bb14-14047cef2cf7 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:07:39.172239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3be769e9-9ae6-4f11-bb14-14047cef2cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:39.382173 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1053/2071] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:07:39.391198 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef39d41-2192-400c-8c9b-248a7d2b7be6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:39.391567 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef39d41-2192-400c-8c9b-248a7d2b7be6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:39.391914 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef39d41-2192-400c-8c9b-248a7d2b7be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:39.422551 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-eef39d41-2192-400c-8c9b-248a7d2b7be6 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:07:39.424563 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-eef39d41-2192-400c-8c9b-248a7d2b7be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:39.455170 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1019/2072] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:07:39.456230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be769e9-9ae6-4f11-bb14-14047cef2cf7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:39.470305 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be769e9-9ae6-4f11-bb14-14047cef2cf7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:39.482275 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31655d84-febf-4d05-a18e-07ae98e1d1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:39.483224 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31655d84-febf-4d05-a18e-07ae98e1d1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:39.483609 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31655d84-febf-4d05-a18e-07ae98e1d1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:39.483948 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31655d84-febf-4d05-a18e-07ae98e1d1e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:39.484936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31655d84-febf-4d05-a18e-07ae98e1d1e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:07:39.485199 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31655d84-febf-4d05-a18e-07ae98e1d1e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:39.486837 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31655d84-febf-4d05-a18e-07ae98e1d1e5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:39.520428 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1054/2073] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:07:39.525588 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef39d41-2192-400c-8c9b-248a7d2b7be6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:39.541573 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31655d84-febf-4d05-a18e-07ae98e1d1e5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:39.542437 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef39d41-2192-400c-8c9b-248a7d2b7be6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:39.544430 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-31655d84-febf-4d05-a18e-07ae98e1d1e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:39.566779 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688787d3-17d3-4620-b0ce-44efb23f96ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:39.567491 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688787d3-17d3-4620-b0ce-44efb23f96ee admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:39.567772 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688787d3-17d3-4620-b0ce-44efb23f96ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:39.568051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688787d3-17d3-4620-b0ce-44efb23f96ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:39.568785 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688787d3-17d3-4620-b0ce-44efb23f96ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:39.570757 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688787d3-17d3-4620-b0ce-44efb23f96ee admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:39.583788 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31655d84-febf-4d05-a18e-07ae98e1d1e5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:39.621669 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdddd60-6adb-490e-b499-9b2c64e1d990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:39.622873 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdddd60-6adb-490e-b499-9b2c64e1d990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:39.623319 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdddd60-6adb-490e-b499-9b2c64e1d990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:39.623751 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdddd60-6adb-490e-b499-9b2c64e1d990 admin admin] PATH_INFO: `/v3/users/de863c4f29e64e32b1488b988d9457d7` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:39.629666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdddd60-6adb-490e-b499-9b2c64e1d990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de863c4f29e64e32b1488b988d9457d7)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:39.631930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdddd60-6adb-490e-b499-9b2c64e1d990 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:39.634322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:39.641295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1020/2074] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:07:39 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:07:39.642606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688787d3-17d3-4620-b0ce-44efb23f96ee admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:39.772157 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6fdddd60-6adb-490e-b499-9b2c64e1d990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de863c4f29e64e32b1488b988d9457d7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:39.801287 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6fdddd60-6adb-490e-b499-9b2c64e1d990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de863c4f29e64e32b1488b988d9457d7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:39.819024 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6fdddd60-6adb-490e-b499-9b2c64e1d990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de863c4f29e64e32b1488b988d9457d7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:39.819024 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6fdddd60-6adb-490e-b499-9b2c64e1d990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de863c4f29e64e32b1488b988d9457d7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:39.821553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688787d3-17d3-4620-b0ce-44efb23f96ee admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:39.822338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6fdddd60-6adb-490e-b499-9b2c64e1d990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de863c4f29e64e32b1488b988d9457d7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:39.838368 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36faadf4-5e46-4b9f-907a-eaa23a90d1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:39.839147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faadf4-5e46-4b9f-907a-eaa23a90d1ed admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:39.839534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faadf4-5e46-4b9f-907a-eaa23a90d1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:39.839823 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faadf4-5e46-4b9f-907a-eaa23a90d1ed admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:39.847737 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36faadf4-5e46-4b9f-907a-eaa23a90d1ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:39.854891 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36faadf4-5e46-4b9f-907a-eaa23a90d1ed admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:39.877734 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:39.882949 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1055/2075] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:07:39 2022] DELETE /identity/v3/users/de863c4f29e64e32b1488b988d9457d7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:39.914422 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1021/2076] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:07:39 2022] POST /identity/v3/users => generated 286 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:07:39.915883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdddd60-6adb-490e-b499-9b2c64e1d990 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:39.917669 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6fdddd60-6adb-490e-b499-9b2c64e1d990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:40.086234 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdddd60-6adb-490e-b499-9b2c64e1d990 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:40.097323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006cbd6-819b-4791-b2fa-cb47f4fb5dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:40.105837 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006cbd6-819b-4791-b2fa-cb47f4fb5dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:40.106190 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006cbd6-819b-4791-b2fa-cb47f4fb5dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:40.106476 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006cbd6-819b-4791-b2fa-cb47f4fb5dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:40.107281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006cbd6-819b-4791-b2fa-cb47f4fb5dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:40.108995 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006cbd6-819b-4791-b2fa-cb47f4fb5dc5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:40.144837 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1056/2077] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:07:40.149015 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36faadf4-5e46-4b9f-907a-eaa23a90d1ed admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:40.180153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36faadf4-5e46-4b9f-907a-eaa23a90d1ed admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:40.210791 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321fd50-ab34-4742-9648-392b23443fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:40.213156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321fd50-ab34-4742-9648-392b23443fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:40.213561 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321fd50-ab34-4742-9648-392b23443fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:40.213942 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321fd50-ab34-4742-9648-392b23443fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:40.214883 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321fd50-ab34-4742-9648-392b23443fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:40.232130 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321fd50-ab34-4742-9648-392b23443fe0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:40.265278 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1022/2078] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:07:40.269098 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006cbd6-819b-4791-b2fa-cb47f4fb5dc5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:40.282436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006cbd6-819b-4791-b2fa-cb47f4fb5dc5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:40.288680 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae99861-ad05-4603-adfc-d5488805847d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:40.290784 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae99861-ad05-4603-adfc-d5488805847d admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:40.291497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae99861-ad05-4603-adfc-d5488805847d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:40.292101 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae99861-ad05-4603-adfc-d5488805847d admin admin] PATH_INFO: `/v3/projects/de22eff028694701b5d3374bc02c4829/users/3a2e5c757efa40818ee741bc417a75df/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:40.339614 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae99861-ad05-4603-adfc-d5488805847d admin admin] RBAC: Authorizing `identity:create_grant(project_id=de22eff028694701b5d3374bc02c4829, user_id=3a2e5c757efa40818ee741bc417a75df, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:40.343163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae99861-ad05-4603-adfc-d5488805847d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:40.374227 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1057/2079] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:07:40 2022] PUT /identity/v3/projects/de22eff028694701b5d3374bc02c4829/users/3a2e5c757efa40818ee741bc417a75df/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:07:40.376500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30dc28-4c31-4aaa-a151-9bddbffbc242 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:40.377377 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30dc28-4c31-4aaa-a151-9bddbffbc242 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:40.377898 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30dc28-4c31-4aaa-a151-9bddbffbc242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:40.415074 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1c30dc28-4c31-4aaa-a151-9bddbffbc242 None None] MFA Rules not processed for user `3a2e5c757efa40818ee741bc417a75df`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:07:40.416833 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1c30dc28-4c31-4aaa-a151-9bddbffbc242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:40.540632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1023/2080] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:07:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:07:40.545208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae99861-ad05-4603-adfc-d5488805847d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:40.636670 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30dc28-4c31-4aaa-a151-9bddbffbc242 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:40.638412 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1c30dc28-4c31-4aaa-a151-9bddbffbc242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:40.703917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:40.729743 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae99861-ad05-4603-adfc-d5488805847d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:40.744651 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aa52d-736c-4d68-9ce1-720498cd84b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:40.745388 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aa52d-736c-4d68-9ce1-720498cd84b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:40.745701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aa52d-736c-4d68-9ce1-720498cd84b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:40.746011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aa52d-736c-4d68-9ce1-720498cd84b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:40.746709 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162aa52d-736c-4d68-9ce1-720498cd84b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:40.749357 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162aa52d-736c-4d68-9ce1-720498cd84b3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:40.797099 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1058/2081] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:07:40 2022] POST /identity/v3/projects => generated 371 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:07:40.800788 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aa52d-736c-4d68-9ce1-720498cd84b3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:40.831242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30dc28-4c31-4aaa-a151-9bddbffbc242 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:40.922478 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aa52d-736c-4d68-9ce1-720498cd84b3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:40.929527 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7717b92-5671-4646-9840-cf9b9b5b1ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:40.930966 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7717b92-5671-4646-9840-cf9b9b5b1ede admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:40.931352 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7717b92-5671-4646-9840-cf9b9b5b1ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:40.931676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7717b92-5671-4646-9840-cf9b9b5b1ede admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:40.932745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7717b92-5671-4646-9840-cf9b9b5b1ede admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:40.936779 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7717b92-5671-4646-9840-cf9b9b5b1ede admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:40.999681 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bd353-fe40-4458-845f-3ea6a6b6f626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:41.001833 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bd353-fe40-4458-845f-3ea6a6b6f626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:41.006276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1059/2082] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:07:40 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:07:41.012219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7717b92-5671-4646-9840-cf9b9b5b1ede admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:41.013127 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bd353-fe40-4458-845f-3ea6a6b6f626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:41.014787 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bd353-fe40-4458-845f-3ea6a6b6f626 admin admin] PATH_INFO: `/v3/users/5b244089f61f45cb812788ef46c15af5` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:41.018515 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bd353-fe40-4458-845f-3ea6a6b6f626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b244089f61f45cb812788ef46c15af5)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:41.029275 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bd353-fe40-4458-845f-3ea6a6b6f626 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:41.043591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7717b92-5671-4646-9840-cf9b9b5b1ede admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:41.060809 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483c131-66c6-4ddf-93c7-11cade69b9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:41.062209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483c131-66c6-4ddf-93c7-11cade69b9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:41.062755 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483c131-66c6-4ddf-93c7-11cade69b9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:41.063272 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483c131-66c6-4ddf-93c7-11cade69b9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:41.064784 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483c131-66c6-4ddf-93c7-11cade69b9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:41.070313 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483c131-66c6-4ddf-93c7-11cade69b9f9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:41.087681 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:INSERT=2,keystone:SELECT=96,keystone:DELETE=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:41.104219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1060/2083] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:07:41.106935 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483c131-66c6-4ddf-93c7-11cade69b9f9 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:41.130235 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483c131-66c6-4ddf-93c7-11cade69b9f9 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:41.142068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268b090-333c-4ab0-bb34-05cc01a1a30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:41.143799 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268b090-333c-4ab0-bb34-05cc01a1a30f admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:41.144680 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268b090-333c-4ab0-bb34-05cc01a1a30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:41.149080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268b090-333c-4ab0-bb34-05cc01a1a30f admin admin] PATH_INFO: `/v3/projects/60297674311d4fb4805842a5cac16107/users/a6672946d6194fdca2bc8f7a308b8a7c/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:41.187767 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-de2bd353-fe40-4458-845f-3ea6a6b6f626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b244089f61f45cb812788ef46c15af5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:41.193947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268b090-333c-4ab0-bb34-05cc01a1a30f admin admin] RBAC: Authorizing `identity:create_grant(project_id=60297674311d4fb4805842a5cac16107, user_id=a6672946d6194fdca2bc8f7a308b8a7c, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:41.199237 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268b090-333c-4ab0-bb34-05cc01a1a30f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:41.201650 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-de2bd353-fe40-4458-845f-3ea6a6b6f626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b244089f61f45cb812788ef46c15af5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:41.228556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1061/2084] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:07:41 2022] PUT /identity/v3/projects/60297674311d4fb4805842a5cac16107/users/a6672946d6194fdca2bc8f7a308b8a7c/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:41.230000 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268b090-333c-4ab0-bb34-05cc01a1a30f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:41.231889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-de2bd353-fe40-4458-845f-3ea6a6b6f626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b244089f61f45cb812788ef46c15af5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:41.233245 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-de2bd353-fe40-4458-845f-3ea6a6b6f626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b244089f61f45cb812788ef46c15af5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:41.237016 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4268b090-333c-4ab0-bb34-05cc01a1a30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:41.257205 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-de2bd353-fe40-4458-845f-3ea6a6b6f626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b244089f61f45cb812788ef46c15af5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:41.287119 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1024/2085] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:07:40 2022] DELETE /identity/v3/users/5b244089f61f45cb812788ef46c15af5 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:41.287119 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bd353-fe40-4458-845f-3ea6a6b6f626 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:41.291430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-de2bd353-fe40-4458-845f-3ea6a6b6f626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:41.423226 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268b090-333c-4ab0-bb34-05cc01a1a30f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:41.506561 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bd353-fe40-4458-845f-3ea6a6b6f626 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:41.528832 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78a7d0-8c1d-49ac-a6c9-746801f79fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:41.529929 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78a7d0-8c1d-49ac-a6c9-746801f79fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:41.530420 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78a7d0-8c1d-49ac-a6c9-746801f79fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:41.530873 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78a7d0-8c1d-49ac-a6c9-746801f79fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:41.532683 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78a7d0-8c1d-49ac-a6c9-746801f79fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:41.536497 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78a7d0-8c1d-49ac-a6c9-746801f79fb4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:41.550013 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:41.571541 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1025/2086] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:07:41.576139 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78a7d0-8c1d-49ac-a6c9-746801f79fb4 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:41.588816 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78a7d0-8c1d-49ac-a6c9-746801f79fb4 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:41.596044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac372f-3f43-4f58-8ffc-46c1cdd743b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:41.598391 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac372f-3f43-4f58-8ffc-46c1cdd743b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:41.599345 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac372f-3f43-4f58-8ffc-46c1cdd743b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:41.599345 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac372f-3f43-4f58-8ffc-46c1cdd743b9 admin admin] PATH_INFO: `/v3/projects/60297674311d4fb4805842a5cac16107/users/a6672946d6194fdca2bc8f7a308b8a7c/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:41.601164 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba0fca-b222-4e49-b897-3855a11e0559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:41.602274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba0fca-b222-4e49-b897-3855a11e0559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:41.602607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba0fca-b222-4e49-b897-3855a11e0559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:41.602823 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba0fca-b222-4e49-b897-3855a11e0559 admin admin] PATH_INFO: `/v3/projects/0d5b48ca7a3146ee9e1f53551e0fe89a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:41.605162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba0fca-b222-4e49-b897-3855a11e0559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d5b48ca7a3146ee9e1f53551e0fe89a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:41.608121 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac372f-3f43-4f58-8ffc-46c1cdd743b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60297674311d4fb4805842a5cac16107, user_id=a6672946d6194fdca2bc8f7a308b8a7c, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:41.611500 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba0fca-b222-4e49-b897-3855a11e0559 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:41.614327 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac372f-3f43-4f58-8ffc-46c1cdd743b9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:41.637531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1026/2087] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:07:41 2022] PUT /identity/v3/projects/60297674311d4fb4805842a5cac16107/users/a6672946d6194fdca2bc8f7a308b8a7c/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:41.649463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbbc2f-c9aa-42ac-8bd5-684f94fe6e45 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:41.649819 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbbc2f-c9aa-42ac-8bd5-684f94fe6e45 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:41.650355 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbbc2f-c9aa-42ac-8bd5-684f94fe6e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:41.694155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-01fbbc2f-c9aa-42ac-8bd5-684f94fe6e45 None None] MFA Rules not processed for user `a6672946d6194fdca2bc8f7a308b8a7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:07:41.696168 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-01fbbc2f-c9aa-42ac-8bd5-684f94fe6e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:41.720820 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0bba0fca-b222-4e49-b897-3855a11e0559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d5b48ca7a3146ee9e1f53551e0fe89a', 'request_id': 'req-0bba0fca-b222-4e49-b897-3855a11e0559'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:41.731791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0bba0fca-b222-4e49-b897-3855a11e0559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d5b48ca7a3146ee9e1f53551e0fe89a', 'request_id': 'req-0bba0fca-b222-4e49-b897-3855a11e0559'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:41.747429 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0bba0fca-b222-4e49-b897-3855a11e0559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d5b48ca7a3146ee9e1f53551e0fe89a', 'request_id': 'req-0bba0fca-b222-4e49-b897-3855a11e0559'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:41.774114 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0bba0fca-b222-4e49-b897-3855a11e0559 admin admin] The token cache is being invalidate because project 0d5b48ca7a3146ee9e1f53551e0fe89a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:07:41.774420 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0bba0fca-b222-4e49-b897-3855a11e0559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:41.776008 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0bba0fca-b222-4e49-b897-3855a11e0559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:41.782183 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1062/2088] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:07:41 2022] DELETE /identity/v3/projects/0d5b48ca7a3146ee9e1f53551e0fe89a => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:41.782183 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba0fca-b222-4e49-b897-3855a11e0559 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:41.786644 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0bba0fca-b222-4e49-b897-3855a11e0559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:41.838920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1027/2089] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:07:41 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:07:41.840091 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbbc2f-c9aa-42ac-8bd5-684f94fe6e45 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:41.842099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-01fbbc2f-c9aa-42ac-8bd5-684f94fe6e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:41.858005 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:41.894711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba0fca-b222-4e49-b897-3855a11e0559 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:41.902210 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef046d7e-5f3c-4b7c-8a09-a89cac9eda5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:41.903572 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef046d7e-5f3c-4b7c-8a09-a89cac9eda5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:41.904006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef046d7e-5f3c-4b7c-8a09-a89cac9eda5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:41.904437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef046d7e-5f3c-4b7c-8a09-a89cac9eda5c admin admin] PATH_INFO: `/v3/projects/4914886561974d358b06b99d1582d906` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:41.907070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef046d7e-5f3c-4b7c-8a09-a89cac9eda5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4914886561974d358b06b99d1582d906)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:41.909875 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef046d7e-5f3c-4b7c-8a09-a89cac9eda5c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:41.971484 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbbc2f-c9aa-42ac-8bd5-684f94fe6e45 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:41.978204 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1858c0-9916-4e8b-a8dc-c0f6bded99ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:41.980346 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1858c0-9916-4e8b-a8dc-c0f6bded99ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:41.980702 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1858c0-9916-4e8b-a8dc-c0f6bded99ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:41.981127 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1858c0-9916-4e8b-a8dc-c0f6bded99ee admin admin] PATH_INFO: `/v3/users/56825a3adce04968b02135a59db68385` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:41.983283 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1858c0-9916-4e8b-a8dc-c0f6bded99ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=56825a3adce04968b02135a59db68385)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:41.985712 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1858c0-9916-4e8b-a8dc-c0f6bded99ee admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:41.997986 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ef046d7e-5f3c-4b7c-8a09-a89cac9eda5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4914886561974d358b06b99d1582d906', 'request_id': 'req-ef046d7e-5f3c-4b7c-8a09-a89cac9eda5c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:42.010092 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ef046d7e-5f3c-4b7c-8a09-a89cac9eda5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4914886561974d358b06b99d1582d906', 'request_id': 'req-ef046d7e-5f3c-4b7c-8a09-a89cac9eda5c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:42.037811 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ef046d7e-5f3c-4b7c-8a09-a89cac9eda5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4914886561974d358b06b99d1582d906', 'request_id': 'req-ef046d7e-5f3c-4b7c-8a09-a89cac9eda5c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:42.057565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:42.074305 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ef046d7e-5f3c-4b7c-8a09-a89cac9eda5c admin admin] The token cache is being invalidate because project 4914886561974d358b06b99d1582d906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:07:42.075288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ef046d7e-5f3c-4b7c-8a09-a89cac9eda5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:42.079006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ef046d7e-5f3c-4b7c-8a09-a89cac9eda5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:42.081839 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1063/2090] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:07:41 2022] DELETE /identity/v3/projects/4914886561974d358b06b99d1582d906 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:42.085747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ce1858c0-9916-4e8b-a8dc-c0f6bded99ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56825a3adce04968b02135a59db68385'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:42.091888 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef046d7e-5f3c-4b7c-8a09-a89cac9eda5c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:42.096624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ef046d7e-5f3c-4b7c-8a09-a89cac9eda5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:42.099552 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ce1858c0-9916-4e8b-a8dc-c0f6bded99ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56825a3adce04968b02135a59db68385'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:42.120787 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ce1858c0-9916-4e8b-a8dc-c0f6bded99ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56825a3adce04968b02135a59db68385'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:42.121563 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ce1858c0-9916-4e8b-a8dc-c0f6bded99ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56825a3adce04968b02135a59db68385'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:42.131460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ce1858c0-9916-4e8b-a8dc-c0f6bded99ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56825a3adce04968b02135a59db68385'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:42.142798 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1028/2091] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:07:41 2022] DELETE /identity/v3/users/56825a3adce04968b02135a59db68385 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:42.164410 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb7d69-b4fa-4935-a332-e370c7e71768 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:42.164797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb7d69-b4fa-4935-a332-e370c7e71768 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:42.165026 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb7d69-b4fa-4935-a332-e370c7e71768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:42.218960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef046d7e-5f3c-4b7c-8a09-a89cac9eda5c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:42.230496 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9fdb7d69-b4fa-4935-a332-e370c7e71768 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:07:42.231986 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9fdb7d69-b4fa-4935-a332-e370c7e71768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:42.343011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5b542-5213-459b-b628-4f6bb13d270d tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6672946d6194fdca2bc8f7a308b8a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60297674311d4fb4805842a5cac16107', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:42.343798 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5b542-5213-459b-b628-4f6bb13d270d tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:42.344186 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5b542-5213-459b-b628-4f6bb13d270d tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:42.345209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5b542-5213-459b-b628-4f6bb13d270d tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:42.349033 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5b542-5213-459b-b628-4f6bb13d270d tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:07:42.349501 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5b542-5213-459b-b628-4f6bb13d270d tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:42.351242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5b542-5213-459b-b628-4f6bb13d270d tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:42.374077 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1064/2092] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:07:42.379451 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5b542-5213-459b-b628-4f6bb13d270d tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:42.382969 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f5c5b542-5213-459b-b628-4f6bb13d270d tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:42.395648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1029/2093] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:07:42.397547 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b64671-5189-45fb-b2ca-3e85ad33294d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:42.398035 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b64671-5189-45fb-b2ca-3e85ad33294d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:42.398631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b64671-5189-45fb-b2ca-3e85ad33294d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:42.416382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5b542-5213-459b-b628-4f6bb13d270d tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:42.428494 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69111a89-72b9-48e6-af2a-355a8bae33d7 tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6672946d6194fdca2bc8f7a308b8a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60297674311d4fb4805842a5cac16107', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:42.430137 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69111a89-72b9-48e6-af2a-355a8bae33d7 tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:42.430429 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69111a89-72b9-48e6-af2a-355a8bae33d7 tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:42.430751 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69111a89-72b9-48e6-af2a-355a8bae33d7 tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:42.434704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69111a89-72b9-48e6-af2a-355a8bae33d7 tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:42.436173 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69111a89-72b9-48e6-af2a-355a8bae33d7 tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:42.440391 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c6b64671-5189-45fb-b2ca-3e85ad33294d None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:07:42.442781 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c6b64671-5189-45fb-b2ca-3e85ad33294d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:42.469486 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1030/2094] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:07:42.471255 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b64671-5189-45fb-b2ca-3e85ad33294d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:42.492484 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b64671-5189-45fb-b2ca-3e85ad33294d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:42.512459 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01e7dd-6d3c-4b85-9bb8-addabf372bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:42.516370 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1065/2095] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:07:42 2022] POST /identity/v3/projects => generated 349 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:07:42.517462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69111a89-72b9-48e6-af2a-355a8bae33d7 tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:42.518699 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01e7dd-6d3c-4b85-9bb8-addabf372bfd admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:42.518987 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01e7dd-6d3c-4b85-9bb8-addabf372bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:42.519262 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01e7dd-6d3c-4b85-9bb8-addabf372bfd admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:42.520040 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01e7dd-6d3c-4b85-9bb8-addabf372bfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:07:42.521807 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01e7dd-6d3c-4b85-9bb8-addabf372bfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:42.524035 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01e7dd-6d3c-4b85-9bb8-addabf372bfd admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:42.559235 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1031/2096] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:07:42.560547 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01e7dd-6d3c-4b85-9bb8-addabf372bfd admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:42.579255 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:42.590105 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01e7dd-6d3c-4b85-9bb8-addabf372bfd admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:42.705285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69111a89-72b9-48e6-af2a-355a8bae33d7 tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:42.725832 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32e368-680d-4dce-aa91-98471e70c728 tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6672946d6194fdca2bc8f7a308b8a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60297674311d4fb4805842a5cac16107', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:42.726452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32e368-680d-4dce-aa91-98471e70c728 tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:42.726871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32e368-680d-4dce-aa91-98471e70c728 tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:42.727257 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32e368-680d-4dce-aa91-98471e70c728 tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:42.728176 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32e368-680d-4dce-aa91-98471e70c728 tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:07:42.728631 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32e368-680d-4dce-aa91-98471e70c728 tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:42.732855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32e368-680d-4dce-aa91-98471e70c728 tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:42.752223 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1066/2097] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:07:42.754174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32e368-680d-4dce-aa91-98471e70c728 tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:42.758828 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eeb819-85e4-4fc7-97a7-5592147a1447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:42.759532 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eeb819-85e4-4fc7-97a7-5592147a1447 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:42.759805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eeb819-85e4-4fc7-97a7-5592147a1447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:42.760081 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eeb819-85e4-4fc7-97a7-5592147a1447 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:42.760827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eeb819-85e4-4fc7-97a7-5592147a1447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:42.763630 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eeb819-85e4-4fc7-97a7-5592147a1447 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:42.764460 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5c32e368-680d-4dce-aa91-98471e70c728 tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:42.779828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32e368-680d-4dce-aa91-98471e70c728 tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:42.786759 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bde91-c9b7-4baa-a409-4827dd4b4c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:42.788079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bde91-c9b7-4baa-a409-4827dd4b4c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:42.788883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bde91-c9b7-4baa-a409-4827dd4b4c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:42.789422 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bde91-c9b7-4baa-a409-4827dd4b4c33 admin admin] PATH_INFO: `/v3/projects/8b3fa50ba7c74b29be36b2b495f67c0f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:42.791050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bde91-c9b7-4baa-a409-4827dd4b4c33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b3fa50ba7c74b29be36b2b495f67c0f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:42.793582 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bde91-c9b7-4baa-a409-4827dd4b4c33 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:42.798564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1032/2098] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:07:42 2022] POST /identity/v3/projects => generated 397 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:07:42.799834 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eeb819-85e4-4fc7-97a7-5592147a1447 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:42.802005 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d1eeb819-85e4-4fc7-97a7-5592147a1447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:42.802878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:42.867120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e66bde91-c9b7-4baa-a409-4827dd4b4c33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b3fa50ba7c74b29be36b2b495f67c0f', 'request_id': 'req-e66bde91-c9b7-4baa-a409-4827dd4b4c33'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:42.877132 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e66bde91-c9b7-4baa-a409-4827dd4b4c33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b3fa50ba7c74b29be36b2b495f67c0f', 'request_id': 'req-e66bde91-c9b7-4baa-a409-4827dd4b4c33'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:42.880176 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eeb819-85e4-4fc7-97a7-5592147a1447 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:42.886330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e66bde91-c9b7-4baa-a409-4827dd4b4c33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b3fa50ba7c74b29be36b2b495f67c0f', 'request_id': 'req-e66bde91-c9b7-4baa-a409-4827dd4b4c33'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:42.904599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e66bde91-c9b7-4baa-a409-4827dd4b4c33 admin admin] The token cache is being invalidate because project 8b3fa50ba7c74b29be36b2b495f67c0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:07:42.905136 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e66bde91-c9b7-4baa-a409-4827dd4b4c33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:42.906068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e66bde91-c9b7-4baa-a409-4827dd4b4c33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:42.908430 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1067/2099] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:07:42 2022] DELETE /identity/v3/projects/8b3fa50ba7c74b29be36b2b495f67c0f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:42.909305 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bde91-c9b7-4baa-a409-4827dd4b4c33 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:42.927786 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e66bde91-c9b7-4baa-a409-4827dd4b4c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:43.142331 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b8054-e263-4148-91fc-e003a4456e4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:43.147758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b8054-e263-4148-91fc-e003a4456e4e service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:43.148244 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b8054-e263-4148-91fc-e003a4456e4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:43.149579 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b8054-e263-4148-91fc-e003a4456e4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:43.163843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cc9b8054-e263-4148-91fc-e003a4456e4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:43.243145 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bde91-c9b7-4baa-a409-4827dd4b4c33 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:43.249970 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21931aa-04db-453a-8ff2-08f10ce89040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:43.250678 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21931aa-04db-453a-8ff2-08f10ce89040 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:43.251102 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21931aa-04db-453a-8ff2-08f10ce89040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:43.252171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21931aa-04db-453a-8ff2-08f10ce89040 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:43.253139 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21931aa-04db-453a-8ff2-08f10ce89040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:43.255452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21931aa-04db-453a-8ff2-08f10ce89040 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:43.261967 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:43.267562 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b8054-e263-4148-91fc-e003a4456e4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:43.272368 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b8054-e263-4148-91fc-e003a4456e4e service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:43.303155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1033/2100] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:07:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:07:43.322409 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1068/2101] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:07:42 2022] POST /identity/v3/users => generated 299 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:07:43.326117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b8054-e263-4148-91fc-e003a4456e4e service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:43.347825 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b8054-e263-4148-91fc-e003a4456e4e service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:43.356185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a99056-f84c-4003-8982-5acd7b8f144a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:43.357291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a99056-f84c-4003-8982-5acd7b8f144a admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:43.357462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a99056-f84c-4003-8982-5acd7b8f144a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:43.358080 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a99056-f84c-4003-8982-5acd7b8f144a admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:43.358696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a99056-f84c-4003-8982-5acd7b8f144a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:43.360385 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a99056-f84c-4003-8982-5acd7b8f144a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:43.378278 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1034/2102] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:07:43.379969 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21931aa-04db-453a-8ff2-08f10ce89040 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:43.392242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21931aa-04db-453a-8ff2-08f10ce89040 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:43.397677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bb3f3-78a1-4de6-a968-5823552ba35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:43.398491 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bb3f3-78a1-4de6-a968-5823552ba35d admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:43.398880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bb3f3-78a1-4de6-a968-5823552ba35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:43.399352 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bb3f3-78a1-4de6-a968-5823552ba35d admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:43.400195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bb3f3-78a1-4de6-a968-5823552ba35d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:43.402112 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bb3f3-78a1-4de6-a968-5823552ba35d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:43.417791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1069/2103] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:07:43.419072 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a99056-f84c-4003-8982-5acd7b8f144a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:43.434791 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a99056-f84c-4003-8982-5acd7b8f144a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:43.441721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be997b7-e047-488c-a34f-23c577d111af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:43.443144 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be997b7-e047-488c-a34f-23c577d111af admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:43.443736 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be997b7-e047-488c-a34f-23c577d111af admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:43.444305 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be997b7-e047-488c-a34f-23c577d111af admin admin] PATH_INFO: `/v3/projects/d0042f2c34614d1190aaf65ef3ee8b86/users/5dbd5052e2714023aba14ca813f27e1e/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:43.469718 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be997b7-e047-488c-a34f-23c577d111af admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0042f2c34614d1190aaf65ef3ee8b86, user_id=5dbd5052e2714023aba14ca813f27e1e, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:43.475329 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be997b7-e047-488c-a34f-23c577d111af admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:43.544467 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1035/2104] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:07:43 2022] PUT /identity/v3/projects/d0042f2c34614d1190aaf65ef3ee8b86/users/5dbd5052e2714023aba14ca813f27e1e/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:43.559902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8390a-a257-49da-b21d-b918feddfcbe None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:43.560760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8390a-a257-49da-b21d-b918feddfcbe None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:43.560905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8390a-a257-49da-b21d-b918feddfcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:43.638575 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-47a8390a-a257-49da-b21d-b918feddfcbe None None] MFA Rules not processed for user `5dbd5052e2714023aba14ca813f27e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:07:43.640073 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-47a8390a-a257-49da-b21d-b918feddfcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:43.759637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1070/2105] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:07:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:07:43.784707 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be997b7-e047-488c-a34f-23c577d111af admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:43.788034 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4be997b7-e047-488c-a34f-23c577d111af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:43.916917 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be997b7-e047-488c-a34f-23c577d111af admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:43.921661 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a2870-d2aa-4c25-9d88-b50f216be0d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:43.922586 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a2870-d2aa-4c25-9d88-b50f216be0d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:43.923065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a2870-d2aa-4c25-9d88-b50f216be0d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:43.923502 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a2870-d2aa-4c25-9d88-b50f216be0d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:43.935137 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a2870-d2aa-4c25-9d88-b50f216be0d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:43.936810 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a2870-d2aa-4c25-9d88-b50f216be0d4 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:43.948408 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1036/2106] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:07:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:07:49.130752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8390a-a257-49da-b21d-b918feddfcbe None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:49.140209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:49.249983 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8390a-a257-49da-b21d-b918feddfcbe None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:49.257070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369eee2f-7dea-4413-a6a1-476d44f36def tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6672946d6194fdca2bc8f7a308b8a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60297674311d4fb4805842a5cac16107', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:49.257639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eee2f-7dea-4413-a6a1-476d44f36def tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:49.257922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eee2f-7dea-4413-a6a1-476d44f36def tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:49.258195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eee2f-7dea-4413-a6a1-476d44f36def tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] PATH_INFO: `/v3/projects/0844ba8714634370abe6542862498ed9` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:49.259464 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369eee2f-7dea-4413-a6a1-476d44f36def tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0844ba8714634370abe6542862498ed9)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:49.261681 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369eee2f-7dea-4413-a6a1-476d44f36def tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:49.335114 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-369eee2f-7dea-4413-a6a1-476d44f36def tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0844ba8714634370abe6542862498ed9', 'request_id': 'req-369eee2f-7dea-4413-a6a1-476d44f36def'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:49.346992 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-369eee2f-7dea-4413-a6a1-476d44f36def tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0844ba8714634370abe6542862498ed9', 'request_id': 'req-369eee2f-7dea-4413-a6a1-476d44f36def'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:49.358412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-369eee2f-7dea-4413-a6a1-476d44f36def tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0844ba8714634370abe6542862498ed9', 'request_id': 'req-369eee2f-7dea-4413-a6a1-476d44f36def'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:49.383716 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-369eee2f-7dea-4413-a6a1-476d44f36def tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] The token cache is being invalidate because project 0844ba8714634370abe6542862498ed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:07:49.384021 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-369eee2f-7dea-4413-a6a1-476d44f36def tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:49.385407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-369eee2f-7dea-4413-a6a1-476d44f36def tempest-QuotasNegativeTest-113863895 tempest-QuotasNegativeTest-113863895-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:49.394399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a2870-d2aa-4c25-9d88-b50f216be0d4 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:49.396773 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3b1a2870-d2aa-4c25-9d88-b50f216be0d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:49.410421 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1071/2107] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:07:49 2022] DELETE /identity/v3/projects/0844ba8714634370abe6542862498ed9 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:49.513924 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a2870-d2aa-4c25-9d88-b50f216be0d4 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:49.606166 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea770cc-f3b2-48eb-a7aa-1c5d5c1dc726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:49.607295 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea770cc-f3b2-48eb-a7aa-1c5d5c1dc726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:49.607548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea770cc-f3b2-48eb-a7aa-1c5d5c1dc726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:49.607828 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea770cc-f3b2-48eb-a7aa-1c5d5c1dc726 admin admin] PATH_INFO: `/v3/users/3a2e5c757efa40818ee741bc417a75df` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:49.609395 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea770cc-f3b2-48eb-a7aa-1c5d5c1dc726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a2e5c757efa40818ee741bc417a75df)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:49.613116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea770cc-f3b2-48eb-a7aa-1c5d5c1dc726 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:49.650215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:49.712088 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3ea770cc-f3b2-48eb-a7aa-1c5d5c1dc726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a2e5c757efa40818ee741bc417a75df'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:49.725708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3ea770cc-f3b2-48eb-a7aa-1c5d5c1dc726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a2e5c757efa40818ee741bc417a75df'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:49.779983 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3ea770cc-f3b2-48eb-a7aa-1c5d5c1dc726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a2e5c757efa40818ee741bc417a75df'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:49.781301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3ea770cc-f3b2-48eb-a7aa-1c5d5c1dc726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a2e5c757efa40818ee741bc417a75df'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:49.797574 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3ea770cc-f3b2-48eb-a7aa-1c5d5c1dc726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a2e5c757efa40818ee741bc417a75df'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:49.816967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e99d98-5e4c-48a1-81a4-0983418b42df None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:49.819426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e99d98-5e4c-48a1-81a4-0983418b42df None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:49.820094 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e99d98-5e4c-48a1-81a4-0983418b42df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:49.822791 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1037/2108] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:07:49 2022] DELETE /identity/v3/users/3a2e5c757efa40818ee741bc417a75df => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:49.853292 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-68e99d98-5e4c-48a1-81a4-0983418b42df None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:07:49.855454 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-68e99d98-5e4c-48a1-81a4-0983418b42df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:50.058193 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1072/2109] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:07:50.268544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea770cc-f3b2-48eb-a7aa-1c5d5c1dc726 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:50.271172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3ea770cc-f3b2-48eb-a7aa-1c5d5c1dc726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:50.383327 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea770cc-f3b2-48eb-a7aa-1c5d5c1dc726 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:50.389542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ebc21-0be3-4b8a-b854-1e0baeea8c0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:50.391355 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ebc21-0be3-4b8a-b854-1e0baeea8c0b service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:50.391744 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ebc21-0be3-4b8a-b854-1e0baeea8c0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:50.392340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ebc21-0be3-4b8a-b854-1e0baeea8c0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:50.466679 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ebc21-0be3-4b8a-b854-1e0baeea8c0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:50.470739 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ebc21-0be3-4b8a-b854-1e0baeea8c0b service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:50.486220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1038/2110] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:07:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:07:52.263776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e99d98-5e4c-48a1-81a4-0983418b42df None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:52.265378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-68e99d98-5e4c-48a1-81a4-0983418b42df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:52.278766 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e99d98-5e4c-48a1-81a4-0983418b42df None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:52.284530 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94545809-0ddf-41de-8fab-830e036b55a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:52.285955 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94545809-0ddf-41de-8fab-830e036b55a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:52.286460 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94545809-0ddf-41de-8fab-830e036b55a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:52.286968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94545809-0ddf-41de-8fab-830e036b55a4 admin admin] PATH_INFO: `/v3/projects/de22eff028694701b5d3374bc02c4829` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:52.288531 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94545809-0ddf-41de-8fab-830e036b55a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de22eff028694701b5d3374bc02c4829)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:52.290916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94545809-0ddf-41de-8fab-830e036b55a4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:52.342514 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:52.383700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-94545809-0ddf-41de-8fab-830e036b55a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de22eff028694701b5d3374bc02c4829', 'request_id': 'req-94545809-0ddf-41de-8fab-830e036b55a4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:52.394023 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-94545809-0ddf-41de-8fab-830e036b55a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de22eff028694701b5d3374bc02c4829', 'request_id': 'req-94545809-0ddf-41de-8fab-830e036b55a4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:52.402937 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-94545809-0ddf-41de-8fab-830e036b55a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de22eff028694701b5d3374bc02c4829', 'request_id': 'req-94545809-0ddf-41de-8fab-830e036b55a4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:52.430426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-94545809-0ddf-41de-8fab-830e036b55a4 admin admin] The token cache is being invalidate because project de22eff028694701b5d3374bc02c4829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:07:52.430854 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-94545809-0ddf-41de-8fab-830e036b55a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:52.431739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-94545809-0ddf-41de-8fab-830e036b55a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:52.436116 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1073/2111] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:07:52 2022] DELETE /identity/v3/projects/de22eff028694701b5d3374bc02c4829 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:07:52.446488 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ebc21-0be3-4b8a-b854-1e0baeea8c0b service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:52.457642 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ebc21-0be3-4b8a-b854-1e0baeea8c0b service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:52.599915 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e71c2-c887-42fa-8b4b-a4fefff3a553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:52.602950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e71c2-c887-42fa-8b4b-a4fefff3a553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:52.603632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e71c2-c887-42fa-8b4b-a4fefff3a553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:52.604446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e71c2-c887-42fa-8b4b-a4fefff3a553 admin admin] PATH_INFO: `/v3/users/a6672946d6194fdca2bc8f7a308b8a7c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:52.606976 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e71c2-c887-42fa-8b4b-a4fefff3a553 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6672946d6194fdca2bc8f7a308b8a7c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:52.609302 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e71c2-c887-42fa-8b4b-a4fefff3a553 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:52.735335 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:52.759772 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-be7e71c2-c887-42fa-8b4b-a4fefff3a553 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6672946d6194fdca2bc8f7a308b8a7c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:52.778039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-be7e71c2-c887-42fa-8b4b-a4fefff3a553 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6672946d6194fdca2bc8f7a308b8a7c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:52.815254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-be7e71c2-c887-42fa-8b4b-a4fefff3a553 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6672946d6194fdca2bc8f7a308b8a7c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:52.817763 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-be7e71c2-c887-42fa-8b4b-a4fefff3a553 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6672946d6194fdca2bc8f7a308b8a7c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:52.838778 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-be7e71c2-c887-42fa-8b4b-a4fefff3a553 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6672946d6194fdca2bc8f7a308b8a7c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:52.856836 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1039/2112] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:07:52 2022] DELETE /identity/v3/users/a6672946d6194fdca2bc8f7a308b8a7c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:07:55.904780 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94545809-0ddf-41de-8fab-830e036b55a4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:55.906479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-94545809-0ddf-41de-8fab-830e036b55a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:55.929084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94545809-0ddf-41de-8fab-830e036b55a4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:56.112063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd003b-7f69-4784-aa0b-8a1e48dd4cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:56.113625 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd003b-7f69-4784-aa0b-8a1e48dd4cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:56.114159 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd003b-7f69-4784-aa0b-8a1e48dd4cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:56.114702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd003b-7f69-4784-aa0b-8a1e48dd4cda admin admin] PATH_INFO: `/v3/projects/60297674311d4fb4805842a5cac16107` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:56.117238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd003b-7f69-4784-aa0b-8a1e48dd4cda admin admin] RBAC: Authorizing `identity:delete_project(project_id=60297674311d4fb4805842a5cac16107)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:56.120909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd003b-7f69-4784-aa0b-8a1e48dd4cda admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:56.233979 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-86bd003b-7f69-4784-aa0b-8a1e48dd4cda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60297674311d4fb4805842a5cac16107', 'request_id': 'req-86bd003b-7f69-4784-aa0b-8a1e48dd4cda'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:56.246786 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-86bd003b-7f69-4784-aa0b-8a1e48dd4cda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60297674311d4fb4805842a5cac16107', 'request_id': 'req-86bd003b-7f69-4784-aa0b-8a1e48dd4cda'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:56.282035 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-86bd003b-7f69-4784-aa0b-8a1e48dd4cda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60297674311d4fb4805842a5cac16107', 'request_id': 'req-86bd003b-7f69-4784-aa0b-8a1e48dd4cda'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:56.311076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-86bd003b-7f69-4784-aa0b-8a1e48dd4cda admin admin] The token cache is being invalidate because project 60297674311d4fb4805842a5cac16107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:07:56.311560 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-86bd003b-7f69-4784-aa0b-8a1e48dd4cda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:56.313548 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-86bd003b-7f69-4784-aa0b-8a1e48dd4cda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:07:56.319472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1074/2113] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:07:55 2022] DELETE /identity/v3/projects/60297674311d4fb4805842a5cac16107 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:56.324462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e550d6a-a9cb-4c51-b7a9-47e10137c3f8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:56.325007 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e550d6a-a9cb-4c51-b7a9-47e10137c3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:56.325087 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e550d6a-a9cb-4c51-b7a9-47e10137c3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:56.362133 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8e550d6a-a9cb-4c51-b7a9-47e10137c3f8 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:07:56.364008 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8e550d6a-a9cb-4c51-b7a9-47e10137c3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:56.547735 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1040/2114] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:07:56.557053 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1b4e3-5168-44a9-98d1-d31b7a8b5f59 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:56.557348 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1b4e3-5168-44a9-98d1-d31b7a8b5f59 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:56.557653 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1b4e3-5168-44a9-98d1-d31b7a8b5f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:56.601374 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c1b1b4e3-5168-44a9-98d1-d31b7a8b5f59 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:07:56.602698 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c1b1b4e3-5168-44a9-98d1-d31b7a8b5f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:56.619843 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1075/2115] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:07:56.623863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e550d6a-a9cb-4c51-b7a9-47e10137c3f8 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:56.642374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e550d6a-a9cb-4c51-b7a9-47e10137c3f8 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:56.656037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836ec37-685c-4cd9-add3-484059885815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:56.658407 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836ec37-685c-4cd9-add3-484059885815 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:56.658734 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836ec37-685c-4cd9-add3-484059885815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:56.659963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836ec37-685c-4cd9-add3-484059885815 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:56.662207 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836ec37-685c-4cd9-add3-484059885815 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:07:56.663696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836ec37-685c-4cd9-add3-484059885815 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:56.665754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836ec37-685c-4cd9-add3-484059885815 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:56.693764 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1041/2116] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:07:56.698534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1b4e3-5168-44a9-98d1-d31b7a8b5f59 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:56.713116 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1b4e3-5168-44a9-98d1-d31b7a8b5f59 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:56.728238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1586117-4ea7-49de-b4a6-7254f1a76d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:56.728238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1586117-4ea7-49de-b4a6-7254f1a76d0a admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:56.728238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1586117-4ea7-49de-b4a6-7254f1a76d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:56.728238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1586117-4ea7-49de-b4a6-7254f1a76d0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:56.728637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1586117-4ea7-49de-b4a6-7254f1a76d0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:56.728637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1586117-4ea7-49de-b4a6-7254f1a76d0a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:56.793676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1076/2117] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:07:56 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:07:56.797618 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836ec37-685c-4cd9-add3-484059885815 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:56.812491 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836ec37-685c-4cd9-add3-484059885815 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:56.907113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38058b-224c-44a0-8452-6ba2f22d2f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:56.907913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38058b-224c-44a0-8452-6ba2f22d2f4e admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:56.908463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38058b-224c-44a0-8452-6ba2f22d2f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:56.908946 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38058b-224c-44a0-8452-6ba2f22d2f4e admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:56.909905 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38058b-224c-44a0-8452-6ba2f22d2f4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:56.912262 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38058b-224c-44a0-8452-6ba2f22d2f4e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:56.945790 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1042/2118] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:07:56 2022] POST /identity/v3/users => generated 285 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:07:56.947439 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1586117-4ea7-49de-b4a6-7254f1a76d0a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:56.959139 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1586117-4ea7-49de-b4a6-7254f1a76d0a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:56.964606 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf385ef-c85c-4ae8-a2e0-da5248bf20f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:56.965706 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf385ef-c85c-4ae8-a2e0-da5248bf20f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:56.966236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf385ef-c85c-4ae8-a2e0-da5248bf20f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:56.966745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf385ef-c85c-4ae8-a2e0-da5248bf20f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:56.968022 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf385ef-c85c-4ae8-a2e0-da5248bf20f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:56.969993 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf385ef-c85c-4ae8-a2e0-da5248bf20f6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:57.015757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1077/2119] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:07:57.017701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38058b-224c-44a0-8452-6ba2f22d2f4e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:57.054859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38058b-224c-44a0-8452-6ba2f22d2f4e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:57.065941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ef164-4a5b-4420-a871-42542e1848ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:57.068094 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ef164-4a5b-4420-a871-42542e1848ab admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:57.069754 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ef164-4a5b-4420-a871-42542e1848ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:57.070273 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ef164-4a5b-4420-a871-42542e1848ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:57.074220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ef164-4a5b-4420-a871-42542e1848ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:57.077213 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ef164-4a5b-4420-a871-42542e1848ab admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:57.101184 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1043/2120] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:07:57.106224 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf385ef-c85c-4ae8-a2e0-da5248bf20f6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:57.120861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf385ef-c85c-4ae8-a2e0-da5248bf20f6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:57.136993 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3531f-f22c-4f46-b4da-5a5841f7e183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:57.137911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3531f-f22c-4f46-b4da-5a5841f7e183 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:57.138184 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3531f-f22c-4f46-b4da-5a5841f7e183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:57.138453 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3531f-f22c-4f46-b4da-5a5841f7e183 admin admin] PATH_INFO: `/v3/projects/b11c82f33768465595cbf5fdd9d446f5/users/8ed5317fc35e47d9bd6740b6e0c2622c/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:57.142554 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:57.182513 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3531f-f22c-4f46-b4da-5a5841f7e183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b11c82f33768465595cbf5fdd9d446f5, user_id=8ed5317fc35e47d9bd6740b6e0c2622c, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:57.185562 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3531f-f22c-4f46-b4da-5a5841f7e183 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:57.206324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1078/2121] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:07:57 2022] PUT /identity/v3/projects/b11c82f33768465595cbf5fdd9d446f5/users/8ed5317fc35e47d9bd6740b6e0c2622c/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:07:57.217577 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15c49c-6065-405f-ac9f-6bfc744c5288 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:57.217900 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15c49c-6065-405f-ac9f-6bfc744c5288 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:57.218154 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15c49c-6065-405f-ac9f-6bfc744c5288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:57.272485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5a15c49c-6065-405f-ac9f-6bfc744c5288 None None] MFA Rules not processed for user `8ed5317fc35e47d9bd6740b6e0c2622c`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:07:57.274143 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5a15c49c-6065-405f-ac9f-6bfc744c5288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:57.281836 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:57.398930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3531f-f22c-4f46-b4da-5a5841f7e183 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:57.401379 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1044/2122] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:07:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:07:57.490896 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3531f-f22c-4f46-b4da-5a5841f7e183 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:57.503171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ea1ab-ac65-446d-8728-d98160b51168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:57.507638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ea1ab-ac65-446d-8728-d98160b51168 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:57.508768 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ea1ab-ac65-446d-8728-d98160b51168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:57.509258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ea1ab-ac65-446d-8728-d98160b51168 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:57.511510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ea1ab-ac65-446d-8728-d98160b51168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:57.517087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ea1ab-ac65-446d-8728-d98160b51168 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:57.592818 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1079/2123] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:07:57 2022] POST /identity/v3/projects => generated 369 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:07:57.595745 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15c49c-6065-405f-ac9f-6bfc744c5288 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:57.629060 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15c49c-6065-405f-ac9f-6bfc744c5288 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:57.783900 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7b3d8-0839-48ce-9cfb-417900d676ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:57.786076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7b3d8-0839-48ce-9cfb-417900d676ee admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:57.786472 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7b3d8-0839-48ce-9cfb-417900d676ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:57.786835 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7b3d8-0839-48ce-9cfb-417900d676ee admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:57.787519 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7b3d8-0839-48ce-9cfb-417900d676ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:57.790078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7b3d8-0839-48ce-9cfb-417900d676ee admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:57.854571 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1045/2124] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:07:57 2022] POST /identity/v3/users => generated 291 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:07:57.861548 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ea1ab-ac65-446d-8728-d98160b51168 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:57.906458 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ea1ab-ac65-446d-8728-d98160b51168 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:57.938971 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2d6b3-fde3-41ac-8dca-f8c3bdb0ec89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:57.940289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2d6b3-fde3-41ac-8dca-f8c3bdb0ec89 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:57.941436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2d6b3-fde3-41ac-8dca-f8c3bdb0ec89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:57.942063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2d6b3-fde3-41ac-8dca-f8c3bdb0ec89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:57.944057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2d6b3-fde3-41ac-8dca-f8c3bdb0ec89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:57.950476 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2d6b3-fde3-41ac-8dca-f8c3bdb0ec89 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:58.000408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1080/2125] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:07:58.002242 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7b3d8-0839-48ce-9cfb-417900d676ee admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:58.033427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7b3d8-0839-48ce-9cfb-417900d676ee admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:58.054692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17beba-b77d-4b69-8707-09ffc420219b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:58.056331 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17beba-b77d-4b69-8707-09ffc420219b admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:58.056869 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17beba-b77d-4b69-8707-09ffc420219b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:58.057417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17beba-b77d-4b69-8707-09ffc420219b admin admin] PATH_INFO: `/v3/projects/3cef0a62bd0c455fb8c0ee7c71cac6f4/users/095664c32c324839a375d3fa12c8e704/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:58.129353 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17beba-b77d-4b69-8707-09ffc420219b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cef0a62bd0c455fb8c0ee7c71cac6f4, user_id=095664c32c324839a375d3fa12c8e704, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:58.142284 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17beba-b77d-4b69-8707-09ffc420219b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:58.177990 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1046/2126] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:07:58 2022] PUT /identity/v3/projects/3cef0a62bd0c455fb8c0ee7c71cac6f4/users/095664c32c324839a375d3fa12c8e704/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:58.183858 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2d6b3-fde3-41ac-8dca-f8c3bdb0ec89 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:58.200393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2d6b3-fde3-41ac-8dca-f8c3bdb0ec89 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:58.319556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc20a8-d041-4739-aeea-fd5b1068438b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:58.320976 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc20a8-d041-4739-aeea-fd5b1068438b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:58.321495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc20a8-d041-4739-aeea-fd5b1068438b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:58.321980 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc20a8-d041-4739-aeea-fd5b1068438b admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:58.330006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc20a8-d041-4739-aeea-fd5b1068438b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:58.333672 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc20a8-d041-4739-aeea-fd5b1068438b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:58.368984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1081/2127] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:07:58.374221 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17beba-b77d-4b69-8707-09ffc420219b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:58.409285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17beba-b77d-4b69-8707-09ffc420219b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:58.443128 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4aec6f-d8e9-4a4d-8b33-8ea4f23afeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:58.445155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4aec6f-d8e9-4a4d-8b33-8ea4f23afeec admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:58.445861 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4aec6f-d8e9-4a4d-8b33-8ea4f23afeec admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:58.446721 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4aec6f-d8e9-4a4d-8b33-8ea4f23afeec admin admin] PATH_INFO: `/v3/projects/3cef0a62bd0c455fb8c0ee7c71cac6f4/users/095664c32c324839a375d3fa12c8e704/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:58.457291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4aec6f-d8e9-4a4d-8b33-8ea4f23afeec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cef0a62bd0c455fb8c0ee7c71cac6f4, user_id=095664c32c324839a375d3fa12c8e704, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:58.466798 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4aec6f-d8e9-4a4d-8b33-8ea4f23afeec admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:58.529710 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1047/2128] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:07:58 2022] PUT /identity/v3/projects/3cef0a62bd0c455fb8c0ee7c71cac6f4/users/095664c32c324839a375d3fa12c8e704/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:07:58.544168 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffde80-a0b0-4715-b56a-4f40e7e0f6e0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:58.544803 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffde80-a0b0-4715-b56a-4f40e7e0f6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:58.545267 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffde80-a0b0-4715-b56a-4f40e7e0f6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:58.615172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-feffde80-a0b0-4715-b56a-4f40e7e0f6e0 None None] MFA Rules not processed for user `095664c32c324839a375d3fa12c8e704`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:07:58.617361 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-feffde80-a0b0-4715-b56a-4f40e7e0f6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:58.718540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:58.793010 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1082/2129] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:07:58 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:07:58.832175 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4aec6f-d8e9-4a4d-8b33-8ea4f23afeec admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:07:58.835561 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4e4aec6f-d8e9-4a4d-8b33-8ea4f23afeec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:58.959228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4aec6f-d8e9-4a4d-8b33-8ea4f23afeec admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:07:58.966110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a700d-deaf-4918-9e3e-490ce059c2d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:07:58.966957 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a700d-deaf-4918-9e3e-490ce059c2d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:58.967343 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a700d-deaf-4918-9e3e-490ce059c2d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:58.967657 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a700d-deaf-4918-9e3e-490ce059c2d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:58.984682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a700d-deaf-4918-9e3e-490ce059c2d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:07:58.986218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a700d-deaf-4918-9e3e-490ce059c2d8 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:07:59.002463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1048/2130] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:07:58 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:08:08.784495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=10 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:08.996883 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=94,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:22.141880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffde80-a0b0-4715-b56a-4f40e7e0f6e0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:22.144212 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-feffde80-a0b0-4715-b56a-4f40e7e0f6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:22.388513 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffde80-a0b0-4715-b56a-4f40e7e0f6e0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:22.395082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893b045-0c06-4ed6-b929-0712352fd63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:22.396865 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893b045-0c06-4ed6-b929-0712352fd63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:22.397151 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893b045-0c06-4ed6-b929-0712352fd63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:22.397430 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893b045-0c06-4ed6-b929-0712352fd63a admin admin] PATH_INFO: `/v3/users/df4dac11851440c6a37dcca360c2356c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:22.400217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893b045-0c06-4ed6-b929-0712352fd63a admin admin] RBAC: Authorizing `identity:delete_user(user_id=df4dac11851440c6a37dcca360c2356c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:22.402912 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893b045-0c06-4ed6-b929-0712352fd63a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:22.525200 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4893b045-0c06-4ed6-b929-0712352fd63a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df4dac11851440c6a37dcca360c2356c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:22.545904 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4893b045-0c06-4ed6-b929-0712352fd63a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df4dac11851440c6a37dcca360c2356c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:22.569200 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4893b045-0c06-4ed6-b929-0712352fd63a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df4dac11851440c6a37dcca360c2356c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:22.570916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4893b045-0c06-4ed6-b929-0712352fd63a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df4dac11851440c6a37dcca360c2356c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:22.575471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4893b045-0c06-4ed6-b929-0712352fd63a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df4dac11851440c6a37dcca360c2356c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:22.630055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1083/2131] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:22 2022] DELETE /identity/v3/users/df4dac11851440c6a37dcca360c2356c => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:22.634708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40eae0-a6fe-41ab-8ead-74a20d25e102 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:22.635594 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40eae0-a6fe-41ab-8ead-74a20d25e102 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:22.635594 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40eae0-a6fe-41ab-8ead-74a20d25e102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:22.679628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2e40eae0-a6fe-41ab-8ead-74a20d25e102 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:22.685458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2e40eae0-a6fe-41ab-8ead-74a20d25e102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:22.829335 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1049/2132] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:08:22.853858 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893b045-0c06-4ed6-b929-0712352fd63a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:22.856271 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4893b045-0c06-4ed6-b929-0712352fd63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:22.993127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893b045-0c06-4ed6-b929-0712352fd63a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:23.002151 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649196ad-ae91-48b4-8e6d-fb1329ecfd23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:23.002841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40eae0-a6fe-41ab-8ead-74a20d25e102 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:23.004329 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2e40eae0-a6fe-41ab-8ead-74a20d25e102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:23.004503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649196ad-ae91-48b4-8e6d-fb1329ecfd23 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:23.005916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649196ad-ae91-48b4-8e6d-fb1329ecfd23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:23.007184 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649196ad-ae91-48b4-8e6d-fb1329ecfd23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:23.035124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40eae0-a6fe-41ab-8ead-74a20d25e102 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:23.039772 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649196ad-ae91-48b4-8e6d-fb1329ecfd23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:23.041941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649196ad-ae91-48b4-8e6d-fb1329ecfd23 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:23.043533 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80098ff6-0665-4edf-9789-7b146465ff86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:23.044535 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80098ff6-0665-4edf-9789-7b146465ff86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:23.044847 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80098ff6-0665-4edf-9789-7b146465ff86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:23.045177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80098ff6-0665-4edf-9789-7b146465ff86 admin admin] PATH_INFO: `/v3/users/f1b307a9384144eb96892f0b63f6da6c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:23.047383 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80098ff6-0665-4edf-9789-7b146465ff86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1b307a9384144eb96892f0b63f6da6c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:23.049613 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80098ff6-0665-4edf-9789-7b146465ff86 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:23.058639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1084/2133] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:23.175000 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-80098ff6-0665-4edf-9789-7b146465ff86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1b307a9384144eb96892f0b63f6da6c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:23.213755 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-80098ff6-0665-4edf-9789-7b146465ff86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1b307a9384144eb96892f0b63f6da6c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:23.276047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-80098ff6-0665-4edf-9789-7b146465ff86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1b307a9384144eb96892f0b63f6da6c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:23.282376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-80098ff6-0665-4edf-9789-7b146465ff86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1b307a9384144eb96892f0b63f6da6c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:23.317066 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-80098ff6-0665-4edf-9789-7b146465ff86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1b307a9384144eb96892f0b63f6da6c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:23.333538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1050/2134] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:23 2022] DELETE /identity/v3/users/f1b307a9384144eb96892f0b63f6da6c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:23.340892 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d5834-9206-4f98-a80b-5b55245f7072 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:23.344953 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d5834-9206-4f98-a80b-5b55245f7072 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:23.346182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d5834-9206-4f98-a80b-5b55245f7072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:23.391905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e19d5834-9206-4f98-a80b-5b55245f7072 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:23.397476 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e19d5834-9206-4f98-a80b-5b55245f7072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:23.462427 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:23.530541 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1085/2135] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:23.551146 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80098ff6-0665-4edf-9789-7b146465ff86 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:23.552693 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-80098ff6-0665-4edf-9789-7b146465ff86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:23.691569 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d5834-9206-4f98-a80b-5b55245f7072 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:23.693211 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e19d5834-9206-4f98-a80b-5b55245f7072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:23.720551 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d5834-9206-4f98-a80b-5b55245f7072 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:23.722520 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80098ff6-0665-4edf-9789-7b146465ff86 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:23.725977 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45eca1-7977-42dd-b494-f4adbbc937a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:23.727164 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45eca1-7977-42dd-b494-f4adbbc937a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:23.727628 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45eca1-7977-42dd-b494-f4adbbc937a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:23.727847 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45eca1-7977-42dd-b494-f4adbbc937a0 admin admin] PATH_INFO: `/v3/projects/8cad4a9fbba946faa78732c9b0017dbf` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:23.731783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45eca1-7977-42dd-b494-f4adbbc937a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cad4a9fbba946faa78732c9b0017dbf)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:23.732527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cecfd9-20c8-497b-bed6-7830d2a6112f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:23.734125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45eca1-7977-42dd-b494-f4adbbc937a0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:23.734297 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cecfd9-20c8-497b-bed6-7830d2a6112f service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:23.734696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cecfd9-20c8-497b-bed6-7830d2a6112f service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:23.735203 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cecfd9-20c8-497b-bed6-7830d2a6112f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:23.770753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cecfd9-20c8-497b-bed6-7830d2a6112f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:23.777582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cecfd9-20c8-497b-bed6-7830d2a6112f service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:23.812478 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bd45eca1-7977-42dd-b494-f4adbbc937a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cad4a9fbba946faa78732c9b0017dbf', 'request_id': 'req-bd45eca1-7977-42dd-b494-f4adbbc937a0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:23.821110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bd45eca1-7977-42dd-b494-f4adbbc937a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cad4a9fbba946faa78732c9b0017dbf', 'request_id': 'req-bd45eca1-7977-42dd-b494-f4adbbc937a0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:23.828774 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bd45eca1-7977-42dd-b494-f4adbbc937a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cad4a9fbba946faa78732c9b0017dbf', 'request_id': 'req-bd45eca1-7977-42dd-b494-f4adbbc937a0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:23.836171 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1051/2136] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:23.857124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bd45eca1-7977-42dd-b494-f4adbbc937a0 admin admin] The token cache is being invalidate because project 8cad4a9fbba946faa78732c9b0017dbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:23.859464 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bd45eca1-7977-42dd-b494-f4adbbc937a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:23.861950 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bd45eca1-7977-42dd-b494-f4adbbc937a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:23.866436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1086/2137] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:23 2022] DELETE /identity/v3/projects/8cad4a9fbba946faa78732c9b0017dbf => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:08:23.876225 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb50cb-e17e-4cf4-aa1a-8687b5210632 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:23.878562 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb50cb-e17e-4cf4-aa1a-8687b5210632 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:23.880286 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb50cb-e17e-4cf4-aa1a-8687b5210632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:23.929001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-99cb50cb-e17e-4cf4-aa1a-8687b5210632 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:23.931774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-99cb50cb-e17e-4cf4-aa1a-8687b5210632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:23.965855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:24.121116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1052/2138] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:24.125538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54211668-43ff-43d2-bce6-fed7ca740759 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:24.127043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54211668-43ff-43d2-bce6-fed7ca740759 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:24.127729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54211668-43ff-43d2-bce6-fed7ca740759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:24.162757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-54211668-43ff-43d2-bce6-fed7ca740759 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:24.164742 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-54211668-43ff-43d2-bce6-fed7ca740759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:24.176781 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1087/2139] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:24.184877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb50cb-e17e-4cf4-aa1a-8687b5210632 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:24.206108 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb50cb-e17e-4cf4-aa1a-8687b5210632 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:24.215839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fa308-e59e-4f41-8fdb-7d6ba329b061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:24.217106 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fa308-e59e-4f41-8fdb-7d6ba329b061 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:24.218936 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fa308-e59e-4f41-8fdb-7d6ba329b061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:24.219613 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fa308-e59e-4f41-8fdb-7d6ba329b061 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:24.220575 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fa308-e59e-4f41-8fdb-7d6ba329b061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:08:24.221868 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fa308-e59e-4f41-8fdb-7d6ba329b061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:24.224181 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fa308-e59e-4f41-8fdb-7d6ba329b061 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:24.249220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1053/2140] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:24.250605 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54211668-43ff-43d2-bce6-fed7ca740759 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:24.266094 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54211668-43ff-43d2-bce6-fed7ca740759 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:24.272005 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c0226-03ce-46f7-b0dc-4c43e5141d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:24.272757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c0226-03ce-46f7-b0dc-4c43e5141d8e admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:24.273044 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c0226-03ce-46f7-b0dc-4c43e5141d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:24.273323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c0226-03ce-46f7-b0dc-4c43e5141d8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:24.275264 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c0226-03ce-46f7-b0dc-4c43e5141d8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:24.277547 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c0226-03ce-46f7-b0dc-4c43e5141d8e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:24.333607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1088/2141] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:24 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:24.337527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fa308-e59e-4f41-8fdb-7d6ba329b061 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:24.355893 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fa308-e59e-4f41-8fdb-7d6ba329b061 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:24.529048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c0226-03ce-46f7-b0dc-4c43e5141d8e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:24.531467 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98ba27-a8ac-4af4-91dc-5cbca6a47510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:24.533141 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98ba27-a8ac-4af4-91dc-5cbca6a47510 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:24.533344 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1c5c0226-03ce-46f7-b0dc-4c43e5141d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:24.534189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98ba27-a8ac-4af4-91dc-5cbca6a47510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:24.534935 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98ba27-a8ac-4af4-91dc-5cbca6a47510 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:24.536532 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98ba27-a8ac-4af4-91dc-5cbca6a47510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:24.541464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98ba27-a8ac-4af4-91dc-5cbca6a47510 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:24.585287 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c0226-03ce-46f7-b0dc-4c43e5141d8e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:24.599465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1054/2142] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:24 2022] POST /identity/v3/users => generated 290 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:24.604257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98ba27-a8ac-4af4-91dc-5cbca6a47510 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:24.606602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb98d24-fc80-4be0-aa26-0353c38f00ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:24.608530 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb98d24-fc80-4be0-aa26-0353c38f00ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:24.608530 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb98d24-fc80-4be0-aa26-0353c38f00ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:24.609845 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb98d24-fc80-4be0-aa26-0353c38f00ae admin admin] PATH_INFO: `/v3/projects/764069a29a7f4a2381c4eac510298c1c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:24.616505 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb98d24-fc80-4be0-aa26-0353c38f00ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=764069a29a7f4a2381c4eac510298c1c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:24.626857 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb98d24-fc80-4be0-aa26-0353c38f00ae admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:24.655312 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98ba27-a8ac-4af4-91dc-5cbca6a47510 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:24.686611 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0bcde-4d9b-49a5-b576-9a2a1de08d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:24.690233 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0bcde-4d9b-49a5-b576-9a2a1de08d13 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:24.691491 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0bcde-4d9b-49a5-b576-9a2a1de08d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:24.698315 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0bcde-4d9b-49a5-b576-9a2a1de08d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:24.700624 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0bcde-4d9b-49a5-b576-9a2a1de08d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:24.712770 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0bcde-4d9b-49a5-b576-9a2a1de08d13 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:24.769888 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1055/2143] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:24.793570 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0bcde-4d9b-49a5-b576-9a2a1de08d13 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:24.800096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-54c0bcde-4d9b-49a5-b576-9a2a1de08d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:24.842493 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0bcde-4d9b-49a5-b576-9a2a1de08d13 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:24.873955 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aeb98d24-fc80-4be0-aa26-0353c38f00ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '764069a29a7f4a2381c4eac510298c1c', 'request_id': 'req-aeb98d24-fc80-4be0-aa26-0353c38f00ae'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:24.895475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aeb98d24-fc80-4be0-aa26-0353c38f00ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '764069a29a7f4a2381c4eac510298c1c', 'request_id': 'req-aeb98d24-fc80-4be0-aa26-0353c38f00ae'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:24.911909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aeb98d24-fc80-4be0-aa26-0353c38f00ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '764069a29a7f4a2381c4eac510298c1c', 'request_id': 'req-aeb98d24-fc80-4be0-aa26-0353c38f00ae'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:24.928902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:24.960427 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aeb98d24-fc80-4be0-aa26-0353c38f00ae admin admin] The token cache is being invalidate because project 764069a29a7f4a2381c4eac510298c1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:24.961045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aeb98d24-fc80-4be0-aa26-0353c38f00ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:24.962501 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aeb98d24-fc80-4be0-aa26-0353c38f00ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:24.965846 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1089/2144] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:24 2022] DELETE /identity/v3/projects/764069a29a7f4a2381c4eac510298c1c => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:24.967919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb98d24-fc80-4be0-aa26-0353c38f00ae admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:24.969851 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-aeb98d24-fc80-4be0-aa26-0353c38f00ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:25.005257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0c276-bf58-4c74-a2c7-9e57c0197a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:25.006206 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0c276-bf58-4c74-a2c7-9e57c0197a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:25.006497 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0c276-bf58-4c74-a2c7-9e57c0197a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:25.006782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0c276-bf58-4c74-a2c7-9e57c0197a1d admin admin] PATH_INFO: `/v3/users/5dbd5052e2714023aba14ca813f27e1e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:25.009869 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0c276-bf58-4c74-a2c7-9e57c0197a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dbd5052e2714023aba14ca813f27e1e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:25.015667 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0c276-bf58-4c74-a2c7-9e57c0197a1d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:25.082850 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:25.142648 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb98d24-fc80-4be0-aa26-0353c38f00ae admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:25.146964 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6cc0c276-bf58-4c74-a2c7-9e57c0197a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dbd5052e2714023aba14ca813f27e1e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:25.151557 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d73e4-5621-4054-8fa7-e181d8c5e6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:25.153040 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d73e4-5621-4054-8fa7-e181d8c5e6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:25.153610 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d73e4-5621-4054-8fa7-e181d8c5e6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:25.154183 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d73e4-5621-4054-8fa7-e181d8c5e6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:25.155676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d73e4-5621-4054-8fa7-e181d8c5e6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:25.159034 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d73e4-5621-4054-8fa7-e181d8c5e6d0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:25.167334 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6cc0c276-bf58-4c74-a2c7-9e57c0197a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dbd5052e2714023aba14ca813f27e1e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:25.181235 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1090/2145] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:25.184401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b821f41-7370-40cd-8a78-7516ecffd467 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:25.185492 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b821f41-7370-40cd-8a78-7516ecffd467 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:25.185633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b821f41-7370-40cd-8a78-7516ecffd467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:25.195573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6cc0c276-bf58-4c74-a2c7-9e57c0197a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dbd5052e2714023aba14ca813f27e1e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:25.196281 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6cc0c276-bf58-4c74-a2c7-9e57c0197a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dbd5052e2714023aba14ca813f27e1e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:25.221466 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6cc0c276-bf58-4c74-a2c7-9e57c0197a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dbd5052e2714023aba14ca813f27e1e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:25.232002 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1056/2146] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:24 2022] DELETE /identity/v3/users/5dbd5052e2714023aba14ca813f27e1e => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:25.232002 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0c276-bf58-4c74-a2c7-9e57c0197a1d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:25.232002 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6cc0c276-bf58-4c74-a2c7-9e57c0197a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:25.245056 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8b821f41-7370-40cd-8a78-7516ecffd467 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:25.247040 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8b821f41-7370-40cd-8a78-7516ecffd467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:25.385830 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0c276-bf58-4c74-a2c7-9e57c0197a1d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:25.392000 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54648f8-dcb5-4078-8677-1028bb189089 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095664c32c324839a375d3fa12c8e704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cef0a62bd0c455fb8c0ee7c71cac6f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:25.392802 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54648f8-dcb5-4078-8677-1028bb189089 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:25.393033 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54648f8-dcb5-4078-8677-1028bb189089 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:25.393361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54648f8-dcb5-4078-8677-1028bb189089 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:25.396774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54648f8-dcb5-4078-8677-1028bb189089 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:08:25.396774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54648f8-dcb5-4078-8677-1028bb189089 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:25.396774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54648f8-dcb5-4078-8677-1028bb189089 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:25.444192 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1057/2147] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:25.444192 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54648f8-dcb5-4078-8677-1028bb189089 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:25.452140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f54648f8-dcb5-4078-8677-1028bb189089 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:25.465216 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1091/2148] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:25.466385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd702cd4-67f4-408d-aaea-55834a976124 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:25.466708 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd702cd4-67f4-408d-aaea-55834a976124 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:25.466982 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd702cd4-67f4-408d-aaea-55834a976124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:25.503260 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54648f8-dcb5-4078-8677-1028bb189089 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:25.522604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304d11f-fae4-46ee-834e-90b39d610e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:25.524663 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304d11f-fae4-46ee-834e-90b39d610e69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:25.529779 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304d11f-fae4-46ee-834e-90b39d610e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:25.530567 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304d11f-fae4-46ee-834e-90b39d610e69 admin admin] PATH_INFO: `/v3/projects/ba0142145c80430c924113fbaae07ba5/users/c83195bd720846fc8ed75aedd152a505/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:25.554213 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-cd702cd4-67f4-408d-aaea-55834a976124 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:25.558175 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cd702cd4-67f4-408d-aaea-55834a976124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:25.594103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1092/2149] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:25.595499 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd702cd4-67f4-408d-aaea-55834a976124 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:25.597177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304d11f-fae4-46ee-834e-90b39d610e69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba0142145c80430c924113fbaae07ba5, user_id=c83195bd720846fc8ed75aedd152a505, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:25.602970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304d11f-fae4-46ee-834e-90b39d610e69 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:25.638219 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1058/2150] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:25 2022] PUT /identity/v3/projects/ba0142145c80430c924113fbaae07ba5/users/c83195bd720846fc8ed75aedd152a505/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:25.643671 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c25b4-ff10-42d7-8f74-f3be0ec068f5 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:25.644038 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c25b4-ff10-42d7-8f74-f3be0ec068f5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:25.644331 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c25b4-ff10-42d7-8f74-f3be0ec068f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:25.645422 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd702cd4-67f4-408d-aaea-55834a976124 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:25.694976 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-027c25b4-ff10-42d7-8f74-f3be0ec068f5 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:25.696403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-027c25b4-ff10-42d7-8f74-f3be0ec068f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:25.877276 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1059/2151] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:25.880482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c25b4-ff10-42d7-8f74-f3be0ec068f5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:25.882458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-027c25b4-ff10-42d7-8f74-f3be0ec068f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:25.895238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3008e9a-4410-4a3f-b6e5-376f53516bdf tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095664c32c324839a375d3fa12c8e704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cef0a62bd0c455fb8c0ee7c71cac6f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:25.903205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3008e9a-4410-4a3f-b6e5-376f53516bdf tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:25.904193 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3008e9a-4410-4a3f-b6e5-376f53516bdf tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:25.905094 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3008e9a-4410-4a3f-b6e5-376f53516bdf tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:25.906601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3008e9a-4410-4a3f-b6e5-376f53516bdf tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:25.913135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3008e9a-4410-4a3f-b6e5-376f53516bdf tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:25.931685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:25.980896 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1093/2152] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:25 2022] POST /identity/v3/projects => generated 348 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:25.986213 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c6e13-afd4-41cf-b182-80adb1272172 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:25.986589 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c6e13-afd4-41cf-b182-80adb1272172 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:25.986870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c6e13-afd4-41cf-b182-80adb1272172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:26.043894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f68c6e13-afd4-41cf-b182-80adb1272172 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:26.045421 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f68c6e13-afd4-41cf-b182-80adb1272172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:26.091862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:26.100971 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c25b4-ff10-42d7-8f74-f3be0ec068f5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:26.240415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37085547-4d26-4ed6-a619-84e375ff6c77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:26.243030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37085547-4d26-4ed6-a619-84e375ff6c77 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:26.243609 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37085547-4d26-4ed6-a619-84e375ff6c77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:26.244149 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37085547-4d26-4ed6-a619-84e375ff6c77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:26.288295 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1094/2153] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:26.290045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c6e13-afd4-41cf-b182-80adb1272172 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:26.326059 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c6e13-afd4-41cf-b182-80adb1272172 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:26.346306 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c000c-8f83-4bba-8a10-4a7f6e61fda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:26.347694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c000c-8f83-4bba-8a10-4a7f6e61fda2 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:26.348588 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c000c-8f83-4bba-8a10-4a7f6e61fda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:26.349502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c000c-8f83-4bba-8a10-4a7f6e61fda2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:26.350527 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c000c-8f83-4bba-8a10-4a7f6e61fda2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:08:26.350993 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c000c-8f83-4bba-8a10-4a7f6e61fda2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:26.355119 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c000c-8f83-4bba-8a10-4a7f6e61fda2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:26.374337 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1095/2154] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:26.376057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c000c-8f83-4bba-8a10-4a7f6e61fda2 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:26.464217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37085547-4d26-4ed6-a619-84e375ff6c77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:26.466553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37085547-4d26-4ed6-a619-84e375ff6c77 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:26.501112 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c000c-8f83-4bba-8a10-4a7f6e61fda2 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:26.501439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1060/2155] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:26.502094 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37085547-4d26-4ed6-a619-84e375ff6c77 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:26.509096 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dfef0-5c5d-4a4e-85a3-71efcfa88e1d tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095664c32c324839a375d3fa12c8e704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cef0a62bd0c455fb8c0ee7c71cac6f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:26.509875 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dfef0-5c5d-4a4e-85a3-71efcfa88e1d tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:26.510162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dfef0-5c5d-4a4e-85a3-71efcfa88e1d tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:26.510447 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dfef0-5c5d-4a4e-85a3-71efcfa88e1d tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:26.511397 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30dfef0-5c5d-4a4e-85a3-71efcfa88e1d tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:08:26.511714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30dfef0-5c5d-4a4e-85a3-71efcfa88e1d tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:26.514178 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30dfef0-5c5d-4a4e-85a3-71efcfa88e1d tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:26.522047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37085547-4d26-4ed6-a619-84e375ff6c77 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:26.537493 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1096/2156] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:26.538933 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dfef0-5c5d-4a4e-85a3-71efcfa88e1d tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:26.539349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21016212-a6ee-4e9c-9cea-4daf101c7ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:26.540152 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21016212-a6ee-4e9c-9cea-4daf101c7ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:26.540436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21016212-a6ee-4e9c-9cea-4daf101c7ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:26.540708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21016212-a6ee-4e9c-9cea-4daf101c7ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:26.541465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21016212-a6ee-4e9c-9cea-4daf101c7ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:26.543192 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b30dfef0-5c5d-4a4e-85a3-71efcfa88e1d tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:26.543476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21016212-a6ee-4e9c-9cea-4daf101c7ba7 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:26.559707 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dfef0-5c5d-4a4e-85a3-71efcfa88e1d tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:26.567033 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ee4ba-4528-4ab2-b5a3-9a41b4aa5163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:26.568534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ee4ba-4528-4ab2-b5a3-9a41b4aa5163 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:26.568856 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ee4ba-4528-4ab2-b5a3-9a41b4aa5163 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:26.569171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ee4ba-4528-4ab2-b5a3-9a41b4aa5163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:26.585322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ee4ba-4528-4ab2-b5a3-9a41b4aa5163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:26.588131 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ee4ba-4528-4ab2-b5a3-9a41b4aa5163 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:26.598558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1061/2157] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:26 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:26.603410 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21016212-a6ee-4e9c-9cea-4daf101c7ba7 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:26.604227 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1097/2158] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:26.758297 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21016212-a6ee-4e9c-9cea-4daf101c7ba7 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:26.759466 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:26.765169 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c570b-6d4b-4728-9c55-ed25e160e9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:26.766034 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c570b-6d4b-4728-9c55-ed25e160e9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:26.766545 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c570b-6d4b-4728-9c55-ed25e160e9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:26.767328 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c570b-6d4b-4728-9c55-ed25e160e9b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:26.768190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c570b-6d4b-4728-9c55-ed25e160e9b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:26.770888 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c570b-6d4b-4728-9c55-ed25e160e9b6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:26.807033 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1062/2159] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:26 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:26.807919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ee4ba-4528-4ab2-b5a3-9a41b4aa5163 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:26.825112 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ee4ba-4528-4ab2-b5a3-9a41b4aa5163 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:26.839428 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ea6da-2060-487a-8c90-8634462e7213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:26.840247 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ea6da-2060-487a-8c90-8634462e7213 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:26.840669 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ea6da-2060-487a-8c90-8634462e7213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:26.841053 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ea6da-2060-487a-8c90-8634462e7213 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:26.841929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ea6da-2060-487a-8c90-8634462e7213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:26.844855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ea6da-2060-487a-8c90-8634462e7213 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:26.876160 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1098/2160] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:08:26.878414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c570b-6d4b-4728-9c55-ed25e160e9b6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:26.914118 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c570b-6d4b-4728-9c55-ed25e160e9b6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:26.931959 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba953cc-39fc-4be6-923c-98df0dd02a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:26.933186 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba953cc-39fc-4be6-923c-98df0dd02a10 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:26.933661 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba953cc-39fc-4be6-923c-98df0dd02a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:26.934139 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba953cc-39fc-4be6-923c-98df0dd02a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:26.936168 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba953cc-39fc-4be6-923c-98df0dd02a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:26.938735 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba953cc-39fc-4be6-923c-98df0dd02a10 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:26.986147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1063/2161] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:26.988103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ea6da-2060-487a-8c90-8634462e7213 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:27.019533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ea6da-2060-487a-8c90-8634462e7213 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:27.039411 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2f64d-f9f9-48b6-9243-97305b5c8fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:27.041126 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2f64d-f9f9-48b6-9243-97305b5c8fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:27.041623 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2f64d-f9f9-48b6-9243-97305b5c8fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:27.042987 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2f64d-f9f9-48b6-9243-97305b5c8fd2 admin admin] PATH_INFO: `/v3/projects/c7afb7da3f804e5e899e0ce7c80091f1/users/9db9c89790a345068c9badf5cf4ee981/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:27.094843 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2f64d-f9f9-48b6-9243-97305b5c8fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7afb7da3f804e5e899e0ce7c80091f1, user_id=9db9c89790a345068c9badf5cf4ee981, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:27.098984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2f64d-f9f9-48b6-9243-97305b5c8fd2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:27.139323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1099/2162] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:26 2022] PUT /identity/v3/projects/c7afb7da3f804e5e899e0ce7c80091f1/users/9db9c89790a345068c9badf5cf4ee981/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:27.152512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53da59b-7a76-445f-ae40-3bae72c8ef1f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:27.152884 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53da59b-7a76-445f-ae40-3bae72c8ef1f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:27.153296 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53da59b-7a76-445f-ae40-3bae72c8ef1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:27.220028 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d53da59b-7a76-445f-ae40-3bae72c8ef1f None None] MFA Rules not processed for user `9db9c89790a345068c9badf5cf4ee981`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:27.222777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d53da59b-7a76-445f-ae40-3bae72c8ef1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:27.425910 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1064/2163] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:08:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:27.463518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2f64d-f9f9-48b6-9243-97305b5c8fd2 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:27.656877 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:27.670230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2f64d-f9f9-48b6-9243-97305b5c8fd2 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:27.679896 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f513ced-78e9-4300-b55c-1f49914bb222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:27.682303 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f513ced-78e9-4300-b55c-1f49914bb222 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:27.685212 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f513ced-78e9-4300-b55c-1f49914bb222 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:27.685212 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f513ced-78e9-4300-b55c-1f49914bb222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:27.718459 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f513ced-78e9-4300-b55c-1f49914bb222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:27.720793 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f513ced-78e9-4300-b55c-1f49914bb222 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:27.736231 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1100/2164] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:27.763035 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53da59b-7a76-445f-ae40-3bae72c8ef1f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:27.765771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d53da59b-7a76-445f-ae40-3bae72c8ef1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:27.942773 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53da59b-7a76-445f-ae40-3bae72c8ef1f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:27.969155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec3012-e1bd-419f-b7be-1195fc5cb1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:27.971870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec3012-e1bd-419f-b7be-1195fc5cb1c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:27.972412 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec3012-e1bd-419f-b7be-1195fc5cb1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:27.973479 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec3012-e1bd-419f-b7be-1195fc5cb1c1 admin admin] PATH_INFO: `/v3/projects/d0042f2c34614d1190aaf65ef3ee8b86` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:27.978930 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec3012-e1bd-419f-b7be-1195fc5cb1c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0042f2c34614d1190aaf65ef3ee8b86)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:27.985456 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec3012-e1bd-419f-b7be-1195fc5cb1c1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:28.132099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-02ec3012-e1bd-419f-b7be-1195fc5cb1c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0042f2c34614d1190aaf65ef3ee8b86', 'request_id': 'req-02ec3012-e1bd-419f-b7be-1195fc5cb1c1'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:28.164269 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-02ec3012-e1bd-419f-b7be-1195fc5cb1c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0042f2c34614d1190aaf65ef3ee8b86', 'request_id': 'req-02ec3012-e1bd-419f-b7be-1195fc5cb1c1'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:28.188853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-02ec3012-e1bd-419f-b7be-1195fc5cb1c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0042f2c34614d1190aaf65ef3ee8b86', 'request_id': 'req-02ec3012-e1bd-419f-b7be-1195fc5cb1c1'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:28.193344 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:28.240553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-02ec3012-e1bd-419f-b7be-1195fc5cb1c1 admin admin] The token cache is being invalidate because project d0042f2c34614d1190aaf65ef3ee8b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:28.241550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-02ec3012-e1bd-419f-b7be-1195fc5cb1c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:28.243259 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-02ec3012-e1bd-419f-b7be-1195fc5cb1c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:28.259125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1065/2165] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:27 2022] DELETE /identity/v3/projects/d0042f2c34614d1190aaf65ef3ee8b86 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:28.264233 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e687971-b691-447f-a5ff-41a62d785e55 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:28.264601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e687971-b691-447f-a5ff-41a62d785e55 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:28.264991 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e687971-b691-447f-a5ff-41a62d785e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:28.303079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6e687971-b691-447f-a5ff-41a62d785e55 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:28.306231 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6e687971-b691-447f-a5ff-41a62d785e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:28.510731 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1101/2166] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:28.518046 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff109456-9dd9-4b2c-b07e-82cf68571d33 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:28.518516 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff109456-9dd9-4b2c-b07e-82cf68571d33 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:28.518966 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff109456-9dd9-4b2c-b07e-82cf68571d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:28.559175 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ff109456-9dd9-4b2c-b07e-82cf68571d33 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:28.562105 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ff109456-9dd9-4b2c-b07e-82cf68571d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:28.583205 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1066/2167] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:28.591601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e687971-b691-447f-a5ff-41a62d785e55 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:28.615972 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e687971-b691-447f-a5ff-41a62d785e55 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:28.652513 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc46c5-74d2-4395-a9d8-15405f8bb08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:28.654529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc46c5-74d2-4395-a9d8-15405f8bb08b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:28.655255 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc46c5-74d2-4395-a9d8-15405f8bb08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:28.656304 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc46c5-74d2-4395-a9d8-15405f8bb08b admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:28.658775 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc46c5-74d2-4395-a9d8-15405f8bb08b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:08:28.662107 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc46c5-74d2-4395-a9d8-15405f8bb08b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:28.673538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc46c5-74d2-4395-a9d8-15405f8bb08b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:28.711801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1102/2168] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:28.714615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff109456-9dd9-4b2c-b07e-82cf68571d33 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:28.754842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff109456-9dd9-4b2c-b07e-82cf68571d33 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:28.781158 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb140ec0-4fda-4078-b13b-b54c306b1b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:28.782469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb140ec0-4fda-4078-b13b-b54c306b1b99 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:28.783096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb140ec0-4fda-4078-b13b-b54c306b1b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:28.784155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb140ec0-4fda-4078-b13b-b54c306b1b99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:28.788560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb140ec0-4fda-4078-b13b-b54c306b1b99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:28.793169 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb140ec0-4fda-4078-b13b-b54c306b1b99 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:28.903735 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1067/2169] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:28 2022] POST /identity/v3/projects => generated 389 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:28.910146 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc46c5-74d2-4395-a9d8-15405f8bb08b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:28.940967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc46c5-74d2-4395-a9d8-15405f8bb08b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:28.943576 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb140ec0-4fda-4078-b13b-b54c306b1b99 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:28.947094 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cb140ec0-4fda-4078-b13b-b54c306b1b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:29.099801 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb140ec0-4fda-4078-b13b-b54c306b1b99 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:29.115977 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eff72a-9089-4b18-a70b-c9e70ec961d7 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095664c32c324839a375d3fa12c8e704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cef0a62bd0c455fb8c0ee7c71cac6f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:29.122491 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eff72a-9089-4b18-a70b-c9e70ec961d7 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:29.123597 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eff72a-9089-4b18-a70b-c9e70ec961d7 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:29.125274 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eff72a-9089-4b18-a70b-c9e70ec961d7 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] PATH_INFO: `/v3/projects/13f3dc96ec7a425e8b00b336cc638238` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:29.132955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eff72a-9089-4b18-a70b-c9e70ec961d7 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] RBAC: Authorizing `identity:delete_project(project_id=13f3dc96ec7a425e8b00b336cc638238)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:29.139099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eff72a-9089-4b18-a70b-c9e70ec961d7 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:29.139764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69003c51-634a-415f-aaac-c5b14a42cdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:29.141224 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69003c51-634a-415f-aaac-c5b14a42cdf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:29.141808 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69003c51-634a-415f-aaac-c5b14a42cdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:29.142292 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69003c51-634a-415f-aaac-c5b14a42cdf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:29.143737 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69003c51-634a-415f-aaac-c5b14a42cdf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:29.151676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69003c51-634a-415f-aaac-c5b14a42cdf7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:29.257577 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1103/2170] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:28 2022] POST /identity/v3/users => generated 295 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:29.259731 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69003c51-634a-415f-aaac-c5b14a42cdf7 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:29.290374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-53eff72a-9089-4b18-a70b-c9e70ec961d7 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13f3dc96ec7a425e8b00b336cc638238', 'request_id': 'req-53eff72a-9089-4b18-a70b-c9e70ec961d7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:29.300790 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69003c51-634a-415f-aaac-c5b14a42cdf7 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:29.308174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-53eff72a-9089-4b18-a70b-c9e70ec961d7 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13f3dc96ec7a425e8b00b336cc638238', 'request_id': 'req-53eff72a-9089-4b18-a70b-c9e70ec961d7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:29.327183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-53eff72a-9089-4b18-a70b-c9e70ec961d7 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13f3dc96ec7a425e8b00b336cc638238', 'request_id': 'req-53eff72a-9089-4b18-a70b-c9e70ec961d7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:29.358665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-53eff72a-9089-4b18-a70b-c9e70ec961d7 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] The token cache is being invalidate because project 13f3dc96ec7a425e8b00b336cc638238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:29.359407 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-53eff72a-9089-4b18-a70b-c9e70ec961d7 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:29.362053 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-53eff72a-9089-4b18-a70b-c9e70ec961d7 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:29.365508 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1068/2171] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:28 2022] DELETE /identity/v3/projects/13f3dc96ec7a425e8b00b336cc638238 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:29.418174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eff72a-9089-4b18-a70b-c9e70ec961d7 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:29.423765 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-53eff72a-9089-4b18-a70b-c9e70ec961d7 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:29.567346 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99c382-5e0b-465d-a515-b4cf6b51a5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:29.568589 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99c382-5e0b-465d-a515-b4cf6b51a5cd admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:29.569167 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99c382-5e0b-465d-a515-b4cf6b51a5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:29.569624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99c382-5e0b-465d-a515-b4cf6b51a5cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:29.571157 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99c382-5e0b-465d-a515-b4cf6b51a5cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:29.575167 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99c382-5e0b-465d-a515-b4cf6b51a5cd admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:29.676200 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1104/2172] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:29.678526 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99c382-5e0b-465d-a515-b4cf6b51a5cd admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:29.685027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3e99c382-5e0b-465d-a515-b4cf6b51a5cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:29.725291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:29.734902 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eff72a-9089-4b18-a70b-c9e70ec961d7 tempest-RoutersAdminTest-1232443782 tempest-RoutersAdminTest-1232443782-project-admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:29.743363 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6bbd0-6a0d-4f9a-8171-00fce2db406a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:29.743953 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99c382-5e0b-465d-a515-b4cf6b51a5cd admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:29.744540 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6bbd0-6a0d-4f9a-8171-00fce2db406a service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:29.745181 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6bbd0-6a0d-4f9a-8171-00fce2db406a service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:29.745840 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6bbd0-6a0d-4f9a-8171-00fce2db406a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:29.749806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-25a6bbd0-6a0d-4f9a-8171-00fce2db406a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:29.769622 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb04a2-b6f6-49d7-91fb-27863a5d3dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:29.771380 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb04a2-b6f6-49d7-91fb-27863a5d3dde admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:29.771879 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb04a2-b6f6-49d7-91fb-27863a5d3dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:29.772438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb04a2-b6f6-49d7-91fb-27863a5d3dde admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:29.774272 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb04a2-b6f6-49d7-91fb-27863a5d3dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:29.782163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb04a2-b6f6-49d7-91fb-27863a5d3dde admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:29.806735 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:29.844778 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1105/2173] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:29.849134 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb04a2-b6f6-49d7-91fb-27863a5d3dde admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:29.880919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb04a2-b6f6-49d7-91fb-27863a5d3dde admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:29.891553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b41ef5-4af1-4d44-b4dd-4dd5f1971ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:29.893784 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b41ef5-4af1-4d44-b4dd-4dd5f1971ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:29.894597 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b41ef5-4af1-4d44-b4dd-4dd5f1971ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:29.895255 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b41ef5-4af1-4d44-b4dd-4dd5f1971ff8 admin admin] PATH_INFO: `/v3/projects/93081c0496b04f018abf99b8e49e94b7/users/8c640955faf14d759e72494fa9512bc6/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:29.946290 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b41ef5-4af1-4d44-b4dd-4dd5f1971ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93081c0496b04f018abf99b8e49e94b7, user_id=8c640955faf14d759e72494fa9512bc6, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:29.952383 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b41ef5-4af1-4d44-b4dd-4dd5f1971ff8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:29.964759 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6bbd0-6a0d-4f9a-8171-00fce2db406a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:29.968354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6bbd0-6a0d-4f9a-8171-00fce2db406a service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:30.005624 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1069/2174] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:08:30.037290 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1106/2175] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:29 2022] PUT /identity/v3/projects/93081c0496b04f018abf99b8e49e94b7/users/8c640955faf14d759e72494fa9512bc6/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:30.068493 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987046a-d8fc-498a-a75b-97be4b7dc19a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:30.069000 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987046a-d8fc-498a-a75b-97be4b7dc19a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:30.069489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987046a-d8fc-498a-a75b-97be4b7dc19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:30.228802 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c987046a-d8fc-498a-a75b-97be4b7dc19a None None] MFA Rules not processed for user `8c640955faf14d759e72494fa9512bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:30.230136 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c987046a-d8fc-498a-a75b-97be4b7dc19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:30.417020 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1070/2176] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:08:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:08:31.077364 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b41ef5-4af1-4d44-b4dd-4dd5f1971ff8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:31.229613 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b41ef5-4af1-4d44-b4dd-4dd5f1971ff8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:31.242886 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79b0bd-a5e9-4198-adcf-632f11753c48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:31.246723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79b0bd-a5e9-4198-adcf-632f11753c48 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:31.247202 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79b0bd-a5e9-4198-adcf-632f11753c48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:31.247596 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79b0bd-a5e9-4198-adcf-632f11753c48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:31.295238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79b0bd-a5e9-4198-adcf-632f11753c48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:31.296786 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79b0bd-a5e9-4198-adcf-632f11753c48 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:31.326624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1107/2177] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:40.397647 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=55 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:41.310486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:47.759326 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31503aa7-5720-43dc-95d0-f6a4455f4922 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:47.760156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31503aa7-5720-43dc-95d0-f6a4455f4922 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:47.760880 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31503aa7-5720-43dc-95d0-f6a4455f4922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:47.859551 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-31503aa7-5720-43dc-95d0-f6a4455f4922 None None] MFA Rules not processed for user `c83195bd720846fc8ed75aedd152a505`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:47.863748 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-31503aa7-5720-43dc-95d0-f6a4455f4922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:48.109405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1071/2178] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:08:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:08:48.115421 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79b0bd-a5e9-4198-adcf-632f11753c48 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:48.118639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0c79b0bd-a5e9-4198-adcf-632f11753c48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:48.232147 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79b0bd-a5e9-4198-adcf-632f11753c48 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:48.238348 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44d6b2-afa7-46ab-a519-aca7c5a650a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:48.239555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44d6b2-afa7-46ab-a519-aca7c5a650a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:48.239880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44d6b2-afa7-46ab-a519-aca7c5a650a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:48.240259 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44d6b2-afa7-46ab-a519-aca7c5a650a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:48.242253 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44d6b2-afa7-46ab-a519-aca7c5a650a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:48.243830 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44d6b2-afa7-46ab-a519-aca7c5a650a0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:48.285201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1108/2179] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:48 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:08:48.291287 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31503aa7-5720-43dc-95d0-f6a4455f4922 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:48.306314 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31503aa7-5720-43dc-95d0-f6a4455f4922 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:48.446905 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1cdff-8120-43c4-85bd-98433f81a314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:48.447658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1cdff-8120-43c4-85bd-98433f81a314 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:48.447954 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1cdff-8120-43c4-85bd-98433f81a314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:48.448233 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1cdff-8120-43c4-85bd-98433f81a314 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:48.449074 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1cdff-8120-43c4-85bd-98433f81a314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:48.451269 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1cdff-8120-43c4-85bd-98433f81a314 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:48.498191 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1072/2180] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:48 2022] POST /identity/v3/users => generated 295 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:08:48.498694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44d6b2-afa7-46ab-a519-aca7c5a650a0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:48.515721 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44d6b2-afa7-46ab-a519-aca7c5a650a0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:48.536922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b020a0-6ac0-4f20-9193-c7e7fab4deb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:48.539807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b020a0-6ac0-4f20-9193-c7e7fab4deb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:48.540802 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b020a0-6ac0-4f20-9193-c7e7fab4deb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:48.541345 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b020a0-6ac0-4f20-9193-c7e7fab4deb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:48.542364 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b020a0-6ac0-4f20-9193-c7e7fab4deb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:48.545371 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b020a0-6ac0-4f20-9193-c7e7fab4deb8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:48.570580 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1109/2181] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:08:48.574618 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1cdff-8120-43c4-85bd-98433f81a314 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:48.595481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1cdff-8120-43c4-85bd-98433f81a314 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:48.601661 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc6c6c-7de2-435b-ae26-6daf2c97008d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:48.603021 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc6c6c-7de2-435b-ae26-6daf2c97008d admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:48.606133 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc6c6c-7de2-435b-ae26-6daf2c97008d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:48.606671 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc6c6c-7de2-435b-ae26-6daf2c97008d admin admin] PATH_INFO: `/v3/projects/11c20ed8b61943f2bf3d814389229e7f/users/c8c4e32232174c76b74183ca628b5575/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:48.633443 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc6c6c-7de2-435b-ae26-6daf2c97008d admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c20ed8b61943f2bf3d814389229e7f, user_id=c8c4e32232174c76b74183ca628b5575, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:48.639422 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc6c6c-7de2-435b-ae26-6daf2c97008d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:48.665102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1073/2182] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:48 2022] PUT /identity/v3/projects/11c20ed8b61943f2bf3d814389229e7f/users/c8c4e32232174c76b74183ca628b5575/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:48.666030 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b020a0-6ac0-4f20-9193-c7e7fab4deb8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:48.685939 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b020a0-6ac0-4f20-9193-c7e7fab4deb8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:48.868319 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4635f6-e8f2-46bd-bf7d-69742ea31f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:48.870260 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4635f6-e8f2-46bd-bf7d-69742ea31f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:48.870260 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4635f6-e8f2-46bd-bf7d-69742ea31f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:48.870632 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4635f6-e8f2-46bd-bf7d-69742ea31f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:48.872066 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4635f6-e8f2-46bd-bf7d-69742ea31f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:48.878988 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4635f6-e8f2-46bd-bf7d-69742ea31f42 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:48.934782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc6c6c-7de2-435b-ae26-6daf2c97008d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:48.942948 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1110/2183] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:48.959738 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc6c6c-7de2-435b-ae26-6daf2c97008d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:48.974434 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b9451-ec8f-49bd-af33-a1edd23bc56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:48.975950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b9451-ec8f-49bd-af33-a1edd23bc56d admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:48.978145 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b9451-ec8f-49bd-af33-a1edd23bc56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:48.978890 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b9451-ec8f-49bd-af33-a1edd23bc56d admin admin] PATH_INFO: `/v3/projects/11c20ed8b61943f2bf3d814389229e7f/users/c8c4e32232174c76b74183ca628b5575/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:48.983590 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b9451-ec8f-49bd-af33-a1edd23bc56d admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c20ed8b61943f2bf3d814389229e7f, user_id=c8c4e32232174c76b74183ca628b5575, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:48.987277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b9451-ec8f-49bd-af33-a1edd23bc56d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:49.007759 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1074/2184] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:48 2022] PUT /identity/v3/projects/11c20ed8b61943f2bf3d814389229e7f/users/c8c4e32232174c76b74183ca628b5575/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:08:58.908106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=67,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:59.000191 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=76,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:10.153717 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4635f6-e8f2-46bd-bf7d-69742ea31f42 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:10.160073 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6e4635f6-e8f2-46bd-bf7d-69742ea31f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:10.433310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4635f6-e8f2-46bd-bf7d-69742ea31f42 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:10.664425 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d766c-282d-4c31-990f-675e5220a721 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:10.665208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d766c-282d-4c31-990f-675e5220a721 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:10.665462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d766c-282d-4c31-990f-675e5220a721 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:10.665736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d766c-282d-4c31-990f-675e5220a721 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:10.669128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-934d766c-282d-4c31-990f-675e5220a721 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:10.709466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d766c-282d-4c31-990f-675e5220a721 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:10.712273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d766c-282d-4c31-990f-675e5220a721 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:10.743303 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1111/2185] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:14.611302 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a56179-716e-4971-9a6f-4e0e8e1c3ea1 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:14.612122 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a56179-716e-4971-9a6f-4e0e8e1c3ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:14.612351 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a56179-716e-4971-9a6f-4e0e8e1c3ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:14.684003 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f0a56179-716e-4971-9a6f-4e0e8e1c3ea1 None None] MFA Rules not processed for user `c8c4e32232174c76b74183ca628b5575`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:14.686777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f0a56179-716e-4971-9a6f-4e0e8e1c3ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:14.949128 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1075/2186] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:09:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:14.956059 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d766c-282d-4c31-990f-675e5220a721 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:14.959357 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-934d766c-282d-4c31-990f-675e5220a721 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:15.148186 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d766c-282d-4c31-990f-675e5220a721 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:15.155729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d18159-e0db-4dff-b46c-c7503f533866 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:15.157208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d18159-e0db-4dff-b46c-c7503f533866 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:15.157675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d18159-e0db-4dff-b46c-c7503f533866 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:15.158195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d18159-e0db-4dff-b46c-c7503f533866 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:15.233651 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:15.294028 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d18159-e0db-4dff-b46c-c7503f533866 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:15.300259 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d18159-e0db-4dff-b46c-c7503f533866 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:15.332429 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1112/2187] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:17.974032 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a56179-716e-4971-9a6f-4e0e8e1c3ea1 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:17.977315 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f0a56179-716e-4971-9a6f-4e0e8e1c3ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:18.143549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a56179-716e-4971-9a6f-4e0e8e1c3ea1 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:18.150675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9bb08-da56-448e-b68b-9a5a69dab2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:18.152054 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9bb08-da56-448e-b68b-9a5a69dab2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:18.152534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9bb08-da56-448e-b68b-9a5a69dab2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:18.153029 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9bb08-da56-448e-b68b-9a5a69dab2ac admin admin] PATH_INFO: `/v3/users/26954cb2f6eb4184b6488d84a842183b` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:18.154675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9bb08-da56-448e-b68b-9a5a69dab2ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=26954cb2f6eb4184b6488d84a842183b)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:18.157411 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9bb08-da56-448e-b68b-9a5a69dab2ac admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:18.245465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9ba9bb08-da56-448e-b68b-9a5a69dab2ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26954cb2f6eb4184b6488d84a842183b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:18.258496 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9ba9bb08-da56-448e-b68b-9a5a69dab2ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26954cb2f6eb4184b6488d84a842183b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:18.277265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9ba9bb08-da56-448e-b68b-9a5a69dab2ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26954cb2f6eb4184b6488d84a842183b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:18.278480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9ba9bb08-da56-448e-b68b-9a5a69dab2ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26954cb2f6eb4184b6488d84a842183b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:18.288851 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9ba9bb08-da56-448e-b68b-9a5a69dab2ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26954cb2f6eb4184b6488d84a842183b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:18.298416 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1076/2188] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:17 2022] DELETE /identity/v3/users/26954cb2f6eb4184b6488d84a842183b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:18.304396 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5972c-be4a-47a9-b61d-17e66e958df2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:18.305468 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5972c-be4a-47a9-b61d-17e66e958df2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:18.305909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5972c-be4a-47a9-b61d-17e66e958df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:18.328458 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2de5972c-be4a-47a9-b61d-17e66e958df2 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:18.330336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2de5972c-be4a-47a9-b61d-17e66e958df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:18.468797 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1113/2189] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:09:18.537691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9bb08-da56-448e-b68b-9a5a69dab2ac admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:18.541564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9ba9bb08-da56-448e-b68b-9a5a69dab2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:18.558440 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:18.729213 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9bb08-da56-448e-b68b-9a5a69dab2ac admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:18.738033 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d51d1-3499-48bc-b70d-39bc3732d233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:18.739465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d51d1-3499-48bc-b70d-39bc3732d233 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:18.740085 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d51d1-3499-48bc-b70d-39bc3732d233 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:18.740521 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d51d1-3499-48bc-b70d-39bc3732d233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:18.778622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d51d1-3499-48bc-b70d-39bc3732d233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:18.782354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d51d1-3499-48bc-b70d-39bc3732d233 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:18.816973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1077/2190] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:09:20.059613 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5972c-be4a-47a9-b61d-17e66e958df2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:20.063288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2de5972c-be4a-47a9-b61d-17e66e958df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:20.113014 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5972c-be4a-47a9-b61d-17e66e958df2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:20.135059 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06be134-8d75-4573-bfa9-b2464b212fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:20.136941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06be134-8d75-4573-bfa9-b2464b212fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:20.137168 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06be134-8d75-4573-bfa9-b2464b212fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:20.137661 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06be134-8d75-4573-bfa9-b2464b212fd5 admin admin] PATH_INFO: `/v3/projects/8f50ccb20fbe402bab5821760d2fe482` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:20.144568 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06be134-8d75-4573-bfa9-b2464b212fd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f50ccb20fbe402bab5821760d2fe482)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:20.153649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06be134-8d75-4573-bfa9-b2464b212fd5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:20.326071 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f06be134-8d75-4573-bfa9-b2464b212fd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f50ccb20fbe402bab5821760d2fe482', 'request_id': 'req-f06be134-8d75-4573-bfa9-b2464b212fd5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:20.366395 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f06be134-8d75-4573-bfa9-b2464b212fd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f50ccb20fbe402bab5821760d2fe482', 'request_id': 'req-f06be134-8d75-4573-bfa9-b2464b212fd5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:20.387498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f06be134-8d75-4573-bfa9-b2464b212fd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f50ccb20fbe402bab5821760d2fe482', 'request_id': 'req-f06be134-8d75-4573-bfa9-b2464b212fd5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:20.460611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f06be134-8d75-4573-bfa9-b2464b212fd5 admin admin] The token cache is being invalidate because project 8f50ccb20fbe402bab5821760d2fe482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:20.461328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f06be134-8d75-4573-bfa9-b2464b212fd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:20.465301 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f06be134-8d75-4573-bfa9-b2464b212fd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:20.467806 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1114/2191] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:20 2022] DELETE /identity/v3/projects/8f50ccb20fbe402bab5821760d2fe482 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:20.474579 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1ffe1-c712-4d2a-97b4-794717cd6832 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:20.475232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1ffe1-c712-4d2a-97b4-794717cd6832 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:20.475622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1ffe1-c712-4d2a-97b4-794717cd6832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:20.543009 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-65d1ffe1-c712-4d2a-97b4-794717cd6832 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:20.545220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-65d1ffe1-c712-4d2a-97b4-794717cd6832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:20.684416 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1078/2192] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:20.686994 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8af60f-8b2e-41fc-8ea4-a533ec69bf4e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:20.687845 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8af60f-8b2e-41fc-8ea4-a533ec69bf4e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:20.688332 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8af60f-8b2e-41fc-8ea4-a533ec69bf4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:20.725354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0f8af60f-8b2e-41fc-8ea4-a533ec69bf4e None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:20.728020 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0f8af60f-8b2e-41fc-8ea4-a533ec69bf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:20.749097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1115/2193] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:09:20.756125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1ffe1-c712-4d2a-97b4-794717cd6832 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:20.779208 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1ffe1-c712-4d2a-97b4-794717cd6832 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:20.788429 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9366f-f96a-4406-84ef-ec64fe612858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:20.790329 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9366f-f96a-4406-84ef-ec64fe612858 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:20.791041 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9366f-f96a-4406-84ef-ec64fe612858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:20.791791 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9366f-f96a-4406-84ef-ec64fe612858 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:20.793517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9366f-f96a-4406-84ef-ec64fe612858 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:09:20.794340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9366f-f96a-4406-84ef-ec64fe612858 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:20.798095 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9366f-f96a-4406-84ef-ec64fe612858 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:20.831596 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1079/2194] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:09:20.834478 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8af60f-8b2e-41fc-8ea4-a533ec69bf4e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:20.858123 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8af60f-8b2e-41fc-8ea4-a533ec69bf4e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:20.867725 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ce4db-f36e-4c59-944e-f1cde7f74417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:20.869738 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ce4db-f36e-4c59-944e-f1cde7f74417 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:20.869738 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ce4db-f36e-4c59-944e-f1cde7f74417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:20.870201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ce4db-f36e-4c59-944e-f1cde7f74417 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:20.871791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ce4db-f36e-4c59-944e-f1cde7f74417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:20.876328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ce4db-f36e-4c59-944e-f1cde7f74417 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:20.930351 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1116/2195] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:20 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:09:20.932417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9366f-f96a-4406-84ef-ec64fe612858 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:20.954247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9366f-f96a-4406-84ef-ec64fe612858 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:21.123808 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56290b75-a16f-45b1-abac-44b5ec47a3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:21.124551 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56290b75-a16f-45b1-abac-44b5ec47a3ce admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:21.124968 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56290b75-a16f-45b1-abac-44b5ec47a3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:21.125327 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56290b75-a16f-45b1-abac-44b5ec47a3ce admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:21.126086 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56290b75-a16f-45b1-abac-44b5ec47a3ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:21.128325 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56290b75-a16f-45b1-abac-44b5ec47a3ce admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:21.170472 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1080/2196] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:20 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:21.176224 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ce4db-f36e-4c59-944e-f1cde7f74417 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:21.202573 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ce4db-f36e-4c59-944e-f1cde7f74417 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:21.212369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf04dbc-cd20-46fa-acca-da344f54496b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:21.214365 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf04dbc-cd20-46fa-acca-da344f54496b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:21.215253 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf04dbc-cd20-46fa-acca-da344f54496b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:21.217608 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf04dbc-cd20-46fa-acca-da344f54496b admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:21.220023 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf04dbc-cd20-46fa-acca-da344f54496b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:21.223959 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf04dbc-cd20-46fa-acca-da344f54496b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:21.281113 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1117/2197] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:21.283309 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56290b75-a16f-45b1-abac-44b5ec47a3ce admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:21.321413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56290b75-a16f-45b1-abac-44b5ec47a3ce admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:21.337376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a7f2b-8af7-49f2-b574-17b6a5b7d11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:21.340357 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a7f2b-8af7-49f2-b574-17b6a5b7d11a admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:21.341263 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a7f2b-8af7-49f2-b574-17b6a5b7d11a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:21.341826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a7f2b-8af7-49f2-b574-17b6a5b7d11a admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:21.343342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a7f2b-8af7-49f2-b574-17b6a5b7d11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:21.349660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a7f2b-8af7-49f2-b574-17b6a5b7d11a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:21.392539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf04dbc-cd20-46fa-acca-da344f54496b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:21.392895 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1081/2198] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:21.422750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf04dbc-cd20-46fa-acca-da344f54496b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:21.455296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdaae71-f106-449e-8b72-c55e9fe7a208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:21.457808 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdaae71-f106-449e-8b72-c55e9fe7a208 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:21.459178 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdaae71-f106-449e-8b72-c55e9fe7a208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:21.459941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdaae71-f106-449e-8b72-c55e9fe7a208 admin admin] PATH_INFO: `/v3/projects/38148fae716f464cb587dfebbf9d6c1e/users/a60287554d6448bf818ddf2f49725a50/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:21.505187 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:21.522307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdaae71-f106-449e-8b72-c55e9fe7a208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38148fae716f464cb587dfebbf9d6c1e, user_id=a60287554d6448bf818ddf2f49725a50, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:21.528280 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdaae71-f106-449e-8b72-c55e9fe7a208 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:21.588237 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1118/2199] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:21 2022] PUT /identity/v3/projects/38148fae716f464cb587dfebbf9d6c1e/users/a60287554d6448bf818ddf2f49725a50/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:21.609218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e5301-902c-4c09-91ac-61cea49dc6dc None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:21.609818 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e5301-902c-4c09-91ac-61cea49dc6dc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:21.610197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e5301-902c-4c09-91ac-61cea49dc6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:21.722465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:21.745143 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e79e5301-902c-4c09-91ac-61cea49dc6dc None None] MFA Rules not processed for user `a60287554d6448bf818ddf2f49725a50`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:21.758766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e79e5301-902c-4c09-91ac-61cea49dc6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:21.959851 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1082/2200] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:09:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:09:21.993141 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdaae71-f106-449e-8b72-c55e9fe7a208 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:21.997450 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-acdaae71-f106-449e-8b72-c55e9fe7a208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:22.172201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdaae71-f106-449e-8b72-c55e9fe7a208 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:22.182506 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a8825-7d6e-49fb-8c7e-49c9d9c35816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:22.183545 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a8825-7d6e-49fb-8c7e-49c9d9c35816 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:22.183545 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a8825-7d6e-49fb-8c7e-49c9d9c35816 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:22.183843 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a8825-7d6e-49fb-8c7e-49c9d9c35816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:22.208264 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a8825-7d6e-49fb-8c7e-49c9d9c35816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:22.209808 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a8825-7d6e-49fb-8c7e-49c9d9c35816 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:22.247467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1119/2201] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:31.947143 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=26 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:32.233026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:34.288154 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e5301-902c-4c09-91ac-61cea49dc6dc None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:34.291025 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e79e5301-902c-4c09-91ac-61cea49dc6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:34.527670 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e5301-902c-4c09-91ac-61cea49dc6dc None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:34.556017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb42b2e-e7e0-4c8c-af24-6c19a9a4e60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:34.560269 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb42b2e-e7e0-4c8c-af24-6c19a9a4e60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:34.562744 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb42b2e-e7e0-4c8c-af24-6c19a9a4e60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:34.564861 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb42b2e-e7e0-4c8c-af24-6c19a9a4e60c admin admin] PATH_INFO: `/v3/users/8c640955faf14d759e72494fa9512bc6` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:34.574850 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb42b2e-e7e0-4c8c-af24-6c19a9a4e60c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c640955faf14d759e72494fa9512bc6)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:34.588694 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb42b2e-e7e0-4c8c-af24-6c19a9a4e60c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:34.775982 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6cb42b2e-e7e0-4c8c-af24-6c19a9a4e60c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c640955faf14d759e72494fa9512bc6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:34.795348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6cb42b2e-e7e0-4c8c-af24-6c19a9a4e60c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c640955faf14d759e72494fa9512bc6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:34.843952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6cb42b2e-e7e0-4c8c-af24-6c19a9a4e60c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c640955faf14d759e72494fa9512bc6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:34.847076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6cb42b2e-e7e0-4c8c-af24-6c19a9a4e60c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c640955faf14d759e72494fa9512bc6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:34.869759 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6cb42b2e-e7e0-4c8c-af24-6c19a9a4e60c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c640955faf14d759e72494fa9512bc6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:34.891648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1083/2202] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:34 2022] DELETE /identity/v3/users/8c640955faf14d759e72494fa9512bc6 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:34.899464 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f861b-5daf-4b3b-8ed5-f98c57da11db None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:34.900418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f861b-5daf-4b3b-8ed5-f98c57da11db None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:34.900628 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f861b-5daf-4b3b-8ed5-f98c57da11db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:34.953277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7a1f861b-5daf-4b3b-8ed5-f98c57da11db None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:34.955413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7a1f861b-5daf-4b3b-8ed5-f98c57da11db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:35.173302 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1120/2203] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:35.200423 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb42b2e-e7e0-4c8c-af24-6c19a9a4e60c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:35.203387 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6cb42b2e-e7e0-4c8c-af24-6c19a9a4e60c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:35.363465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb42b2e-e7e0-4c8c-af24-6c19a9a4e60c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:35.367962 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106b69f-2596-431d-a6f4-508ec70b2147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:35.368634 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106b69f-2596-431d-a6f4-508ec70b2147 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:35.368948 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106b69f-2596-431d-a6f4-508ec70b2147 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:35.369969 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106b69f-2596-431d-a6f4-508ec70b2147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:35.386590 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106b69f-2596-431d-a6f4-508ec70b2147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:35.389542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106b69f-2596-431d-a6f4-508ec70b2147 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:35.405279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1084/2204] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:35.984042 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f861b-5daf-4b3b-8ed5-f98c57da11db None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:35.987744 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7a1f861b-5daf-4b3b-8ed5-f98c57da11db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:36.010739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f861b-5daf-4b3b-8ed5-f98c57da11db None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:36.030140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffe6f5-5200-4779-b7d5-80e37283ac99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:36.033845 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffe6f5-5200-4779-b7d5-80e37283ac99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:36.036100 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffe6f5-5200-4779-b7d5-80e37283ac99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:36.036689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffe6f5-5200-4779-b7d5-80e37283ac99 admin admin] PATH_INFO: `/v3/users/9db9c89790a345068c9badf5cf4ee981` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:36.040301 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffe6f5-5200-4779-b7d5-80e37283ac99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9db9c89790a345068c9badf5cf4ee981)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:36.043914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffe6f5-5200-4779-b7d5-80e37283ac99 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:36.211362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d6ffe6f5-5200-4779-b7d5-80e37283ac99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9db9c89790a345068c9badf5cf4ee981'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:36.230769 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d6ffe6f5-5200-4779-b7d5-80e37283ac99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9db9c89790a345068c9badf5cf4ee981'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:36.253800 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d6ffe6f5-5200-4779-b7d5-80e37283ac99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9db9c89790a345068c9badf5cf4ee981'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:36.259419 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d6ffe6f5-5200-4779-b7d5-80e37283ac99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9db9c89790a345068c9badf5cf4ee981'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:36.261336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d6ffe6f5-5200-4779-b7d5-80e37283ac99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9db9c89790a345068c9badf5cf4ee981'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:36.352328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1121/2205] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:35 2022] DELETE /identity/v3/users/9db9c89790a345068c9badf5cf4ee981 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:36.362892 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df844998-fb97-4304-945f-9f1a1b54c1b0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:36.363597 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df844998-fb97-4304-945f-9f1a1b54c1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:36.364747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df844998-fb97-4304-945f-9f1a1b54c1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:36.404585 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-df844998-fb97-4304-945f-9f1a1b54c1b0 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:36.407444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffe6f5-5200-4779-b7d5-80e37283ac99 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:36.410601 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d6ffe6f5-5200-4779-b7d5-80e37283ac99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:36.443176 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-df844998-fb97-4304-945f-9f1a1b54c1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:36.504682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:36.632384 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffe6f5-5200-4779-b7d5-80e37283ac99 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:36.638179 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1085/2206] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:36.644231 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22672b3-cb2f-4de3-b484-23daf1802553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:36.645548 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22672b3-cb2f-4de3-b484-23daf1802553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:36.646025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22672b3-cb2f-4de3-b484-23daf1802553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:36.646176 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22672b3-cb2f-4de3-b484-23daf1802553 admin admin] PATH_INFO: `/v3/projects/93081c0496b04f018abf99b8e49e94b7` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:36.648560 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22672b3-cb2f-4de3-b484-23daf1802553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93081c0496b04f018abf99b8e49e94b7)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:36.650679 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22672b3-cb2f-4de3-b484-23daf1802553 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:36.663604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df844998-fb97-4304-945f-9f1a1b54c1b0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:36.667199 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-df844998-fb97-4304-945f-9f1a1b54c1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:36.693454 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:36.763187 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b22672b3-cb2f-4de3-b484-23daf1802553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93081c0496b04f018abf99b8e49e94b7', 'request_id': 'req-b22672b3-cb2f-4de3-b484-23daf1802553'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:36.772469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b22672b3-cb2f-4de3-b484-23daf1802553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93081c0496b04f018abf99b8e49e94b7', 'request_id': 'req-b22672b3-cb2f-4de3-b484-23daf1802553'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:36.781354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b22672b3-cb2f-4de3-b484-23daf1802553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93081c0496b04f018abf99b8e49e94b7', 'request_id': 'req-b22672b3-cb2f-4de3-b484-23daf1802553'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:36.809457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b22672b3-cb2f-4de3-b484-23daf1802553 admin admin] The token cache is being invalidate because project 93081c0496b04f018abf99b8e49e94b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:36.810150 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b22672b3-cb2f-4de3-b484-23daf1802553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:36.812556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b22672b3-cb2f-4de3-b484-23daf1802553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:36.815045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1122/2207] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:36 2022] DELETE /identity/v3/projects/93081c0496b04f018abf99b8e49e94b7 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:09:36.823170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785351a-98c3-43d9-a37e-d21ec37ca9b5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:36.823754 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785351a-98c3-43d9-a37e-d21ec37ca9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:36.824193 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785351a-98c3-43d9-a37e-d21ec37ca9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:36.831723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df844998-fb97-4304-945f-9f1a1b54c1b0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:36.868487 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b785351a-98c3-43d9-a37e-d21ec37ca9b5 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:36.870719 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b785351a-98c3-43d9-a37e-d21ec37ca9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:36.989605 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32faa5e-2511-4c0f-80f3-d706c3de4df0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:36.993617 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32faa5e-2511-4c0f-80f3-d706c3de4df0 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:36.994240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32faa5e-2511-4c0f-80f3-d706c3de4df0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:36.994513 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32faa5e-2511-4c0f-80f3-d706c3de4df0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:37.001921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e32faa5e-2511-4c0f-80f3-d706c3de4df0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:37.171488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1123/2208] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:37.184084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61694d2-2a41-40f9-9a0d-b5a9e6db5f83 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:37.185022 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61694d2-2a41-40f9-9a0d-b5a9e6db5f83 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:37.185635 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61694d2-2a41-40f9-9a0d-b5a9e6db5f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:37.201129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32faa5e-2511-4c0f-80f3-d706c3de4df0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:37.203610 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32faa5e-2511-4c0f-80f3-d706c3de4df0 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:37.220386 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1086/2209] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:37.247887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e61694d2-2a41-40f9-9a0d-b5a9e6db5f83 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:37.250151 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e61694d2-2a41-40f9-9a0d-b5a9e6db5f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:37.270947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1124/2210] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:09:37.272352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32faa5e-2511-4c0f-80f3-d706c3de4df0 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:37.290554 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32faa5e-2511-4c0f-80f3-d706c3de4df0 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:37.296774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8bbc2-87b3-4d46-abc7-cec01101f3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:37.297911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8bbc2-87b3-4d46-abc7-cec01101f3ac admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:37.298306 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8bbc2-87b3-4d46-abc7-cec01101f3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:37.298708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8bbc2-87b3-4d46-abc7-cec01101f3ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:37.299809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8bbc2-87b3-4d46-abc7-cec01101f3ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:09:37.300425 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8bbc2-87b3-4d46-abc7-cec01101f3ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:37.302861 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8bbc2-87b3-4d46-abc7-cec01101f3ac admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:37.325240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1087/2211] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:09:37.326248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61694d2-2a41-40f9-9a0d-b5a9e6db5f83 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:37.371995 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61694d2-2a41-40f9-9a0d-b5a9e6db5f83 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:37.388628 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d197d9-7480-4195-b7c1-d2ca61b10ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:37.390493 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d197d9-7480-4195-b7c1-d2ca61b10ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:37.391229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d197d9-7480-4195-b7c1-d2ca61b10ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:37.391987 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d197d9-7480-4195-b7c1-d2ca61b10ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:37.393635 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d197d9-7480-4195-b7c1-d2ca61b10ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:37.397945 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d197d9-7480-4195-b7c1-d2ca61b10ec9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:37.488803 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1125/2212] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:37 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:37.491114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8bbc2-87b3-4d46-abc7-cec01101f3ac admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:37.506510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8bbc2-87b3-4d46-abc7-cec01101f3ac admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:37.531853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:37.675583 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187fb89-957b-4fce-9c0d-e6a3b0e6e42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:37.677951 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187fb89-957b-4fce-9c0d-e6a3b0e6e42f admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:37.679117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187fb89-957b-4fce-9c0d-e6a3b0e6e42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:37.680239 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187fb89-957b-4fce-9c0d-e6a3b0e6e42f admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:37.681645 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187fb89-957b-4fce-9c0d-e6a3b0e6e42f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:37.685534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187fb89-957b-4fce-9c0d-e6a3b0e6e42f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:37.741987 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1088/2213] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:37 2022] POST /identity/v3/users => generated 287 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:37.747304 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d197d9-7480-4195-b7c1-d2ca61b10ec9 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:37.769120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d197d9-7480-4195-b7c1-d2ca61b10ec9 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:37.787272 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d0517-6821-4bbb-8f00-03a6166ffebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:37.789103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d0517-6821-4bbb-8f00-03a6166ffebf admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:37.790288 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d0517-6821-4bbb-8f00-03a6166ffebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:37.791062 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d0517-6821-4bbb-8f00-03a6166ffebf admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:37.792864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d0517-6821-4bbb-8f00-03a6166ffebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:37.798577 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d0517-6821-4bbb-8f00-03a6166ffebf admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:37.826145 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1126/2214] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:37.833313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187fb89-957b-4fce-9c0d-e6a3b0e6e42f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:37.859281 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187fb89-957b-4fce-9c0d-e6a3b0e6e42f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:37.875660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adddeff-0afa-4df2-b3d6-1fd75224767e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:37.878079 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adddeff-0afa-4df2-b3d6-1fd75224767e admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:37.879081 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adddeff-0afa-4df2-b3d6-1fd75224767e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:37.881091 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adddeff-0afa-4df2-b3d6-1fd75224767e admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:37.883494 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adddeff-0afa-4df2-b3d6-1fd75224767e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:37.888782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adddeff-0afa-4df2-b3d6-1fd75224767e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:37.915751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1089/2215] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:37.921567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d0517-6821-4bbb-8f00-03a6166ffebf admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:37.947903 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d0517-6821-4bbb-8f00-03a6166ffebf admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:37.957011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40ee5b-17f4-4845-85a1-becf7119a152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:37.958011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40ee5b-17f4-4845-85a1-becf7119a152 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:37.958300 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40ee5b-17f4-4845-85a1-becf7119a152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:37.958615 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40ee5b-17f4-4845-85a1-becf7119a152 admin admin] PATH_INFO: `/v3/projects/3a75957c9c4646de8b610bb126b8855a/users/f81bc4a07d1b4c988e126dddc764387b/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:37.992118 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40ee5b-17f4-4845-85a1-becf7119a152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a75957c9c4646de8b610bb126b8855a, user_id=f81bc4a07d1b4c988e126dddc764387b, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:37.998687 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40ee5b-17f4-4845-85a1-becf7119a152 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:38.037817 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1127/2216] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:37 2022] PUT /identity/v3/projects/3a75957c9c4646de8b610bb126b8855a/users/f81bc4a07d1b4c988e126dddc764387b/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:38.040030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83e36e-813a-4fdd-a27b-3f70af30322d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:38.040517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83e36e-813a-4fdd-a27b-3f70af30322d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:38.041032 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83e36e-813a-4fdd-a27b-3f70af30322d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:38.102179 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8f83e36e-813a-4fdd-a27b-3f70af30322d None None] MFA Rules not processed for user `f81bc4a07d1b4c988e126dddc764387b`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:38.112026 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8f83e36e-813a-4fdd-a27b-3f70af30322d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:38.166557 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40ee5b-17f4-4845-85a1-becf7119a152 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:38.169944 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7e40ee5b-17f4-4845-85a1-becf7119a152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:38.359366 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1090/2217] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:09:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:38.374992 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:38.421358 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83e36e-813a-4fdd-a27b-3f70af30322d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:38.423832 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8f83e36e-813a-4fdd-a27b-3f70af30322d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:38.483482 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40ee5b-17f4-4845-85a1-becf7119a152 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:38.507903 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e5de6-b695-48b7-876f-9d47cb7b585c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:38.509433 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e5de6-b695-48b7-876f-9d47cb7b585c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:38.510181 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e5de6-b695-48b7-876f-9d47cb7b585c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:38.510645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e5de6-b695-48b7-876f-9d47cb7b585c admin admin] PATH_INFO: `/v3/projects/c7afb7da3f804e5e899e0ce7c80091f1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:38.512682 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e5de6-b695-48b7-876f-9d47cb7b585c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7afb7da3f804e5e899e0ce7c80091f1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:38.515957 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e5de6-b695-48b7-876f-9d47cb7b585c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:38.632400 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c45e5de6-b695-48b7-876f-9d47cb7b585c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7afb7da3f804e5e899e0ce7c80091f1', 'request_id': 'req-c45e5de6-b695-48b7-876f-9d47cb7b585c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:38.650527 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c45e5de6-b695-48b7-876f-9d47cb7b585c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7afb7da3f804e5e899e0ce7c80091f1', 'request_id': 'req-c45e5de6-b695-48b7-876f-9d47cb7b585c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:38.663912 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c45e5de6-b695-48b7-876f-9d47cb7b585c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7afb7da3f804e5e899e0ce7c80091f1', 'request_id': 'req-c45e5de6-b695-48b7-876f-9d47cb7b585c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:38.693571 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c45e5de6-b695-48b7-876f-9d47cb7b585c admin admin] The token cache is being invalidate because project c7afb7da3f804e5e899e0ce7c80091f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:38.694036 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c45e5de6-b695-48b7-876f-9d47cb7b585c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:38.695209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c45e5de6-b695-48b7-876f-9d47cb7b585c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:38.703860 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1128/2218] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:38 2022] DELETE /identity/v3/projects/c7afb7da3f804e5e899e0ce7c80091f1 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:38.709398 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f3397-e61c-4266-9f6f-f88cc967e9e9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:38.710363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f3397-e61c-4266-9f6f-f88cc967e9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:38.711955 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f3397-e61c-4266-9f6f-f88cc967e9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:38.723226 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83e36e-813a-4fdd-a27b-3f70af30322d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:38.757239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b50f3397-e61c-4266-9f6f-f88cc967e9e9 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:38.759279 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b50f3397-e61c-4266-9f6f-f88cc967e9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:38.859371 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:38.907595 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210d7d0-eeae-484d-ab23-e792b2efe3ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:38.911153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210d7d0-eeae-484d-ab23-e792b2efe3ec service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:38.911877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210d7d0-eeae-484d-ab23-e792b2efe3ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:38.914897 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210d7d0-eeae-484d-ab23-e792b2efe3ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:38.923958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6210d7d0-eeae-484d-ab23-e792b2efe3ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:38.941437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1129/2219] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:38.944810 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2f58f-bcc1-407e-ac0a-8b357a8509c0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:38.945643 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2f58f-bcc1-407e-ac0a-8b357a8509c0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:38.946344 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2f58f-bcc1-407e-ac0a-8b357a8509c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:39.028909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-47e2f58f-bcc1-407e-ac0a-8b357a8509c0 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:39.051784 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-47e2f58f-bcc1-407e-ac0a-8b357a8509c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:39.086624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1130/2220] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:39.093567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2f58f-bcc1-407e-ac0a-8b357a8509c0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:39.127065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2f58f-bcc1-407e-ac0a-8b357a8509c0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:39.129308 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210d7d0-eeae-484d-ab23-e792b2efe3ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:39.132779 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210d7d0-eeae-484d-ab23-e792b2efe3ec service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:39.140420 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937cbd8-42f2-4cd8-b5f5-ddbbe307df3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:39.141184 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937cbd8-42f2-4cd8-b5f5-ddbbe307df3b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:39.141508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937cbd8-42f2-4cd8-b5f5-ddbbe307df3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:39.141793 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937cbd8-42f2-4cd8-b5f5-ddbbe307df3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:39.142652 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937cbd8-42f2-4cd8-b5f5-ddbbe307df3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:09:39.142963 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937cbd8-42f2-4cd8-b5f5-ddbbe307df3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:39.145132 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937cbd8-42f2-4cd8-b5f5-ddbbe307df3b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:39.155993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1091/2221] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 736 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:39.166676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1131/2222] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:09:39.176623 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210d7d0-eeae-484d-ab23-e792b2efe3ec service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:39.222587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210d7d0-eeae-484d-ab23-e792b2efe3ec service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:39.262926 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace3e2b-0b0a-49ea-a9f5-1acb494b654a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:39.265160 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace3e2b-0b0a-49ea-a9f5-1acb494b654a admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:39.265871 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace3e2b-0b0a-49ea-a9f5-1acb494b654a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:39.266683 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace3e2b-0b0a-49ea-a9f5-1acb494b654a admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:39.268546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace3e2b-0b0a-49ea-a9f5-1acb494b654a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:39.276587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace3e2b-0b0a-49ea-a9f5-1acb494b654a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:39.375687 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937cbd8-42f2-4cd8-b5f5-ddbbe307df3b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:39.382062 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1092/2223] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:39 2022] POST /identity/v3/projects => generated 375 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:39.391108 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937cbd8-42f2-4cd8-b5f5-ddbbe307df3b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:39.570304 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:39.587157 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6bc2e-4f9b-45d3-a6d6-45b79371f098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:39.587897 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6bc2e-4f9b-45d3-a6d6-45b79371f098 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:39.588214 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6bc2e-4f9b-45d3-a6d6-45b79371f098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:39.588925 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6bc2e-4f9b-45d3-a6d6-45b79371f098 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:39.589666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6bc2e-4f9b-45d3-a6d6-45b79371f098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:39.595426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6bc2e-4f9b-45d3-a6d6-45b79371f098 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:39.637419 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1132/2224] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:39 2022] POST /identity/v3/users => generated 288 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:39.642258 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace3e2b-0b0a-49ea-a9f5-1acb494b654a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:39.666573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace3e2b-0b0a-49ea-a9f5-1acb494b654a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:39.679366 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307f4d7-d88a-4bc6-9678-9eeff50fb9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:39.680120 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307f4d7-d88a-4bc6-9678-9eeff50fb9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:39.680618 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307f4d7-d88a-4bc6-9678-9eeff50fb9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:39.681337 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307f4d7-d88a-4bc6-9678-9eeff50fb9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:39.686145 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307f4d7-d88a-4bc6-9678-9eeff50fb9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:39.689995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307f4d7-d88a-4bc6-9678-9eeff50fb9c2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:39.719790 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1093/2225] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:09:39.724865 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6bc2e-4f9b-45d3-a6d6-45b79371f098 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:39.779053 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6bc2e-4f9b-45d3-a6d6-45b79371f098 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:39.787610 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd2ef6-7102-4a15-b10a-fdb348c48758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:39.788482 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd2ef6-7102-4a15-b10a-fdb348c48758 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:39.788980 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd2ef6-7102-4a15-b10a-fdb348c48758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:39.789723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd2ef6-7102-4a15-b10a-fdb348c48758 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:39.790654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd2ef6-7102-4a15-b10a-fdb348c48758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:39.793130 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd2ef6-7102-4a15-b10a-fdb348c48758 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:39.830364 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1133/2226] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:39.836245 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307f4d7-d88a-4bc6-9678-9eeff50fb9c2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:39.852692 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307f4d7-d88a-4bc6-9678-9eeff50fb9c2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:39.868500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8233757-60aa-4c68-ab0e-27d08a7db5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:39.870006 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8233757-60aa-4c68-ab0e-27d08a7db5e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:39.870006 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8233757-60aa-4c68-ab0e-27d08a7db5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:39.870471 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8233757-60aa-4c68-ab0e-27d08a7db5e8 admin admin] PATH_INFO: `/v3/projects/13b2adcae1744090aad6afaef227c2cd/users/5c3e931a8bd74d1d83a42a004f17bd4c/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:39.911796 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8233757-60aa-4c68-ab0e-27d08a7db5e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b2adcae1744090aad6afaef227c2cd, user_id=5c3e931a8bd74d1d83a42a004f17bd4c, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:39.921243 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8233757-60aa-4c68-ab0e-27d08a7db5e8 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:39.955535 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1094/2227] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:39 2022] PUT /identity/v3/projects/13b2adcae1744090aad6afaef227c2cd/users/5c3e931a8bd74d1d83a42a004f17bd4c/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:09:39.966141 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff8e57-2255-4cb3-ad92-dd293d2a977e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:39.966606 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff8e57-2255-4cb3-ad92-dd293d2a977e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:39.967177 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff8e57-2255-4cb3-ad92-dd293d2a977e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:40.031354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-eeff8e57-2255-4cb3-ad92-dd293d2a977e None None] MFA Rules not processed for user `5c3e931a8bd74d1d83a42a004f17bd4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:40.032827 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-eeff8e57-2255-4cb3-ad92-dd293d2a977e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:40.203909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1134/2228] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:09:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:09:40.276380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8233757-60aa-4c68-ab0e-27d08a7db5e8 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:40.280892 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a8233757-60aa-4c68-ab0e-27d08a7db5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:40.391958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8233757-60aa-4c68-ab0e-27d08a7db5e8 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:40.398421 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47930aa3-8411-4ebf-90d0-d23b5dae7c4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:40.400448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47930aa3-8411-4ebf-90d0-d23b5dae7c4e service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:40.400448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47930aa3-8411-4ebf-90d0-d23b5dae7c4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:40.400880 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47930aa3-8411-4ebf-90d0-d23b5dae7c4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:40.430543 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47930aa3-8411-4ebf-90d0-d23b5dae7c4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:40.451033 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47930aa3-8411-4ebf-90d0-d23b5dae7c4e service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:40.471841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1095/2229] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:40.498420 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff8e57-2255-4cb3-ad92-dd293d2a977e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:40.633200 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff8e57-2255-4cb3-ad92-dd293d2a977e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:40.646631 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa11214-346f-4832-9c0d-a6cee500cc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:40.648375 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa11214-346f-4832-9c0d-a6cee500cc98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:40.648897 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa11214-346f-4832-9c0d-a6cee500cc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:40.649368 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa11214-346f-4832-9c0d-a6cee500cc98 admin admin] PATH_INFO: `/v3/users/5c3e931a8bd74d1d83a42a004f17bd4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:40.651057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa11214-346f-4832-9c0d-a6cee500cc98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3e931a8bd74d1d83a42a004f17bd4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:40.654767 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa11214-346f-4832-9c0d-a6cee500cc98 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:40.750805 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4fa11214-346f-4832-9c0d-a6cee500cc98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3e931a8bd74d1d83a42a004f17bd4c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:40.765434 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4fa11214-346f-4832-9c0d-a6cee500cc98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3e931a8bd74d1d83a42a004f17bd4c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:40.778361 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:40.783118 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4fa11214-346f-4832-9c0d-a6cee500cc98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3e931a8bd74d1d83a42a004f17bd4c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:40.784283 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4fa11214-346f-4832-9c0d-a6cee500cc98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3e931a8bd74d1d83a42a004f17bd4c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:40.787145 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4fa11214-346f-4832-9c0d-a6cee500cc98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3e931a8bd74d1d83a42a004f17bd4c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:40.838205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1135/2230] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:40 2022] DELETE /identity/v3/users/5c3e931a8bd74d1d83a42a004f17bd4c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:40.843256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4de4c-312f-494b-a625-36c8e8f3e4df None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:40.843857 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4de4c-312f-494b-a625-36c8e8f3e4df None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:40.843857 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4de4c-312f-494b-a625-36c8e8f3e4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:40.872134 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-22a4de4c-312f-494b-a625-36c8e8f3e4df None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:40.873637 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-22a4de4c-312f-494b-a625-36c8e8f3e4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:40.936153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:41.025036 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1096/2231] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:41.037889 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa11214-346f-4832-9c0d-a6cee500cc98 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:41.039530 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4fa11214-346f-4832-9c0d-a6cee500cc98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:41.183984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa11214-346f-4832-9c0d-a6cee500cc98 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:41.189592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a07da-b517-437e-8867-053990f126e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:41.190293 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a07da-b517-437e-8867-053990f126e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:41.191762 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a07da-b517-437e-8867-053990f126e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:41.192088 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a07da-b517-437e-8867-053990f126e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:41.208277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a07da-b517-437e-8867-053990f126e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:41.210472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a07da-b517-437e-8867-053990f126e4 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:41.234626 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1136/2232] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:09:42.494349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4de4c-312f-494b-a625-36c8e8f3e4df None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:42.501119 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-22a4de4c-312f-494b-a625-36c8e8f3e4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:42.583717 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4de4c-312f-494b-a625-36c8e8f3e4df None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:42.614075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3205901-caaf-40f9-af8f-2b8f60fdc602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:42.623096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3205901-caaf-40f9-af8f-2b8f60fdc602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:42.623602 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3205901-caaf-40f9-af8f-2b8f60fdc602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:42.624973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3205901-caaf-40f9-af8f-2b8f60fdc602 admin admin] PATH_INFO: `/v3/projects/13b2adcae1744090aad6afaef227c2cd` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:42.636030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3205901-caaf-40f9-af8f-2b8f60fdc602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b2adcae1744090aad6afaef227c2cd)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:42.639980 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3205901-caaf-40f9-af8f-2b8f60fdc602 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:42.860193 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d3205901-caaf-40f9-af8f-2b8f60fdc602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b2adcae1744090aad6afaef227c2cd', 'request_id': 'req-d3205901-caaf-40f9-af8f-2b8f60fdc602'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:42.882207 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d3205901-caaf-40f9-af8f-2b8f60fdc602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b2adcae1744090aad6afaef227c2cd', 'request_id': 'req-d3205901-caaf-40f9-af8f-2b8f60fdc602'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:42.897220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d3205901-caaf-40f9-af8f-2b8f60fdc602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b2adcae1744090aad6afaef227c2cd', 'request_id': 'req-d3205901-caaf-40f9-af8f-2b8f60fdc602'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:42.949375 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d3205901-caaf-40f9-af8f-2b8f60fdc602 admin admin] The token cache is being invalidate because project 13b2adcae1744090aad6afaef227c2cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:42.950626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d3205901-caaf-40f9-af8f-2b8f60fdc602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:42.952244 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d3205901-caaf-40f9-af8f-2b8f60fdc602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:42.960083 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1097/2233] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:42 2022] DELETE /identity/v3/projects/13b2adcae1744090aad6afaef227c2cd => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:51.221223 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=34,keystone:DELETE=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:52.320850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a07da-b517-437e-8867-053990f126e4 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:52.324560 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ec6a07da-b517-437e-8867-053990f126e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:52.536597 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a07da-b517-437e-8867-053990f126e4 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:52.697972 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6f57a-2470-4ebd-9a4b-9ebdbe60b524 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:52.700290 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6f57a-2470-4ebd-9a4b-9ebdbe60b524 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:52.701417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6f57a-2470-4ebd-9a4b-9ebdbe60b524 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:52.702866 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6f57a-2470-4ebd-9a4b-9ebdbe60b524 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:52.706727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-62e6f57a-2470-4ebd-9a4b-9ebdbe60b524 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:52.743330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6f57a-2470-4ebd-9a4b-9ebdbe60b524 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:52.755516 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6f57a-2470-4ebd-9a4b-9ebdbe60b524 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:52.804099 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1137/2234] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:52.937372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:54.585357 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3205901-caaf-40f9-af8f-2b8f60fdc602 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:54.587762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d3205901-caaf-40f9-af8f-2b8f60fdc602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:54.732971 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3205901-caaf-40f9-af8f-2b8f60fdc602 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:54.750407 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894dfee-cafe-4db2-85ed-fd2280b5ed27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:54.752396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894dfee-cafe-4db2-85ed-fd2280b5ed27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:54.753095 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894dfee-cafe-4db2-85ed-fd2280b5ed27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:54.753531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894dfee-cafe-4db2-85ed-fd2280b5ed27 admin admin] PATH_INFO: `/v3/users/a60287554d6448bf818ddf2f49725a50` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:54.756417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894dfee-cafe-4db2-85ed-fd2280b5ed27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a60287554d6448bf818ddf2f49725a50)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:54.760757 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894dfee-cafe-4db2-85ed-fd2280b5ed27 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:54.874146 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d894dfee-cafe-4db2-85ed-fd2280b5ed27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a60287554d6448bf818ddf2f49725a50'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:54.890681 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d894dfee-cafe-4db2-85ed-fd2280b5ed27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a60287554d6448bf818ddf2f49725a50'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:54.929594 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d894dfee-cafe-4db2-85ed-fd2280b5ed27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a60287554d6448bf818ddf2f49725a50'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:54.930874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d894dfee-cafe-4db2-85ed-fd2280b5ed27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a60287554d6448bf818ddf2f49725a50'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:54.951566 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d894dfee-cafe-4db2-85ed-fd2280b5ed27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a60287554d6448bf818ddf2f49725a50'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:54.997695 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1098/2235] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:54 2022] DELETE /identity/v3/users/a60287554d6448bf818ddf2f49725a50 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:55.000496 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71a98d-edbf-4c3e-9bd9-280407c60c3e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:55.001338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71a98d-edbf-4c3e-9bd9-280407c60c3e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:55.001937 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71a98d-edbf-4c3e-9bd9-280407c60c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:55.059110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6d71a98d-edbf-4c3e-9bd9-280407c60c3e None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:55.064269 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6d71a98d-edbf-4c3e-9bd9-280407c60c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:55.277526 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1138/2236] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:09:55.297370 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894dfee-cafe-4db2-85ed-fd2280b5ed27 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:55.299424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d894dfee-cafe-4db2-85ed-fd2280b5ed27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:55.454570 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894dfee-cafe-4db2-85ed-fd2280b5ed27 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:55.461173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf0b1b-8dd8-406b-b775-772dc3e39847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:55.462526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf0b1b-8dd8-406b-b775-772dc3e39847 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:55.463112 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf0b1b-8dd8-406b-b775-772dc3e39847 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:55.463707 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf0b1b-8dd8-406b-b775-772dc3e39847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:55.494211 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf0b1b-8dd8-406b-b775-772dc3e39847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:55.497428 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf0b1b-8dd8-406b-b775-772dc3e39847 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:55.518286 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1099/2237] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:55.905757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71a98d-edbf-4c3e-9bd9-280407c60c3e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:55.908158 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6d71a98d-edbf-4c3e-9bd9-280407c60c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:55.956006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71a98d-edbf-4c3e-9bd9-280407c60c3e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:55.965335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154e41d-3edd-416a-8ee3-d696c90e788d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:55.967221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154e41d-3edd-416a-8ee3-d696c90e788d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:55.967564 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154e41d-3edd-416a-8ee3-d696c90e788d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:55.968078 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154e41d-3edd-416a-8ee3-d696c90e788d admin admin] PATH_INFO: `/v3/projects/38148fae716f464cb587dfebbf9d6c1e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:55.970648 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154e41d-3edd-416a-8ee3-d696c90e788d admin admin] RBAC: Authorizing `identity:delete_project(project_id=38148fae716f464cb587dfebbf9d6c1e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:55.974672 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154e41d-3edd-416a-8ee3-d696c90e788d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:56.101362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:56.158962 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1154e41d-3edd-416a-8ee3-d696c90e788d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38148fae716f464cb587dfebbf9d6c1e', 'request_id': 'req-1154e41d-3edd-416a-8ee3-d696c90e788d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:56.170836 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1154e41d-3edd-416a-8ee3-d696c90e788d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38148fae716f464cb587dfebbf9d6c1e', 'request_id': 'req-1154e41d-3edd-416a-8ee3-d696c90e788d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:56.187950 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1154e41d-3edd-416a-8ee3-d696c90e788d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38148fae716f464cb587dfebbf9d6c1e', 'request_id': 'req-1154e41d-3edd-416a-8ee3-d696c90e788d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:56.212304 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1154e41d-3edd-416a-8ee3-d696c90e788d admin admin] The token cache is being invalidate because project 38148fae716f464cb587dfebbf9d6c1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:56.212304 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1154e41d-3edd-416a-8ee3-d696c90e788d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:56.214817 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1154e41d-3edd-416a-8ee3-d696c90e788d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:56.234488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1139/2238] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:55 2022] DELETE /identity/v3/projects/38148fae716f464cb587dfebbf9d6c1e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:56.239165 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2ce44-edfb-434c-8de5-7784d9550d35 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:56.239904 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2ce44-edfb-434c-8de5-7784d9550d35 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:56.240166 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2ce44-edfb-434c-8de5-7784d9550d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:56.330475 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-93d2ce44-edfb-434c-8de5-7784d9550d35 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:56.333200 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-93d2ce44-edfb-434c-8de5-7784d9550d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:56.374080 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:56.558159 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1100/2239] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:56.566953 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862087ee-c7f1-4b1e-8740-8a31534012f4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:56.567428 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862087ee-c7f1-4b1e-8740-8a31534012f4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:56.567706 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862087ee-c7f1-4b1e-8740-8a31534012f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:56.621240 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-862087ee-c7f1-4b1e-8740-8a31534012f4 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:56.628849 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-862087ee-c7f1-4b1e-8740-8a31534012f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:56.659763 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1140/2240] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:56.662848 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2ce44-edfb-434c-8de5-7784d9550d35 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:56.680219 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2ce44-edfb-434c-8de5-7784d9550d35 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:56.713404 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f7027-e211-4c85-a6d6-55ad3279167e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:56.714552 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f7027-e211-4c85-a6d6-55ad3279167e admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:56.715049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f7027-e211-4c85-a6d6-55ad3279167e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:56.715568 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f7027-e211-4c85-a6d6-55ad3279167e admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:56.716939 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f7027-e211-4c85-a6d6-55ad3279167e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:09:56.717494 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f7027-e211-4c85-a6d6-55ad3279167e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:56.723746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f7027-e211-4c85-a6d6-55ad3279167e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:56.785869 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1101/2241] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:09:56.791798 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862087ee-c7f1-4b1e-8740-8a31534012f4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:56.848273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862087ee-c7f1-4b1e-8740-8a31534012f4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:56.871571 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6836101-9688-4f6c-bffa-73be56361eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:56.884292 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6836101-9688-4f6c-bffa-73be56361eac admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:56.885007 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6836101-9688-4f6c-bffa-73be56361eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:56.885494 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6836101-9688-4f6c-bffa-73be56361eac admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:56.886873 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6836101-9688-4f6c-bffa-73be56361eac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:56.892420 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6836101-9688-4f6c-bffa-73be56361eac admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:56.973795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1141/2242] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:56 2022] POST /identity/v3/projects => generated 361 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:56.975558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f7027-e211-4c85-a6d6-55ad3279167e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:57.004140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f7027-e211-4c85-a6d6-55ad3279167e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:57.133529 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e52f75-3e9b-4b35-b4f6-d0dc5c47246c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:57.134743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e52f75-3e9b-4b35-b4f6-d0dc5c47246c admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:57.135221 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e52f75-3e9b-4b35-b4f6-d0dc5c47246c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:57.135507 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e52f75-3e9b-4b35-b4f6-d0dc5c47246c admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:57.136261 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e52f75-3e9b-4b35-b4f6-d0dc5c47246c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:57.138392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e52f75-3e9b-4b35-b4f6-d0dc5c47246c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:57.171172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1102/2243] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:56 2022] POST /identity/v3/users => generated 281 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:57.177056 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6836101-9688-4f6c-bffa-73be56361eac admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:57.193800 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6836101-9688-4f6c-bffa-73be56361eac admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:57.202831 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05406759-1a2e-4bad-82b2-edd59038a81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:57.204009 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05406759-1a2e-4bad-82b2-edd59038a81a admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:57.205239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05406759-1a2e-4bad-82b2-edd59038a81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:57.205984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05406759-1a2e-4bad-82b2-edd59038a81a admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:57.207379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05406759-1a2e-4bad-82b2-edd59038a81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:57.209704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05406759-1a2e-4bad-82b2-edd59038a81a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:57.235105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1142/2244] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:57.239941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e52f75-3e9b-4b35-b4f6-d0dc5c47246c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:57.252525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e52f75-3e9b-4b35-b4f6-d0dc5c47246c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:57.257998 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633d2e3-8797-4538-8bbb-b986f0b57d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:57.258718 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633d2e3-8797-4538-8bbb-b986f0b57d6a admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:57.259382 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633d2e3-8797-4538-8bbb-b986f0b57d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:57.259606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633d2e3-8797-4538-8bbb-b986f0b57d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:57.260790 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633d2e3-8797-4538-8bbb-b986f0b57d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:57.262892 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633d2e3-8797-4538-8bbb-b986f0b57d6a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:57.282176 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1103/2245] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:09:57.284233 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05406759-1a2e-4bad-82b2-edd59038a81a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:57.306290 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05406759-1a2e-4bad-82b2-edd59038a81a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:57.315149 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a2262-e10f-48ca-bf81-4bd6159d4ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:57.316869 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a2262-e10f-48ca-bf81-4bd6159d4ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:57.317366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a2262-e10f-48ca-bf81-4bd6159d4ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:57.317839 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a2262-e10f-48ca-bf81-4bd6159d4ffb admin admin] PATH_INFO: `/v3/projects/42b3a387f03841ce927a22ce28f1c694/users/836ea11bb4c1453c910e3c458d851a5e/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:57.347476 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a2262-e10f-48ca-bf81-4bd6159d4ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b3a387f03841ce927a22ce28f1c694, user_id=836ea11bb4c1453c910e3c458d851a5e, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:57.352851 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a2262-e10f-48ca-bf81-4bd6159d4ffb admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:57.377774 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1143/2246] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:57 2022] PUT /identity/v3/projects/42b3a387f03841ce927a22ce28f1c694/users/836ea11bb4c1453c910e3c458d851a5e/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:57.389166 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd570b9-d125-4449-84d4-198ad10be3fa None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:57.389900 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd570b9-d125-4449-84d4-198ad10be3fa None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:57.390505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd570b9-d125-4449-84d4-198ad10be3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:57.426726 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-edd570b9-d125-4449-84d4-198ad10be3fa None None] MFA Rules not processed for user `836ea11bb4c1453c910e3c458d851a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:57.428564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-edd570b9-d125-4449-84d4-198ad10be3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:57.532850 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1104/2247] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:09:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:57.557770 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a2262-e10f-48ca-bf81-4bd6159d4ffb admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:57.559896 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-142a2262-e10f-48ca-bf81-4bd6159d4ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:57.637414 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a2262-e10f-48ca-bf81-4bd6159d4ffb admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:57.641693 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec013414-b5c4-4d88-a5b9-bcb25eed8ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:57.642680 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec013414-b5c4-4d88-a5b9-bcb25eed8ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:57.642970 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec013414-b5c4-4d88-a5b9-bcb25eed8ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:57.643284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec013414-b5c4-4d88-a5b9-bcb25eed8ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:57.654415 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec013414-b5c4-4d88-a5b9-bcb25eed8ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:57.655934 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec013414-b5c4-4d88-a5b9-bcb25eed8ba8 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:57.672162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1144/2248] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:58.115164 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5e8d9-42ba-4f9b-835b-e8a74b9585f5 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:58.115689 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5e8d9-42ba-4f9b-835b-e8a74b9585f5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:58.116362 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5e8d9-42ba-4f9b-835b-e8a74b9585f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:58.152455 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f6d5e8d9-42ba-4f9b-835b-e8a74b9585f5 None None] MFA Rules not processed for user `c83195bd720846fc8ed75aedd152a505`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:58.154596 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f6d5e8d9-42ba-4f9b-835b-e8a74b9585f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:58.181294 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:58.302300 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1105/2249] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:09:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:04.372875 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec013414-b5c4-4d88-a5b9-bcb25eed8ba8 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:04.375307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ec013414-b5c4-4d88-a5b9-bcb25eed8ba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:04.540106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:04.595433 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec013414-b5c4-4d88-a5b9-bcb25eed8ba8 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:04.607008 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9401b65-bbb9-45e0-8d4c-af57a43fbd2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:04.607247 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9401b65-bbb9-45e0-8d4c-af57a43fbd2b service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:04.608766 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9401b65-bbb9-45e0-8d4c-af57a43fbd2b service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:04.608766 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9401b65-bbb9-45e0-8d4c-af57a43fbd2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:04.614420 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d9401b65-bbb9-45e0-8d4c-af57a43fbd2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:04.787162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9401b65-bbb9-45e0-8d4c-af57a43fbd2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:04.796587 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9401b65-bbb9-45e0-8d4c-af57a43fbd2b service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:04.818099 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1145/2250] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:10:07.351879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5e8d9-42ba-4f9b-835b-e8a74b9585f5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:07.354725 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f6d5e8d9-42ba-4f9b-835b-e8a74b9585f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:07.545526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5e8d9-42ba-4f9b-835b-e8a74b9585f5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:07.554334 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececb213-3efb-48d4-b738-954868251c9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:07.555052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececb213-3efb-48d4-b738-954868251c9c service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:07.555292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececb213-3efb-48d4-b738-954868251c9c service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:07.555581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececb213-3efb-48d4-b738-954868251c9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:07.558149 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ececb213-3efb-48d4-b738-954868251c9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:07.591408 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ececb213-3efb-48d4-b738-954868251c9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:07.593298 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ececb213-3efb-48d4-b738-954868251c9c service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:07.613074 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1106/2251] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:09.312217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9401b65-bbb9-45e0-8d4c-af57a43fbd2b service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:09.315017 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d9401b65-bbb9-45e0-8d4c-af57a43fbd2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:09.332916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9401b65-bbb9-45e0-8d4c-af57a43fbd2b service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:09.343690 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a310abb-16e2-42d5-bbb5-3073e2b5000e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:09.344661 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a310abb-16e2-42d5-bbb5-3073e2b5000e service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:09.345159 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a310abb-16e2-42d5-bbb5-3073e2b5000e service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:09.345629 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a310abb-16e2-42d5-bbb5-3073e2b5000e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:09.349466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5a310abb-16e2-42d5-bbb5-3073e2b5000e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:09.365842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a310abb-16e2-42d5-bbb5-3073e2b5000e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:09.367687 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a310abb-16e2-42d5-bbb5-3073e2b5000e service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:09.404944 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1146/2252] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:13.206566 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececb213-3efb-48d4-b738-954868251c9c service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:13.235860 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececb213-3efb-48d4-b738-954868251c9c service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:13.255348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955ccfc-a3bc-488e-a80a-0e5b3453dd92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:13.257103 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955ccfc-a3bc-488e-a80a-0e5b3453dd92 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:13.262220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955ccfc-a3bc-488e-a80a-0e5b3453dd92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:13.265339 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955ccfc-a3bc-488e-a80a-0e5b3453dd92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:13.277096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1955ccfc-a3bc-488e-a80a-0e5b3453dd92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:13.333205 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955ccfc-a3bc-488e-a80a-0e5b3453dd92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:13.334782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955ccfc-a3bc-488e-a80a-0e5b3453dd92 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:13.364035 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1107/2253] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:10:16.288407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a310abb-16e2-42d5-bbb5-3073e2b5000e service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:16.289943 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5a310abb-16e2-42d5-bbb5-3073e2b5000e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:16.409995 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a310abb-16e2-42d5-bbb5-3073e2b5000e service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:16.418479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82981b58-d686-4579-aef3-3b6a347f3ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:16.419972 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82981b58-d686-4579-aef3-3b6a347f3ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:16.420305 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82981b58-d686-4579-aef3-3b6a347f3ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:16.420693 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82981b58-d686-4579-aef3-3b6a347f3ecd admin admin] PATH_INFO: `/v3/users/8ed5317fc35e47d9bd6740b6e0c2622c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:16.422315 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82981b58-d686-4579-aef3-3b6a347f3ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed5317fc35e47d9bd6740b6e0c2622c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:16.430767 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82981b58-d686-4579-aef3-3b6a347f3ecd admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:16.548860 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-82981b58-d686-4579-aef3-3b6a347f3ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed5317fc35e47d9bd6740b6e0c2622c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:16.560598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-82981b58-d686-4579-aef3-3b6a347f3ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed5317fc35e47d9bd6740b6e0c2622c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:16.576176 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-82981b58-d686-4579-aef3-3b6a347f3ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed5317fc35e47d9bd6740b6e0c2622c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:16.577184 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-82981b58-d686-4579-aef3-3b6a347f3ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed5317fc35e47d9bd6740b6e0c2622c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:16.577806 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-82981b58-d686-4579-aef3-3b6a347f3ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed5317fc35e47d9bd6740b6e0c2622c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:16.607186 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:16.608878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1147/2254] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:16 2022] DELETE /identity/v3/users/8ed5317fc35e47d9bd6740b6e0c2622c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:10:16.614239 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e76de3-de0b-44aa-8ef5-4ee287c8dd5b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:16.615326 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e76de3-de0b-44aa-8ef5-4ee287c8dd5b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:16.616124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e76de3-de0b-44aa-8ef5-4ee287c8dd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:16.655813 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-18e76de3-de0b-44aa-8ef5-4ee287c8dd5b None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:16.658055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-18e76de3-de0b-44aa-8ef5-4ee287c8dd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:16.753476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1108/2255] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:10:16.773168 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82981b58-d686-4579-aef3-3b6a347f3ecd admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:16.777184 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-82981b58-d686-4579-aef3-3b6a347f3ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:17.027468 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82981b58-d686-4579-aef3-3b6a347f3ecd admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:17.049083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb3da1-5d8b-4381-a60e-2bf1a2de3fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:17.049780 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb3da1-5d8b-4381-a60e-2bf1a2de3fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:17.050067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb3da1-5d8b-4381-a60e-2bf1a2de3fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:17.050341 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb3da1-5d8b-4381-a60e-2bf1a2de3fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:17.069314 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb3da1-5d8b-4381-a60e-2bf1a2de3fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:17.071263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb3da1-5d8b-4381-a60e-2bf1a2de3fb0 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:17.088057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1148/2256] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:17.666346 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e76de3-de0b-44aa-8ef5-4ee287c8dd5b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:17.687784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e76de3-de0b-44aa-8ef5-4ee287c8dd5b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:17.695660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b43156-3cb0-4cef-a770-1d27a7d13f3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:17.698291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b43156-3cb0-4cef-a770-1d27a7d13f3e service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:17.699173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b43156-3cb0-4cef-a770-1d27a7d13f3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:17.699910 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b43156-3cb0-4cef-a770-1d27a7d13f3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:17.704890 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-47b43156-3cb0-4cef-a770-1d27a7d13f3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:17.730321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b43156-3cb0-4cef-a770-1d27a7d13f3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:17.733218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b43156-3cb0-4cef-a770-1d27a7d13f3e service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:17.747742 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb3da1-5d8b-4381-a60e-2bf1a2de3fb0 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:17.750195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8dbb3da1-5d8b-4381-a60e-2bf1a2de3fb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:17.773820 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb3da1-5d8b-4381-a60e-2bf1a2de3fb0 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:17.781820 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6bb9d-9ff6-4b33-863c-9c4a76bc3f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:17.783191 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6bb9d-9ff6-4b33-863c-9c4a76bc3f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:17.783851 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6bb9d-9ff6-4b33-863c-9c4a76bc3f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:17.784585 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6bb9d-9ff6-4b33-863c-9c4a76bc3f4a admin admin] PATH_INFO: `/v3/projects/b11c82f33768465595cbf5fdd9d446f5` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:17.786588 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6bb9d-9ff6-4b33-863c-9c4a76bc3f4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b11c82f33768465595cbf5fdd9d446f5)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:17.789071 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6bb9d-9ff6-4b33-863c-9c4a76bc3f4a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:17.807290 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1109/2257] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:17.863826 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-acc6bb9d-9ff6-4b33-863c-9c4a76bc3f4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b11c82f33768465595cbf5fdd9d446f5', 'request_id': 'req-acc6bb9d-9ff6-4b33-863c-9c4a76bc3f4a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:17.872750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-acc6bb9d-9ff6-4b33-863c-9c4a76bc3f4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b11c82f33768465595cbf5fdd9d446f5', 'request_id': 'req-acc6bb9d-9ff6-4b33-863c-9c4a76bc3f4a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:17.882781 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-acc6bb9d-9ff6-4b33-863c-9c4a76bc3f4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b11c82f33768465595cbf5fdd9d446f5', 'request_id': 'req-acc6bb9d-9ff6-4b33-863c-9c4a76bc3f4a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:17.923904 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-acc6bb9d-9ff6-4b33-863c-9c4a76bc3f4a admin admin] The token cache is being invalidate because project b11c82f33768465595cbf5fdd9d446f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:17.924536 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-acc6bb9d-9ff6-4b33-863c-9c4a76bc3f4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:17.926235 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-acc6bb9d-9ff6-4b33-863c-9c4a76bc3f4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:17.934558 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1149/2258] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:17 2022] DELETE /identity/v3/projects/b11c82f33768465595cbf5fdd9d446f5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:10:17.936847 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b43156-3cb0-4cef-a770-1d27a7d13f3e service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:17.958053 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b43156-3cb0-4cef-a770-1d27a7d13f3e service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:18.019713 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:18.098822 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee10c33-3ac8-4381-bfa0-f25585979c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:18.106037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee10c33-3ac8-4381-bfa0-f25585979c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:18.106037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee10c33-3ac8-4381-bfa0-f25585979c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:18.106037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee10c33-3ac8-4381-bfa0-f25585979c6d admin admin] PATH_INFO: `/v3/users/095664c32c324839a375d3fa12c8e704` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:18.108585 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee10c33-3ac8-4381-bfa0-f25585979c6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=095664c32c324839a375d3fa12c8e704)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:18.117109 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee10c33-3ac8-4381-bfa0-f25585979c6d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:18.261161 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2ee10c33-3ac8-4381-bfa0-f25585979c6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '095664c32c324839a375d3fa12c8e704'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:18.279278 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2ee10c33-3ac8-4381-bfa0-f25585979c6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '095664c32c324839a375d3fa12c8e704'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:18.318899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2ee10c33-3ac8-4381-bfa0-f25585979c6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '095664c32c324839a375d3fa12c8e704'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:18.321289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2ee10c33-3ac8-4381-bfa0-f25585979c6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '095664c32c324839a375d3fa12c8e704'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:18.359379 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2ee10c33-3ac8-4381-bfa0-f25585979c6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '095664c32c324839a375d3fa12c8e704'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:18.384324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1110/2259] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:17 2022] DELETE /identity/v3/users/095664c32c324839a375d3fa12c8e704 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:18.919565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6bb9d-9ff6-4b33-863c-9c4a76bc3f4a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:18.922726 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-acc6bb9d-9ff6-4b33-863c-9c4a76bc3f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:18.952502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6bb9d-9ff6-4b33-863c-9c4a76bc3f4a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:19.079262 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552d34e-407a-4bde-a767-386bb3523ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:19.080957 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552d34e-407a-4bde-a767-386bb3523ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:19.081384 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552d34e-407a-4bde-a767-386bb3523ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:19.081765 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552d34e-407a-4bde-a767-386bb3523ae5 admin admin] PATH_INFO: `/v3/projects/3cef0a62bd0c455fb8c0ee7c71cac6f4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:19.083436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552d34e-407a-4bde-a767-386bb3523ae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cef0a62bd0c455fb8c0ee7c71cac6f4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:19.085875 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552d34e-407a-4bde-a767-386bb3523ae5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:19.187104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:19.229973 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6552d34e-407a-4bde-a767-386bb3523ae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cef0a62bd0c455fb8c0ee7c71cac6f4', 'request_id': 'req-6552d34e-407a-4bde-a767-386bb3523ae5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:19.238920 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6552d34e-407a-4bde-a767-386bb3523ae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cef0a62bd0c455fb8c0ee7c71cac6f4', 'request_id': 'req-6552d34e-407a-4bde-a767-386bb3523ae5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:19.247735 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6552d34e-407a-4bde-a767-386bb3523ae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cef0a62bd0c455fb8c0ee7c71cac6f4', 'request_id': 'req-6552d34e-407a-4bde-a767-386bb3523ae5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:19.269307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6552d34e-407a-4bde-a767-386bb3523ae5 admin admin] The token cache is being invalidate because project 3cef0a62bd0c455fb8c0ee7c71cac6f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:19.269658 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6552d34e-407a-4bde-a767-386bb3523ae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:19.271097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6552d34e-407a-4bde-a767-386bb3523ae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:19.272748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1150/2260] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:18 2022] DELETE /identity/v3/projects/3cef0a62bd0c455fb8c0ee7c71cac6f4 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:19.278427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18147628-773a-47b1-903f-8d00574084f4 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:19.278975 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18147628-773a-47b1-903f-8d00574084f4 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:19.279204 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18147628-773a-47b1-903f-8d00574084f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:19.318932 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-18147628-773a-47b1-903f-8d00574084f4 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:19.321602 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-18147628-773a-47b1-903f-8d00574084f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:19.491658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1111/2261] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:19.500099 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb21273-0036-4c4c-88f2-b13bf303eb9d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:19.500398 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb21273-0036-4c4c-88f2-b13bf303eb9d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:19.500648 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb21273-0036-4c4c-88f2-b13bf303eb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:19.537822 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dcb21273-0036-4c4c-88f2-b13bf303eb9d None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:19.543107 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dcb21273-0036-4c4c-88f2-b13bf303eb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:19.567141 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1151/2262] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:19.569128 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18147628-773a-47b1-903f-8d00574084f4 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:19.598725 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18147628-773a-47b1-903f-8d00574084f4 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:19.615310 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1111c2-15e2-4ca3-8c60-e85292005cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:19.616514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1111c2-15e2-4ca3-8c60-e85292005cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:19.617051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1111c2-15e2-4ca3-8c60-e85292005cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:19.617519 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1111c2-15e2-4ca3-8c60-e85292005cb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:19.619031 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1111c2-15e2-4ca3-8c60-e85292005cb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:19.619575 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1111c2-15e2-4ca3-8c60-e85292005cb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:19.625679 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1111c2-15e2-4ca3-8c60-e85292005cb0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:19.695007 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1112/2263] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:19.696647 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb21273-0036-4c4c-88f2-b13bf303eb9d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:19.713512 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb21273-0036-4c4c-88f2-b13bf303eb9d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:19.723631 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32203b17-130b-44a4-951d-30f7bdbf8487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:19.724643 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32203b17-130b-44a4-951d-30f7bdbf8487 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:19.725183 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32203b17-130b-44a4-951d-30f7bdbf8487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:19.725705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32203b17-130b-44a4-951d-30f7bdbf8487 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:19.727266 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32203b17-130b-44a4-951d-30f7bdbf8487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:19.731946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32203b17-130b-44a4-951d-30f7bdbf8487 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:19.802723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1152/2264] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:19 2022] POST /identity/v3/projects => generated 393 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:19.807929 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1111c2-15e2-4ca3-8c60-e85292005cb0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:19.873119 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1111c2-15e2-4ca3-8c60-e85292005cb0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:20.034911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:20.159597 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f618b08-0cc8-4767-85fc-b7940bb25d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:20.160332 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f618b08-0cc8-4767-85fc-b7940bb25d22 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:20.160616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f618b08-0cc8-4767-85fc-b7940bb25d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:20.160922 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f618b08-0cc8-4767-85fc-b7940bb25d22 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:20.162479 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f618b08-0cc8-4767-85fc-b7940bb25d22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:20.165112 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f618b08-0cc8-4767-85fc-b7940bb25d22 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:20.204136 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1113/2265] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:19 2022] POST /identity/v3/users => generated 297 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:20.208889 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32203b17-130b-44a4-951d-30f7bdbf8487 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:20.224518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32203b17-130b-44a4-951d-30f7bdbf8487 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:20.232071 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7bfb46-abad-4b0d-9e3a-f35722e5d9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:20.233129 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bfb46-abad-4b0d-9e3a-f35722e5d9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:20.233518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bfb46-abad-4b0d-9e3a-f35722e5d9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:20.233950 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bfb46-abad-4b0d-9e3a-f35722e5d9b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:20.235037 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7bfb46-abad-4b0d-9e3a-f35722e5d9b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:20.237035 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7bfb46-abad-4b0d-9e3a-f35722e5d9b1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:20.258318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1153/2266] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:10:20.262988 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f618b08-0cc8-4767-85fc-b7940bb25d22 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:20.279247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f618b08-0cc8-4767-85fc-b7940bb25d22 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:20.293135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10b6b0-68df-4caf-adc3-1b00fb8021b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:20.295532 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10b6b0-68df-4caf-adc3-1b00fb8021b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:20.296332 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10b6b0-68df-4caf-adc3-1b00fb8021b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:20.297508 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10b6b0-68df-4caf-adc3-1b00fb8021b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:20.300943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10b6b0-68df-4caf-adc3-1b00fb8021b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:20.306431 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10b6b0-68df-4caf-adc3-1b00fb8021b6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:20.344653 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7bfb46-abad-4b0d-9e3a-f35722e5d9b1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:20.346204 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1114/2267] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:20.361583 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7bfb46-abad-4b0d-9e3a-f35722e5d9b1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:20.377297 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a096026-b066-4a84-955d-4b430af62f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:20.378342 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a096026-b066-4a84-955d-4b430af62f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:20.378694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a096026-b066-4a84-955d-4b430af62f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:20.379039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a096026-b066-4a84-955d-4b430af62f10 admin admin] PATH_INFO: `/v3/projects/2fe3e2486fe944c393a5e82115493b32/users/ec860a3409ba430eaaa94d8111eb2e69/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:20.417269 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a096026-b066-4a84-955d-4b430af62f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe3e2486fe944c393a5e82115493b32, user_id=ec860a3409ba430eaaa94d8111eb2e69, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:20.420888 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a096026-b066-4a84-955d-4b430af62f10 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:20.465632 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1154/2268] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:20 2022] PUT /identity/v3/projects/2fe3e2486fe944c393a5e82115493b32/users/ec860a3409ba430eaaa94d8111eb2e69/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:20.479158 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872d4f2-09f4-4a79-8ebd-27e7ef5ce712 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:20.479631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872d4f2-09f4-4a79-8ebd-27e7ef5ce712 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:20.480311 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872d4f2-09f4-4a79-8ebd-27e7ef5ce712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:20.529097 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4872d4f2-09f4-4a79-8ebd-27e7ef5ce712 None None] MFA Rules not processed for user `ec860a3409ba430eaaa94d8111eb2e69`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:20.529909 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4872d4f2-09f4-4a79-8ebd-27e7ef5ce712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:20.679122 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1115/2269] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:10:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:20.686250 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a096026-b066-4a84-955d-4b430af62f10 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:20.982869 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a096026-b066-4a84-955d-4b430af62f10 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:20.992406 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda32f17-5b34-4000-97db-4ba68348d129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:20.993894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda32f17-5b34-4000-97db-4ba68348d129 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:20.994580 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda32f17-5b34-4000-97db-4ba68348d129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:20.995948 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda32f17-5b34-4000-97db-4ba68348d129 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:20.998497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda32f17-5b34-4000-97db-4ba68348d129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:21.002671 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda32f17-5b34-4000-97db-4ba68348d129 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:21.102894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1155/2270] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:20 2022] POST /identity/v3/projects => generated 393 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:21.106823 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872d4f2-09f4-4a79-8ebd-27e7ef5ce712 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:21.126044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872d4f2-09f4-4a79-8ebd-27e7ef5ce712 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:21.281303 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898bae9-e797-44fd-922a-2ae35f744039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:21.282664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898bae9-e797-44fd-922a-2ae35f744039 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:21.285996 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898bae9-e797-44fd-922a-2ae35f744039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:21.286990 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898bae9-e797-44fd-922a-2ae35f744039 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:21.290798 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898bae9-e797-44fd-922a-2ae35f744039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:21.296283 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898bae9-e797-44fd-922a-2ae35f744039 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:21.305749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda32f17-5b34-4000-97db-4ba68348d129 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:21.309090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cda32f17-5b34-4000-97db-4ba68348d129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:21.387938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1116/2271] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:21 2022] POST /identity/v3/users => generated 303 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:21.391171 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898bae9-e797-44fd-922a-2ae35f744039 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:21.435537 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:21.456171 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898bae9-e797-44fd-922a-2ae35f744039 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:21.483203 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ae47e-f3d8-42fc-bdd5-0e9ca95587ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:21.484103 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ae47e-f3d8-42fc-bdd5-0e9ca95587ec admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:21.489486 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ae47e-f3d8-42fc-bdd5-0e9ca95587ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:21.490079 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ae47e-f3d8-42fc-bdd5-0e9ca95587ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:21.493040 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ae47e-f3d8-42fc-bdd5-0e9ca95587ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:21.497155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda32f17-5b34-4000-97db-4ba68348d129 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:21.498512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ae47e-f3d8-42fc-bdd5-0e9ca95587ec admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:21.503013 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716394d7-3351-4c49-9103-acd96031e315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:21.504543 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716394d7-3351-4c49-9103-acd96031e315 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:21.505619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716394d7-3351-4c49-9103-acd96031e315 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:21.506155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716394d7-3351-4c49-9103-acd96031e315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:21.518196 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-716394d7-3351-4c49-9103-acd96031e315 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:21.537449 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716394d7-3351-4c49-9103-acd96031e315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:21.539340 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716394d7-3351-4c49-9103-acd96031e315 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:21.554369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1117/2272] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:21.554695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1156/2273] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:10:21.558429 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ae47e-f3d8-42fc-bdd5-0e9ca95587ec admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:21.578494 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ae47e-f3d8-42fc-bdd5-0e9ca95587ec admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:21.590684 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf18bfd-91b9-48ed-b2b8-78ee5ed5515c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:21.591804 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf18bfd-91b9-48ed-b2b8-78ee5ed5515c admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:21.592097 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf18bfd-91b9-48ed-b2b8-78ee5ed5515c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:21.592373 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf18bfd-91b9-48ed-b2b8-78ee5ed5515c admin admin] PATH_INFO: `/v3/projects/fd2d4da2d83f41bf91c07bed15ae8b2f/users/c743318a4a754dd7b6ca1fddf73c8a42/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:21.615076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf18bfd-91b9-48ed-b2b8-78ee5ed5515c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2d4da2d83f41bf91c07bed15ae8b2f, user_id=c743318a4a754dd7b6ca1fddf73c8a42, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:21.618905 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf18bfd-91b9-48ed-b2b8-78ee5ed5515c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:21.623955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:21.652786 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1118/2274] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:21 2022] PUT /identity/v3/projects/fd2d4da2d83f41bf91c07bed15ae8b2f/users/c743318a4a754dd7b6ca1fddf73c8a42/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:10:21.656192 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716394d7-3351-4c49-9103-acd96031e315 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:21.672431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716394d7-3351-4c49-9103-acd96031e315 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:21.812809 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea903b58-f17d-4af4-81fb-2c3d5eb77891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:21.814908 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea903b58-f17d-4af4-81fb-2c3d5eb77891 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:21.815502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea903b58-f17d-4af4-81fb-2c3d5eb77891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:21.816033 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea903b58-f17d-4af4-81fb-2c3d5eb77891 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:21.817495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea903b58-f17d-4af4-81fb-2c3d5eb77891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:21.820997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea903b58-f17d-4af4-81fb-2c3d5eb77891 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:21.847426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1157/2275] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:10:21.851993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf18bfd-91b9-48ed-b2b8-78ee5ed5515c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:21.892520 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf18bfd-91b9-48ed-b2b8-78ee5ed5515c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:21.907010 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff62adb-27f0-401f-994b-13cc409f9819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:21.909417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff62adb-27f0-401f-994b-13cc409f9819 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:21.910009 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff62adb-27f0-401f-994b-13cc409f9819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:21.912604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff62adb-27f0-401f-994b-13cc409f9819 admin admin] PATH_INFO: `/v3/projects/fd2d4da2d83f41bf91c07bed15ae8b2f/users/c743318a4a754dd7b6ca1fddf73c8a42/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:21.916497 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff62adb-27f0-401f-994b-13cc409f9819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2d4da2d83f41bf91c07bed15ae8b2f, user_id=c743318a4a754dd7b6ca1fddf73c8a42, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:21.921011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff62adb-27f0-401f-994b-13cc409f9819 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:21.940504 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1119/2276] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:21 2022] PUT /identity/v3/projects/fd2d4da2d83f41bf91c07bed15ae8b2f/users/c743318a4a754dd7b6ca1fddf73c8a42/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:21.953090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a389922-d1d6-4c85-ba78-5e45ab0e9a7a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:21.954217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a389922-d1d6-4c85-ba78-5e45ab0e9a7a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:21.954948 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a389922-d1d6-4c85-ba78-5e45ab0e9a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:22.055380 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3a389922-d1d6-4c85-ba78-5e45ab0e9a7a None None] MFA Rules not processed for user `c743318a4a754dd7b6ca1fddf73c8a42`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:22.058158 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3a389922-d1d6-4c85-ba78-5e45ab0e9a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:22.240770 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1158/2277] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:10:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:22.277311 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff62adb-27f0-401f-994b-13cc409f9819 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:22.598875 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff62adb-27f0-401f-994b-13cc409f9819 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:22.608397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e5eba-dc78-419e-a5db-af68640624ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:22.609135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e5eba-dc78-419e-a5db-af68640624ee service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:22.609424 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e5eba-dc78-419e-a5db-af68640624ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:22.609706 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e5eba-dc78-419e-a5db-af68640624ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:22.650253 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e5eba-dc78-419e-a5db-af68640624ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:22.651840 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e5eba-dc78-419e-a5db-af68640624ee service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:22.665704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1120/2278] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:28.770593 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a389922-d1d6-4c85-ba78-5e45ab0e9a7a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:28.772877 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3a389922-d1d6-4c85-ba78-5e45ab0e9a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:29.119090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a389922-d1d6-4c85-ba78-5e45ab0e9a7a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:29.157040 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547c87f-576e-48b8-ab0d-870981a013e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:29.162172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547c87f-576e-48b8-ab0d-870981a013e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:29.168356 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547c87f-576e-48b8-ab0d-870981a013e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:29.168929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547c87f-576e-48b8-ab0d-870981a013e6 admin admin] PATH_INFO: `/v3/users/917700ed75464456a056f42c446eaf6a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:29.172938 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547c87f-576e-48b8-ab0d-870981a013e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=917700ed75464456a056f42c446eaf6a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:29.177584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547c87f-576e-48b8-ab0d-870981a013e6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:29.180753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:29.373243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e547c87f-576e-48b8-ab0d-870981a013e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '917700ed75464456a056f42c446eaf6a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:29.394143 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e547c87f-576e-48b8-ab0d-870981a013e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '917700ed75464456a056f42c446eaf6a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:29.421022 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e547c87f-576e-48b8-ab0d-870981a013e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '917700ed75464456a056f42c446eaf6a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:29.424209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e547c87f-576e-48b8-ab0d-870981a013e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '917700ed75464456a056f42c446eaf6a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:29.425308 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e547c87f-576e-48b8-ab0d-870981a013e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '917700ed75464456a056f42c446eaf6a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:29.503987 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1159/2279] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:28 2022] DELETE /identity/v3/users/917700ed75464456a056f42c446eaf6a => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:10:29.783605 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e5eba-dc78-419e-a5db-af68640624ee service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:29.815708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e5eba-dc78-419e-a5db-af68640624ee service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:29.978038 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f11a9-b8b4-4ac5-bf73-65cf45c25c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:29.980351 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f11a9-b8b4-4ac5-bf73-65cf45c25c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:29.985352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f11a9-b8b4-4ac5-bf73-65cf45c25c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:29.986226 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f11a9-b8b4-4ac5-bf73-65cf45c25c21 admin admin] PATH_INFO: `/v3/users/ec860a3409ba430eaaa94d8111eb2e69` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:29.992573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f11a9-b8b4-4ac5-bf73-65cf45c25c21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec860a3409ba430eaaa94d8111eb2e69)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:30.003585 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f11a9-b8b4-4ac5-bf73-65cf45c25c21 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:30.158930 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b84f11a9-b8b4-4ac5-bf73-65cf45c25c21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec860a3409ba430eaaa94d8111eb2e69'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:30.184095 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b84f11a9-b8b4-4ac5-bf73-65cf45c25c21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec860a3409ba430eaaa94d8111eb2e69'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:30.225259 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b84f11a9-b8b4-4ac5-bf73-65cf45c25c21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec860a3409ba430eaaa94d8111eb2e69'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:30.226095 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b84f11a9-b8b4-4ac5-bf73-65cf45c25c21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec860a3409ba430eaaa94d8111eb2e69'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:30.243976 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b84f11a9-b8b4-4ac5-bf73-65cf45c25c21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec860a3409ba430eaaa94d8111eb2e69'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:30.255696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1121/2280] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:29 2022] DELETE /identity/v3/users/ec860a3409ba430eaaa94d8111eb2e69 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:30.258397 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49df53e-11bf-4a06-961d-4c23b1299bd3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:30.258983 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49df53e-11bf-4a06-961d-4c23b1299bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:30.259591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49df53e-11bf-4a06-961d-4c23b1299bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:30.298066 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f49df53e-11bf-4a06-961d-4c23b1299bd3 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:30.300840 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f49df53e-11bf-4a06-961d-4c23b1299bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:30.508975 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1160/2281] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:30.541903 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f11a9-b8b4-4ac5-bf73-65cf45c25c21 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:30.547071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b84f11a9-b8b4-4ac5-bf73-65cf45c25c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:30.565834 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:30.717644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f11a9-b8b4-4ac5-bf73-65cf45c25c21 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:30.732653 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d73959-eaac-4ed6-8bf2-6d611c176e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:30.735964 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d73959-eaac-4ed6-8bf2-6d611c176e9e service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:30.737404 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d73959-eaac-4ed6-8bf2-6d611c176e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:30.737997 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d73959-eaac-4ed6-8bf2-6d611c176e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:30.754871 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d73959-eaac-4ed6-8bf2-6d611c176e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:30.757559 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d73959-eaac-4ed6-8bf2-6d611c176e9e service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:30.799981 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1122/2282] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:31.355425 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49df53e-11bf-4a06-961d-4c23b1299bd3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:31.358355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f49df53e-11bf-4a06-961d-4c23b1299bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:31.393750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49df53e-11bf-4a06-961d-4c23b1299bd3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:31.421823 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31461fd5-ac23-4ef3-897c-2d4fa03e1845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:31.423800 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31461fd5-ac23-4ef3-897c-2d4fa03e1845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:31.424342 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31461fd5-ac23-4ef3-897c-2d4fa03e1845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:31.424992 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31461fd5-ac23-4ef3-897c-2d4fa03e1845 admin admin] PATH_INFO: `/v3/projects/d2d9f362b6844df2b1e604aa20002edf` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:31.429080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31461fd5-ac23-4ef3-897c-2d4fa03e1845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d9f362b6844df2b1e604aa20002edf)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:31.436638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31461fd5-ac23-4ef3-897c-2d4fa03e1845 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:31.556737 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-31461fd5-ac23-4ef3-897c-2d4fa03e1845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d9f362b6844df2b1e604aa20002edf', 'request_id': 'req-31461fd5-ac23-4ef3-897c-2d4fa03e1845'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:31.571094 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-31461fd5-ac23-4ef3-897c-2d4fa03e1845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d9f362b6844df2b1e604aa20002edf', 'request_id': 'req-31461fd5-ac23-4ef3-897c-2d4fa03e1845'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:31.584007 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-31461fd5-ac23-4ef3-897c-2d4fa03e1845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d9f362b6844df2b1e604aa20002edf', 'request_id': 'req-31461fd5-ac23-4ef3-897c-2d4fa03e1845'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:31.616368 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-31461fd5-ac23-4ef3-897c-2d4fa03e1845 admin admin] The token cache is being invalidate because project d2d9f362b6844df2b1e604aa20002edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:31.617074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-31461fd5-ac23-4ef3-897c-2d4fa03e1845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:31.618565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-31461fd5-ac23-4ef3-897c-2d4fa03e1845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:31.623682 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1161/2283] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:31 2022] DELETE /identity/v3/projects/d2d9f362b6844df2b1e604aa20002edf => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:31.629388 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b14a75-5a5f-4f3e-bc00-4ec19af5b5d0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:31.629664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b14a75-5a5f-4f3e-bc00-4ec19af5b5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:31.630035 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b14a75-5a5f-4f3e-bc00-4ec19af5b5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:31.651827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-32b14a75-5a5f-4f3e-bc00-4ec19af5b5d0 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:31.653077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-32b14a75-5a5f-4f3e-bc00-4ec19af5b5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:31.777175 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1123/2284] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:31.791001 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96c7e6-8506-499e-a206-0ed686f7804c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:31.793977 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96c7e6-8506-499e-a206-0ed686f7804c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:31.794269 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96c7e6-8506-499e-a206-0ed686f7804c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:31.805787 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:31.822358 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7e96c7e6-8506-499e-a206-0ed686f7804c None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:31.824385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7e96c7e6-8506-499e-a206-0ed686f7804c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:31.841235 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1162/2285] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:31.845808 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b14a75-5a5f-4f3e-bc00-4ec19af5b5d0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:31.861003 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b14a75-5a5f-4f3e-bc00-4ec19af5b5d0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:31.887658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ebd93-298e-447d-9b59-4822f70a8524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:31.888780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ebd93-298e-447d-9b59-4822f70a8524 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:31.889352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ebd93-298e-447d-9b59-4822f70a8524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:31.890630 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ebd93-298e-447d-9b59-4822f70a8524 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:31.892785 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ebd93-298e-447d-9b59-4822f70a8524 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:31.893500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ebd93-298e-447d-9b59-4822f70a8524 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:31.896933 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ebd93-298e-447d-9b59-4822f70a8524 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:31.936101 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96c7e6-8506-499e-a206-0ed686f7804c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:31.949227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1124/2286] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:31.953294 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96c7e6-8506-499e-a206-0ed686f7804c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:31.964489 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3262ca6-0def-43e3-98c6-5617c63ea6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:31.966076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3262ca6-0def-43e3-98c6-5617c63ea6dc admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:31.966740 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3262ca6-0def-43e3-98c6-5617c63ea6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:31.967479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3262ca6-0def-43e3-98c6-5617c63ea6dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:31.969270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3262ca6-0def-43e3-98c6-5617c63ea6dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:31.973857 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3262ca6-0def-43e3-98c6-5617c63ea6dc admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:32.043508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1163/2287] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:31 2022] POST /identity/v3/projects => generated 393 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:32.045741 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ebd93-298e-447d-9b59-4822f70a8524 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:32.063332 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ebd93-298e-447d-9b59-4822f70a8524 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:32.186101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930029a-0f0a-4478-8e4b-6d07dd20577a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:32.187110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930029a-0f0a-4478-8e4b-6d07dd20577a admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:32.188379 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930029a-0f0a-4478-8e4b-6d07dd20577a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:32.188897 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930029a-0f0a-4478-8e4b-6d07dd20577a admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:32.189934 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930029a-0f0a-4478-8e4b-6d07dd20577a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:32.192911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930029a-0f0a-4478-8e4b-6d07dd20577a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:32.237595 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1125/2288] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:32 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:32.240636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3262ca6-0def-43e3-98c6-5617c63ea6dc admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:32.264585 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3262ca6-0def-43e3-98c6-5617c63ea6dc admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:32.273418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaebc35-5da1-49d9-99a2-3fffae82ef7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:32.274855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaebc35-5da1-49d9-99a2-3fffae82ef7f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:32.275417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaebc35-5da1-49d9-99a2-3fffae82ef7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:32.276008 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaebc35-5da1-49d9-99a2-3fffae82ef7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:32.277532 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaebc35-5da1-49d9-99a2-3fffae82ef7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:32.281089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaebc35-5da1-49d9-99a2-3fffae82ef7f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:32.306975 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1164/2289] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:32.309114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930029a-0f0a-4478-8e4b-6d07dd20577a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:32.325302 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930029a-0f0a-4478-8e4b-6d07dd20577a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:32.331740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d341c5-65a0-433a-b394-eace51021a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:32.333301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d341c5-65a0-433a-b394-eace51021a16 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:32.333771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d341c5-65a0-433a-b394-eace51021a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:32.334218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d341c5-65a0-433a-b394-eace51021a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:32.335145 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d341c5-65a0-433a-b394-eace51021a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:32.338019 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d341c5-65a0-433a-b394-eace51021a16 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:32.360050 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1126/2290] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:32.362248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaebc35-5da1-49d9-99a2-3fffae82ef7f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:32.388980 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaebc35-5da1-49d9-99a2-3fffae82ef7f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:32.398540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe70f19-1732-4262-bdf0-4cb42544b5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:32.400509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe70f19-1732-4262-bdf0-4cb42544b5a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:32.401380 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe70f19-1732-4262-bdf0-4cb42544b5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:32.402512 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe70f19-1732-4262-bdf0-4cb42544b5a3 admin admin] PATH_INFO: `/v3/projects/3604434a40c44e4888c3ff8c607b0722/users/2bc2e66079784b2587d660d2197c7f4c/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:32.440961 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe70f19-1732-4262-bdf0-4cb42544b5a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3604434a40c44e4888c3ff8c607b0722, user_id=2bc2e66079784b2587d660d2197c7f4c, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:32.447063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe70f19-1732-4262-bdf0-4cb42544b5a3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:32.507735 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1165/2291] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:32 2022] PUT /identity/v3/projects/3604434a40c44e4888c3ff8c607b0722/users/2bc2e66079784b2587d660d2197c7f4c/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:32.531514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58205c0-1005-4014-a2ff-4be0d6870e49 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:32.532394 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58205c0-1005-4014-a2ff-4be0d6870e49 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:32.533052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58205c0-1005-4014-a2ff-4be0d6870e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:32.600190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:32.610046 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b58205c0-1005-4014-a2ff-4be0d6870e49 None None] MFA Rules not processed for user `2bc2e66079784b2587d660d2197c7f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:32.611425 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b58205c0-1005-4014-a2ff-4be0d6870e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:32.824851 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1127/2292] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:10:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:32.834372 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe70f19-1732-4262-bdf0-4cb42544b5a3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:32.836621 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3fe70f19-1732-4262-bdf0-4cb42544b5a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:33.035173 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe70f19-1732-4262-bdf0-4cb42544b5a3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:33.050147 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e4545-6a74-4587-9fdc-4a70e9ea8d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:33.051277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e4545-6a74-4587-9fdc-4a70e9ea8d76 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:33.051752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e4545-6a74-4587-9fdc-4a70e9ea8d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:33.052230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e4545-6a74-4587-9fdc-4a70e9ea8d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:33.085656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e4545-6a74-4587-9fdc-4a70e9ea8d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:33.087334 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e4545-6a74-4587-9fdc-4a70e9ea8d76 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:33.131086 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1166/2293] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:10:33.172701 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58205c0-1005-4014-a2ff-4be0d6870e49 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:33.176077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b58205c0-1005-4014-a2ff-4be0d6870e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:33.311070 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58205c0-1005-4014-a2ff-4be0d6870e49 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:33.329119 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edaecb-faaa-46c2-89b9-972e3fe8eda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:33.330220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edaecb-faaa-46c2-89b9-972e3fe8eda6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:33.331341 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edaecb-faaa-46c2-89b9-972e3fe8eda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:33.331341 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edaecb-faaa-46c2-89b9-972e3fe8eda6 admin admin] PATH_INFO: `/v3/projects/2fe3e2486fe944c393a5e82115493b32` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:33.332611 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edaecb-faaa-46c2-89b9-972e3fe8eda6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fe3e2486fe944c393a5e82115493b32)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:33.335688 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edaecb-faaa-46c2-89b9-972e3fe8eda6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:33.477029 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f1edaecb-faaa-46c2-89b9-972e3fe8eda6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fe3e2486fe944c393a5e82115493b32', 'request_id': 'req-f1edaecb-faaa-46c2-89b9-972e3fe8eda6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:33.524916 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f1edaecb-faaa-46c2-89b9-972e3fe8eda6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fe3e2486fe944c393a5e82115493b32', 'request_id': 'req-f1edaecb-faaa-46c2-89b9-972e3fe8eda6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:33.557069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f1edaecb-faaa-46c2-89b9-972e3fe8eda6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fe3e2486fe944c393a5e82115493b32', 'request_id': 'req-f1edaecb-faaa-46c2-89b9-972e3fe8eda6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:33.582542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f1edaecb-faaa-46c2-89b9-972e3fe8eda6 admin admin] The token cache is being invalidate because project 2fe3e2486fe944c393a5e82115493b32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:33.582542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f1edaecb-faaa-46c2-89b9-972e3fe8eda6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:33.585485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f1edaecb-faaa-46c2-89b9-972e3fe8eda6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:33.593316 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1128/2294] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:33 2022] DELETE /identity/v3/projects/2fe3e2486fe944c393a5e82115493b32 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:33.594458 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e4545-6a74-4587-9fdc-4a70e9ea8d76 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:33.613459 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e4545-6a74-4587-9fdc-4a70e9ea8d76 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:33.935546 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243f139-bc0d-4bc5-8bef-4349078cb211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:33.937088 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243f139-bc0d-4bc5-8bef-4349078cb211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:33.937588 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243f139-bc0d-4bc5-8bef-4349078cb211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:33.938170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243f139-bc0d-4bc5-8bef-4349078cb211 admin admin] PATH_INFO: `/v3/users/c743318a4a754dd7b6ca1fddf73c8a42` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:33.940569 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243f139-bc0d-4bc5-8bef-4349078cb211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c743318a4a754dd7b6ca1fddf73c8a42)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:33.944564 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243f139-bc0d-4bc5-8bef-4349078cb211 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:34.062120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:34.078558 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1243f139-bc0d-4bc5-8bef-4349078cb211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c743318a4a754dd7b6ca1fddf73c8a42'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:34.102374 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1243f139-bc0d-4bc5-8bef-4349078cb211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c743318a4a754dd7b6ca1fddf73c8a42'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:34.126092 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1243f139-bc0d-4bc5-8bef-4349078cb211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c743318a4a754dd7b6ca1fddf73c8a42'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:34.129045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1243f139-bc0d-4bc5-8bef-4349078cb211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c743318a4a754dd7b6ca1fddf73c8a42'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:34.130998 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1243f139-bc0d-4bc5-8bef-4349078cb211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c743318a4a754dd7b6ca1fddf73c8a42'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:34.206432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1167/2295] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:33 2022] DELETE /identity/v3/users/c743318a4a754dd7b6ca1fddf73c8a42 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:34.791742 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edaecb-faaa-46c2-89b9-972e3fe8eda6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:34.795409 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f1edaecb-faaa-46c2-89b9-972e3fe8eda6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:34.835025 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edaecb-faaa-46c2-89b9-972e3fe8eda6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:34.995819 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:35.120665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a2cca-d4bb-4247-b66a-b75209d38d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:35.122914 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a2cca-d4bb-4247-b66a-b75209d38d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:35.123677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a2cca-d4bb-4247-b66a-b75209d38d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:35.124202 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a2cca-d4bb-4247-b66a-b75209d38d8a admin admin] PATH_INFO: `/v3/projects/fd2d4da2d83f41bf91c07bed15ae8b2f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:35.126767 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a2cca-d4bb-4247-b66a-b75209d38d8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd2d4da2d83f41bf91c07bed15ae8b2f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:35.130191 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a2cca-d4bb-4247-b66a-b75209d38d8a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:35.317969 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b59a2cca-d4bb-4247-b66a-b75209d38d8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd2d4da2d83f41bf91c07bed15ae8b2f', 'request_id': 'req-b59a2cca-d4bb-4247-b66a-b75209d38d8a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:35.337217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b59a2cca-d4bb-4247-b66a-b75209d38d8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd2d4da2d83f41bf91c07bed15ae8b2f', 'request_id': 'req-b59a2cca-d4bb-4247-b66a-b75209d38d8a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:35.347448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b59a2cca-d4bb-4247-b66a-b75209d38d8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd2d4da2d83f41bf91c07bed15ae8b2f', 'request_id': 'req-b59a2cca-d4bb-4247-b66a-b75209d38d8a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:35.378649 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b59a2cca-d4bb-4247-b66a-b75209d38d8a admin admin] The token cache is being invalidate because project fd2d4da2d83f41bf91c07bed15ae8b2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:35.378649 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b59a2cca-d4bb-4247-b66a-b75209d38d8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:35.379094 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b59a2cca-d4bb-4247-b66a-b75209d38d8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:35.380784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1129/2296] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:34 2022] DELETE /identity/v3/projects/fd2d4da2d83f41bf91c07bed15ae8b2f => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:35.395263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdf3a1-81ec-46a0-8c88-cd985d06e107 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:35.414487 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdf3a1-81ec-46a0-8c88-cd985d06e107 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:35.422556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdf3a1-81ec-46a0-8c88-cd985d06e107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:35.517921 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4ecdf3a1-81ec-46a0-8c88-cd985d06e107 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:35.520551 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4ecdf3a1-81ec-46a0-8c88-cd985d06e107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:35.740512 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1168/2297] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:35.753100 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c15ea5-7339-4ea8-bcf1-7e56ac4c7ad0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:35.753620 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c15ea5-7339-4ea8-bcf1-7e56ac4c7ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:35.754057 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c15ea5-7339-4ea8-bcf1-7e56ac4c7ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:35.828106 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b3c15ea5-7339-4ea8-bcf1-7e56ac4c7ad0 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:35.834261 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b3c15ea5-7339-4ea8-bcf1-7e56ac4c7ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:35.862417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1130/2298] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:35.870572 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecdf3a1-81ec-46a0-8c88-cd985d06e107 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:35.884437 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecdf3a1-81ec-46a0-8c88-cd985d06e107 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:35.890478 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2eb7b4-0bb2-49aa-852c-fcc5147cca98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:35.891590 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2eb7b4-0bb2-49aa-852c-fcc5147cca98 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:35.892020 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2eb7b4-0bb2-49aa-852c-fcc5147cca98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:35.892493 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2eb7b4-0bb2-49aa-852c-fcc5147cca98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:35.893519 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2eb7b4-0bb2-49aa-852c-fcc5147cca98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:35.894172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2eb7b4-0bb2-49aa-852c-fcc5147cca98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:35.896206 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2eb7b4-0bb2-49aa-852c-fcc5147cca98 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:35.911146 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1169/2299] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:35.918716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c15ea5-7339-4ea8-bcf1-7e56ac4c7ad0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:35.940838 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c15ea5-7339-4ea8-bcf1-7e56ac4c7ad0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:35.951588 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855825de-fd26-4e80-a659-dc21388ff930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:35.953412 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855825de-fd26-4e80-a659-dc21388ff930 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:35.954014 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855825de-fd26-4e80-a659-dc21388ff930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:35.954563 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855825de-fd26-4e80-a659-dc21388ff930 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:35.958138 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855825de-fd26-4e80-a659-dc21388ff930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:35.963650 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855825de-fd26-4e80-a659-dc21388ff930 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:36.037355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2eb7b4-0bb2-49aa-852c-fcc5147cca98 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:36.037627 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1131/2300] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:35 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:36.064411 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2eb7b4-0bb2-49aa-852c-fcc5147cca98 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:36.318753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c890a-2d6f-40ba-ad99-242b86bed715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:36.327890 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c890a-2d6f-40ba-ad99-242b86bed715 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:36.329214 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c890a-2d6f-40ba-ad99-242b86bed715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:36.329460 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c890a-2d6f-40ba-ad99-242b86bed715 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:36.331071 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c890a-2d6f-40ba-ad99-242b86bed715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:36.336517 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c890a-2d6f-40ba-ad99-242b86bed715 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:36.412461 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1170/2301] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:36 2022] POST /identity/v3/users => generated 289 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:10:36.416296 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855825de-fd26-4e80-a659-dc21388ff930 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:36.475889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855825de-fd26-4e80-a659-dc21388ff930 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:36.489309 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ac9e9-f935-42ae-99f2-230f65f6df0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:36.491620 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ac9e9-f935-42ae-99f2-230f65f6df0f admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:36.492386 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ac9e9-f935-42ae-99f2-230f65f6df0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:36.493126 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ac9e9-f935-42ae-99f2-230f65f6df0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:36.494741 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ac9e9-f935-42ae-99f2-230f65f6df0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:36.498981 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ac9e9-f935-42ae-99f2-230f65f6df0f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:36.530430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1132/2302] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:36.530879 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c890a-2d6f-40ba-ad99-242b86bed715 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:36.553820 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c890a-2d6f-40ba-ad99-242b86bed715 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:36.563153 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced8900-7b49-42d6-a388-2ed53e97af7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:36.564799 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced8900-7b49-42d6-a388-2ed53e97af7d admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:36.565511 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced8900-7b49-42d6-a388-2ed53e97af7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:36.566174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced8900-7b49-42d6-a388-2ed53e97af7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:36.567815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced8900-7b49-42d6-a388-2ed53e97af7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:36.571597 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced8900-7b49-42d6-a388-2ed53e97af7d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:36.625264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ac9e9-f935-42ae-99f2-230f65f6df0f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:36.634834 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1171/2303] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:36.647719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ac9e9-f935-42ae-99f2-230f65f6df0f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:36.675593 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46278e22-53b1-47cb-8bd2-ae525eacbefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:36.676546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46278e22-53b1-47cb-8bd2-ae525eacbefc admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:36.676899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46278e22-53b1-47cb-8bd2-ae525eacbefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:36.677165 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46278e22-53b1-47cb-8bd2-ae525eacbefc admin admin] PATH_INFO: `/v3/projects/aa3a334f458b47adb53f709fb78a0c19/users/1a84e0814a324e1eb09baa7a28f7460a/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:36.702452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46278e22-53b1-47cb-8bd2-ae525eacbefc admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3a334f458b47adb53f709fb78a0c19, user_id=1a84e0814a324e1eb09baa7a28f7460a, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:36.706317 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46278e22-53b1-47cb-8bd2-ae525eacbefc admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:36.744872 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c72614-fd6b-4c5f-988c-08d263127cba None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:36.745165 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c72614-fd6b-4c5f-988c-08d263127cba None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:36.745521 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c72614-fd6b-4c5f-988c-08d263127cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:36.747324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1133/2304] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:36 2022] PUT /identity/v3/projects/aa3a334f458b47adb53f709fb78a0c19/users/1a84e0814a324e1eb09baa7a28f7460a/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:36.788309 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-73c72614-fd6b-4c5f-988c-08d263127cba None None] MFA Rules not processed for user `1a84e0814a324e1eb09baa7a28f7460a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:36.789988 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-73c72614-fd6b-4c5f-988c-08d263127cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:36.813510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:36.942291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1172/2305] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:10:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:36.972015 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46278e22-53b1-47cb-8bd2-ae525eacbefc admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:36.977706 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-46278e22-53b1-47cb-8bd2-ae525eacbefc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:37.108273 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46278e22-53b1-47cb-8bd2-ae525eacbefc admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:37.114921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373469e5-94b5-4526-a7aa-c77c96bd0cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:37.115770 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373469e5-94b5-4526-a7aa-c77c96bd0cba service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:37.116118 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373469e5-94b5-4526-a7aa-c77c96bd0cba service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:37.116478 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373469e5-94b5-4526-a7aa-c77c96bd0cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:37.134354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373469e5-94b5-4526-a7aa-c77c96bd0cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:37.137163 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373469e5-94b5-4526-a7aa-c77c96bd0cba service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:37.150574 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1134/2306] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:42.733295 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c72614-fd6b-4c5f-988c-08d263127cba None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:42.735950 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-73c72614-fd6b-4c5f-988c-08d263127cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:42.780695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c72614-fd6b-4c5f-988c-08d263127cba None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:42.802274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02af8b-5e63-4045-84b0-0c15c8f7cd3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:42.804547 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02af8b-5e63-4045-84b0-0c15c8f7cd3b service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:42.806932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02af8b-5e63-4045-84b0-0c15c8f7cd3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:42.807803 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02af8b-5e63-4045-84b0-0c15c8f7cd3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:42.813244 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8a02af8b-5e63-4045-84b0-0c15c8f7cd3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:42.984893 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02af8b-5e63-4045-84b0-0c15c8f7cd3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:42.986681 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02af8b-5e63-4045-84b0-0c15c8f7cd3b service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:43.001431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1173/2307] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:47.144120 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:50.920687 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373469e5-94b5-4526-a7aa-c77c96bd0cba service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:50.923449 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-373469e5-94b5-4526-a7aa-c77c96bd0cba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:51.044426 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373469e5-94b5-4526-a7aa-c77c96bd0cba service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:51.057570 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cf03b-a5e0-4b9d-9425-8ff0766a0871 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:51.059115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cf03b-a5e0-4b9d-9425-8ff0766a0871 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:51.060054 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cf03b-a5e0-4b9d-9425-8ff0766a0871 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:51.060572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cf03b-a5e0-4b9d-9425-8ff0766a0871 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:51.063377 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f95cf03b-a5e0-4b9d-9425-8ff0766a0871 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:51.079251 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95cf03b-a5e0-4b9d-9425-8ff0766a0871 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:51.081878 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95cf03b-a5e0-4b9d-9425-8ff0766a0871 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:51.095852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1135/2308] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:52.994015 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=50 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:56.743265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02af8b-5e63-4045-84b0-0c15c8f7cd3b service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:56.744830 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8a02af8b-5e63-4045-84b0-0c15c8f7cd3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:56.888609 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02af8b-5e63-4045-84b0-0c15c8f7cd3b service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:56.898315 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc414e-b7df-4c83-b4a7-41cd5e7f0cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:56.900010 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc414e-b7df-4c83-b4a7-41cd5e7f0cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:56.901560 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc414e-b7df-4c83-b4a7-41cd5e7f0cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:56.902065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc414e-b7df-4c83-b4a7-41cd5e7f0cdc admin admin] PATH_INFO: `/v3/users/2bc2e66079784b2587d660d2197c7f4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:56.905077 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc414e-b7df-4c83-b4a7-41cd5e7f0cdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc2e66079784b2587d660d2197c7f4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:56.910384 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc414e-b7df-4c83-b4a7-41cd5e7f0cdc admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:56.997911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-03fc414e-b7df-4c83-b4a7-41cd5e7f0cdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc2e66079784b2587d660d2197c7f4c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:57.010614 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-03fc414e-b7df-4c83-b4a7-41cd5e7f0cdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc2e66079784b2587d660d2197c7f4c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:57.022926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-03fc414e-b7df-4c83-b4a7-41cd5e7f0cdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc2e66079784b2587d660d2197c7f4c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:57.023792 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-03fc414e-b7df-4c83-b4a7-41cd5e7f0cdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc2e66079784b2587d660d2197c7f4c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:57.024414 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-03fc414e-b7df-4c83-b4a7-41cd5e7f0cdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc2e66079784b2587d660d2197c7f4c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:57.059798 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8846f-a0d3-430e-a065-c902a8ab9491 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:57.060419 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1174/2309] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:56 2022] DELETE /identity/v3/users/2bc2e66079784b2587d660d2197c7f4c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:57.060913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8846f-a0d3-430e-a065-c902a8ab9491 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:57.061777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8846f-a0d3-430e-a065-c902a8ab9491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:57.082046 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1ce8846f-a0d3-430e-a065-c902a8ab9491 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:57.083649 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1ce8846f-a0d3-430e-a065-c902a8ab9491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:57.163149 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1136/2310] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:57.232321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc414e-b7df-4c83-b4a7-41cd5e7f0cdc admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:57.235777 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-03fc414e-b7df-4c83-b4a7-41cd5e7f0cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:57.348932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc414e-b7df-4c83-b4a7-41cd5e7f0cdc admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:57.353170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec732c-3162-472f-9576-5f2bc061eacd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:57.354229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec732c-3162-472f-9576-5f2bc061eacd service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:57.354229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec732c-3162-472f-9576-5f2bc061eacd service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:57.354783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec732c-3162-472f-9576-5f2bc061eacd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:57.366750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec732c-3162-472f-9576-5f2bc061eacd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:57.368752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec732c-3162-472f-9576-5f2bc061eacd service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:57.381000 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1175/2311] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:58.497581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8846f-a0d3-430e-a065-c902a8ab9491 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:58.499363 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1ce8846f-a0d3-430e-a065-c902a8ab9491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:58.513914 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8846f-a0d3-430e-a065-c902a8ab9491 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:58.520379 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c815b83-786e-48d7-a152-3eb56f46741b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:58.521895 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c815b83-786e-48d7-a152-3eb56f46741b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:58.522516 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c815b83-786e-48d7-a152-3eb56f46741b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:58.522997 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c815b83-786e-48d7-a152-3eb56f46741b admin admin] PATH_INFO: `/v3/projects/3604434a40c44e4888c3ff8c607b0722` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:58.525093 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c815b83-786e-48d7-a152-3eb56f46741b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3604434a40c44e4888c3ff8c607b0722)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:58.527945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c815b83-786e-48d7-a152-3eb56f46741b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:58.652101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9c815b83-786e-48d7-a152-3eb56f46741b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3604434a40c44e4888c3ff8c607b0722', 'request_id': 'req-9c815b83-786e-48d7-a152-3eb56f46741b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:58.670847 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9c815b83-786e-48d7-a152-3eb56f46741b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3604434a40c44e4888c3ff8c607b0722', 'request_id': 'req-9c815b83-786e-48d7-a152-3eb56f46741b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:58.694015 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9c815b83-786e-48d7-a152-3eb56f46741b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3604434a40c44e4888c3ff8c607b0722', 'request_id': 'req-9c815b83-786e-48d7-a152-3eb56f46741b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:58.727136 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9c815b83-786e-48d7-a152-3eb56f46741b admin admin] The token cache is being invalidate because project 3604434a40c44e4888c3ff8c607b0722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:58.727466 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9c815b83-786e-48d7-a152-3eb56f46741b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:58.728702 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9c815b83-786e-48d7-a152-3eb56f46741b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:58.732251 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1137/2312] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:58 2022] DELETE /identity/v3/projects/3604434a40c44e4888c3ff8c607b0722 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:10:58.745945 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b653d4e-9ba8-4792-950d-5d29d504a24b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:58.746799 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b653d4e-9ba8-4792-950d-5d29d504a24b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:58.746799 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b653d4e-9ba8-4792-950d-5d29d504a24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:58.787494 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5b653d4e-9ba8-4792-950d-5d29d504a24b None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:58.793273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5b653d4e-9ba8-4792-950d-5d29d504a24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:58.840418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:59.081633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4e568-d3a8-4fac-a2c4-094dabbcfbef None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:59.082572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4e568-d3a8-4fac-a2c4-094dabbcfbef None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:59.083472 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4e568-d3a8-4fac-a2c4-094dabbcfbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:59.102038 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1176/2313] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:10:59.170573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-24d4e568-d3a8-4fac-a2c4-094dabbcfbef None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:59.173569 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-24d4e568-d3a8-4fac-a2c4-094dabbcfbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:59.292222 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1138/2314] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:59.303094 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b653d4e-9ba8-4792-950d-5d29d504a24b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:59.361461 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b653d4e-9ba8-4792-950d-5d29d504a24b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:59.401296 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92b85a-bc62-4257-8d68-7aee007e041c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:59.402994 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92b85a-bc62-4257-8d68-7aee007e041c admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:59.403605 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92b85a-bc62-4257-8d68-7aee007e041c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:59.405439 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92b85a-bc62-4257-8d68-7aee007e041c admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:59.407008 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92b85a-bc62-4257-8d68-7aee007e041c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:59.407795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92b85a-bc62-4257-8d68-7aee007e041c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:59.413694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92b85a-bc62-4257-8d68-7aee007e041c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:59.525955 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1177/2315] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:59.527994 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4e568-d3a8-4fac-a2c4-094dabbcfbef None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:59.545161 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:59.589618 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4e568-d3a8-4fac-a2c4-094dabbcfbef None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:59.623510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7217e-d1eb-43b8-b9d1-ff61de4b6128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:59.630058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7217e-d1eb-43b8-b9d1-ff61de4b6128 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:59.631679 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7217e-d1eb-43b8-b9d1-ff61de4b6128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:59.632285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7217e-d1eb-43b8-b9d1-ff61de4b6128 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:59.639074 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7217e-d1eb-43b8-b9d1-ff61de4b6128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:59.648783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7217e-d1eb-43b8-b9d1-ff61de4b6128 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:59.734152 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1139/2316] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:59 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:59.745517 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92b85a-bc62-4257-8d68-7aee007e041c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:59.791762 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92b85a-bc62-4257-8d68-7aee007e041c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:59.970261 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8765de0-1183-4c11-9d62-45a3f2a80e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:59.970882 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8765de0-1183-4c11-9d62-45a3f2a80e01 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:59.971171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8765de0-1183-4c11-9d62-45a3f2a80e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:59.971453 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8765de0-1183-4c11-9d62-45a3f2a80e01 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:59.972202 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8765de0-1183-4c11-9d62-45a3f2a80e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:59.975313 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8765de0-1183-4c11-9d62-45a3f2a80e01 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:00.024403 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1178/2317] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:59 2022] POST /identity/v3/users => generated 293 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:11:00.030492 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7217e-d1eb-43b8-b9d1-ff61de4b6128 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:00.050656 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7217e-d1eb-43b8-b9d1-ff61de4b6128 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:00.063118 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e4d15-4817-44bc-87e2-fc9ea584b604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:00.064618 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e4d15-4817-44bc-87e2-fc9ea584b604 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:00.064941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e4d15-4817-44bc-87e2-fc9ea584b604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:00.065217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e4d15-4817-44bc-87e2-fc9ea584b604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:00.066002 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e4d15-4817-44bc-87e2-fc9ea584b604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:00.067680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e4d15-4817-44bc-87e2-fc9ea584b604 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:00.110204 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1140/2318] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:11:00.116438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8765de0-1183-4c11-9d62-45a3f2a80e01 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:00.135286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8765de0-1183-4c11-9d62-45a3f2a80e01 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:00.145974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68403d9d-3013-4823-852c-471b32ef7e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:00.146722 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68403d9d-3013-4823-852c-471b32ef7e72 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:00.147011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68403d9d-3013-4823-852c-471b32ef7e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:00.147294 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68403d9d-3013-4823-852c-471b32ef7e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:00.148077 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68403d9d-3013-4823-852c-471b32ef7e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:00.149844 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68403d9d-3013-4823-852c-471b32ef7e72 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:00.179277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1179/2319] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:11:00.186934 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e4d15-4817-44bc-87e2-fc9ea584b604 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:00.231941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e4d15-4817-44bc-87e2-fc9ea584b604 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:00.272841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22934ebf-6c34-4cd1-9c83-54d5b00b5235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:00.275543 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22934ebf-6c34-4cd1-9c83-54d5b00b5235 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:00.276218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22934ebf-6c34-4cd1-9c83-54d5b00b5235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:00.276798 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22934ebf-6c34-4cd1-9c83-54d5b00b5235 admin admin] PATH_INFO: `/v3/projects/e2801c79310842da86c328de6ffaf3db/users/245d61f6148c4c96bb30a9f30467c7ad/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:00.345954 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22934ebf-6c34-4cd1-9c83-54d5b00b5235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2801c79310842da86c328de6ffaf3db, user_id=245d61f6148c4c96bb30a9f30467c7ad, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:00.360268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22934ebf-6c34-4cd1-9c83-54d5b00b5235 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:00.416785 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1141/2320] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:11:00 2022] PUT /identity/v3/projects/e2801c79310842da86c328de6ffaf3db/users/245d61f6148c4c96bb30a9f30467c7ad/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:00.428850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa4308-5cfb-4394-bc7c-851bd42643bf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:00.428850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa4308-5cfb-4394-bc7c-851bd42643bf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:00.428850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa4308-5cfb-4394-bc7c-851bd42643bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:00.490788 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-03fa4308-5cfb-4394-bc7c-851bd42643bf None None] MFA Rules not processed for user `245d61f6148c4c96bb30a9f30467c7ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:00.491898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-03fa4308-5cfb-4394-bc7c-851bd42643bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:00.645103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1180/2321] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:11:00.672778 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22934ebf-6c34-4cd1-9c83-54d5b00b5235 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:00.677497 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-22934ebf-6c34-4cd1-9c83-54d5b00b5235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:00.807463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22934ebf-6c34-4cd1-9c83-54d5b00b5235 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:00.813544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f25fb9-b877-4a95-b70a-77a7906707e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:00.814251 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f25fb9-b877-4a95-b70a-77a7906707e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:00.814541 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f25fb9-b877-4a95-b70a-77a7906707e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:00.814814 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f25fb9-b877-4a95-b70a-77a7906707e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:00.838557 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f25fb9-b877-4a95-b70a-77a7906707e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:00.839595 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f25fb9-b877-4a95-b70a-77a7906707e8 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:00.872790 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1142/2322] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:11:10.633511 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:10.850195 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=49,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:13.334369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa4308-5cfb-4394-bc7c-851bd42643bf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:13.337910 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-03fa4308-5cfb-4394-bc7c-851bd42643bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:13.550128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa4308-5cfb-4394-bc7c-851bd42643bf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:13.562422 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d24c6a-48f7-4ec8-a5c5-cc76ef27a0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:13.563401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d24c6a-48f7-4ec8-a5c5-cc76ef27a0e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:13.563742 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d24c6a-48f7-4ec8-a5c5-cc76ef27a0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:13.564026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d24c6a-48f7-4ec8-a5c5-cc76ef27a0e0 admin admin] PATH_INFO: `/v3/users/1a84e0814a324e1eb09baa7a28f7460a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:13.570018 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d24c6a-48f7-4ec8-a5c5-cc76ef27a0e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a84e0814a324e1eb09baa7a28f7460a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:13.573496 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d24c6a-48f7-4ec8-a5c5-cc76ef27a0e0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:13.724524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f8d24c6a-48f7-4ec8-a5c5-cc76ef27a0e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a84e0814a324e1eb09baa7a28f7460a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:13.755880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f8d24c6a-48f7-4ec8-a5c5-cc76ef27a0e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a84e0814a324e1eb09baa7a28f7460a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:13.790203 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f8d24c6a-48f7-4ec8-a5c5-cc76ef27a0e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a84e0814a324e1eb09baa7a28f7460a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:13.791776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f8d24c6a-48f7-4ec8-a5c5-cc76ef27a0e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a84e0814a324e1eb09baa7a28f7460a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:13.793798 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f8d24c6a-48f7-4ec8-a5c5-cc76ef27a0e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a84e0814a324e1eb09baa7a28f7460a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:13.921365 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1181/2323] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:11:13 2022] DELETE /identity/v3/users/1a84e0814a324e1eb09baa7a28f7460a => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:13.927950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843c65a-47fb-491f-bc1d-b611a9d856da None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:13.928972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843c65a-47fb-491f-bc1d-b611a9d856da None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:13.929441 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843c65a-47fb-491f-bc1d-b611a9d856da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:13.989131 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b843c65a-47fb-491f-bc1d-b611a9d856da None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:13.989131 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b843c65a-47fb-491f-bc1d-b611a9d856da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:14.154171 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1143/2324] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:14.191713 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d24c6a-48f7-4ec8-a5c5-cc76ef27a0e0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:14.195820 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f8d24c6a-48f7-4ec8-a5c5-cc76ef27a0e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:14.410116 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d24c6a-48f7-4ec8-a5c5-cc76ef27a0e0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:14.419556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad514ee-99db-4cc2-bc71-e2cead69c4b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:14.420830 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad514ee-99db-4cc2-bc71-e2cead69c4b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:14.421369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad514ee-99db-4cc2-bc71-e2cead69c4b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:14.421904 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad514ee-99db-4cc2-bc71-e2cead69c4b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:14.477783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad514ee-99db-4cc2-bc71-e2cead69c4b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:14.479650 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad514ee-99db-4cc2-bc71-e2cead69c4b1 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:14.493165 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1182/2325] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:11:15.402523 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843c65a-47fb-491f-bc1d-b611a9d856da None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:15.415370 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b843c65a-47fb-491f-bc1d-b611a9d856da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:15.474427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843c65a-47fb-491f-bc1d-b611a9d856da None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:15.481574 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4803e12-9742-4db7-a834-d3269f2b5e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:15.484807 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4803e12-9742-4db7-a834-d3269f2b5e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:15.486263 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4803e12-9742-4db7-a834-d3269f2b5e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:15.486798 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4803e12-9742-4db7-a834-d3269f2b5e79 admin admin] PATH_INFO: `/v3/projects/aa3a334f458b47adb53f709fb78a0c19` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:15.505379 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4803e12-9742-4db7-a834-d3269f2b5e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa3a334f458b47adb53f709fb78a0c19)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:15.511322 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4803e12-9742-4db7-a834-d3269f2b5e79 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:15.684573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d4803e12-9742-4db7-a834-d3269f2b5e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa3a334f458b47adb53f709fb78a0c19', 'request_id': 'req-d4803e12-9742-4db7-a834-d3269f2b5e79'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:15.713738 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d4803e12-9742-4db7-a834-d3269f2b5e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa3a334f458b47adb53f709fb78a0c19', 'request_id': 'req-d4803e12-9742-4db7-a834-d3269f2b5e79'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:15.742412 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d4803e12-9742-4db7-a834-d3269f2b5e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa3a334f458b47adb53f709fb78a0c19', 'request_id': 'req-d4803e12-9742-4db7-a834-d3269f2b5e79'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:15.790949 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d4803e12-9742-4db7-a834-d3269f2b5e79 admin admin] The token cache is being invalidate because project aa3a334f458b47adb53f709fb78a0c19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:11:15.792235 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d4803e12-9742-4db7-a834-d3269f2b5e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:15.794166 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d4803e12-9742-4db7-a834-d3269f2b5e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:15.809197 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52e56b-9068-4d23-8a9e-0816625ff311 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:15.809675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52e56b-9068-4d23-8a9e-0816625ff311 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:15.819208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52e56b-9068-4d23-8a9e-0816625ff311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:15.835302 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1144/2326] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:11:15 2022] DELETE /identity/v3/projects/aa3a334f458b47adb53f709fb78a0c19 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:15.881793 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9b52e56b-9068-4d23-8a9e-0816625ff311 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:15.884458 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9b52e56b-9068-4d23-8a9e-0816625ff311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:15.952838 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:16.102608 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1183/2327] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:16.109657 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7293c1-d935-4500-a438-800250b0ea50 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:16.110272 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7293c1-d935-4500-a438-800250b0ea50 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:16.110661 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7293c1-d935-4500-a438-800250b0ea50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:16.146882 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7e7293c1-d935-4500-a438-800250b0ea50 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:16.148360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7e7293c1-d935-4500-a438-800250b0ea50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:16.174431 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1145/2328] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:16.179444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52e56b-9068-4d23-8a9e-0816625ff311 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:16.194761 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52e56b-9068-4d23-8a9e-0816625ff311 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:16.217578 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54be03-71a3-424e-909c-4d7ab8e6e01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:16.218346 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54be03-71a3-424e-909c-4d7ab8e6e01d admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:16.218702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54be03-71a3-424e-909c-4d7ab8e6e01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:16.219063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54be03-71a3-424e-909c-4d7ab8e6e01d admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:16.219927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54be03-71a3-424e-909c-4d7ab8e6e01d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:11:16.220313 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54be03-71a3-424e-909c-4d7ab8e6e01d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:16.228115 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54be03-71a3-424e-909c-4d7ab8e6e01d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:16.265075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1184/2329] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:11:16.270339 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7293c1-d935-4500-a438-800250b0ea50 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:16.282332 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7293c1-d935-4500-a438-800250b0ea50 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:16.294544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ac481-2330-454a-9dbe-2102a6f26a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:16.296011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ac481-2330-454a-9dbe-2102a6f26a54 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:16.296542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ac481-2330-454a-9dbe-2102a6f26a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:16.297091 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ac481-2330-454a-9dbe-2102a6f26a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:16.298173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ac481-2330-454a-9dbe-2102a6f26a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:16.300559 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ac481-2330-454a-9dbe-2102a6f26a54 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:16.348094 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1146/2330] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:11:16 2022] POST /identity/v3/projects => generated 367 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:11:16.353226 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54be03-71a3-424e-909c-4d7ab8e6e01d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:16.375262 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54be03-71a3-424e-909c-4d7ab8e6e01d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:16.613568 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cce34c-a4db-4fe9-8ba4-ac56d98e9771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:16.615432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cce34c-a4db-4fe9-8ba4-ac56d98e9771 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:16.616633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cce34c-a4db-4fe9-8ba4-ac56d98e9771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:16.617699 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cce34c-a4db-4fe9-8ba4-ac56d98e9771 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:16.623638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cce34c-a4db-4fe9-8ba4-ac56d98e9771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:16.630471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cce34c-a4db-4fe9-8ba4-ac56d98e9771 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:16.697142 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1185/2331] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:11:16 2022] POST /identity/v3/users => generated 284 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:11:16.702879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ac481-2330-454a-9dbe-2102a6f26a54 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:16.746127 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ac481-2330-454a-9dbe-2102a6f26a54 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:16.754759 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ef8de-bf76-4e00-84e2-325514105606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:16.761448 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ef8de-bf76-4e00-84e2-325514105606 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:16.762056 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ef8de-bf76-4e00-84e2-325514105606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:16.762991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ef8de-bf76-4e00-84e2-325514105606 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:16.764342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ef8de-bf76-4e00-84e2-325514105606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:16.767197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ef8de-bf76-4e00-84e2-325514105606 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:16.785752 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1147/2332] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:11:16.790761 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cce34c-a4db-4fe9-8ba4-ac56d98e9771 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:16.805071 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cce34c-a4db-4fe9-8ba4-ac56d98e9771 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:16.821930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b44f3c-8817-477c-ac0c-d63a63a592bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:16.822536 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b44f3c-8817-477c-ac0c-d63a63a592bb admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:16.824312 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b44f3c-8817-477c-ac0c-d63a63a592bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:16.829959 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b44f3c-8817-477c-ac0c-d63a63a592bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:16.831178 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b44f3c-8817-477c-ac0c-d63a63a592bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:16.843037 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b44f3c-8817-477c-ac0c-d63a63a592bb admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:16.880954 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1186/2333] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:11:16.882413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ef8de-bf76-4e00-84e2-325514105606 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:16.904544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ef8de-bf76-4e00-84e2-325514105606 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:16.912705 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7933ce-a1ed-4aed-b146-f1f7f59a6f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:16.914037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7933ce-a1ed-4aed-b146-f1f7f59a6f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:16.914536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7933ce-a1ed-4aed-b146-f1f7f59a6f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:16.915005 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7933ce-a1ed-4aed-b146-f1f7f59a6f3a admin admin] PATH_INFO: `/v3/projects/3b638c2a1b7441eead2b1db106455e4e/users/2f3eaf04063e4785af248a43ab09f1e9/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:16.942466 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7933ce-a1ed-4aed-b146-f1f7f59a6f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b638c2a1b7441eead2b1db106455e4e, user_id=2f3eaf04063e4785af248a43ab09f1e9, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:16.947983 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7933ce-a1ed-4aed-b146-f1f7f59a6f3a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:16.983986 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1148/2334] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:11:16 2022] PUT /identity/v3/projects/3b638c2a1b7441eead2b1db106455e4e/users/2f3eaf04063e4785af248a43ab09f1e9/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:17.008013 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2f515-0f8e-4099-9b25-af67f197c15b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:17.009070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2f515-0f8e-4099-9b25-af67f197c15b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:17.011250 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2f515-0f8e-4099-9b25-af67f197c15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:17.091050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dcd2f515-0f8e-4099-9b25-af67f197c15b None None] MFA Rules not processed for user `2f3eaf04063e4785af248a43ab09f1e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:17.097013 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dcd2f515-0f8e-4099-9b25-af67f197c15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:17.263891 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1187/2335] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:17.276114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7933ce-a1ed-4aed-b146-f1f7f59a6f3a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:17.280375 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-be7933ce-a1ed-4aed-b146-f1f7f59a6f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:17.344743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:17.467895 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7933ce-a1ed-4aed-b146-f1f7f59a6f3a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:17.476107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c28701-4ecf-47b1-851e-d04f9186c870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:17.477427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c28701-4ecf-47b1-851e-d04f9186c870 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:17.479032 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c28701-4ecf-47b1-851e-d04f9186c870 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:17.479606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c28701-4ecf-47b1-851e-d04f9186c870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:17.501765 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c28701-4ecf-47b1-851e-d04f9186c870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:17.504979 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c28701-4ecf-47b1-851e-d04f9186c870 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:17.541667 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1149/2336] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:17 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:11:22.213339 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2f515-0f8e-4099-9b25-af67f197c15b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:22.220204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dcd2f515-0f8e-4099-9b25-af67f197c15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:22.334881 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:22.527909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2f515-0f8e-4099-9b25-af67f197c15b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:22.538923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7df4d4-b0f6-49e8-a50a-69a667c18aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:22.541119 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7df4d4-b0f6-49e8-a50a-69a667c18aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:22.541427 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7df4d4-b0f6-49e8-a50a-69a667c18aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:22.541706 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7df4d4-b0f6-49e8-a50a-69a667c18aec admin admin] PATH_INFO: `/v3/users/245d61f6148c4c96bb30a9f30467c7ad` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:22.545372 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7df4d4-b0f6-49e8-a50a-69a667c18aec admin admin] RBAC: Authorizing `identity:delete_user(user_id=245d61f6148c4c96bb30a9f30467c7ad)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:22.551445 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7df4d4-b0f6-49e8-a50a-69a667c18aec admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:22.746433 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3c7df4d4-b0f6-49e8-a50a-69a667c18aec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '245d61f6148c4c96bb30a9f30467c7ad'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:22.782218 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3c7df4d4-b0f6-49e8-a50a-69a667c18aec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '245d61f6148c4c96bb30a9f30467c7ad'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:22.792864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3c7df4d4-b0f6-49e8-a50a-69a667c18aec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '245d61f6148c4c96bb30a9f30467c7ad'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:22.793952 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3c7df4d4-b0f6-49e8-a50a-69a667c18aec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '245d61f6148c4c96bb30a9f30467c7ad'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:22.801368 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3c7df4d4-b0f6-49e8-a50a-69a667c18aec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '245d61f6148c4c96bb30a9f30467c7ad'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:22.860295 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1188/2337] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:11:22 2022] DELETE /identity/v3/users/245d61f6148c4c96bb30a9f30467c7ad => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:22.868073 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf0032-035a-4ff9-a112-4ff6bdc17900 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:22.868995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf0032-035a-4ff9-a112-4ff6bdc17900 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:22.869370 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf0032-035a-4ff9-a112-4ff6bdc17900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:22.928857 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-20bf0032-035a-4ff9-a112-4ff6bdc17900 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:22.933844 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-20bf0032-035a-4ff9-a112-4ff6bdc17900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:23.053731 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1150/2338] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:23.090808 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7df4d4-b0f6-49e8-a50a-69a667c18aec admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:23.092932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3c7df4d4-b0f6-49e8-a50a-69a667c18aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:23.104444 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf0032-035a-4ff9-a112-4ff6bdc17900 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:23.109034 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-20bf0032-035a-4ff9-a112-4ff6bdc17900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:23.152807 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf0032-035a-4ff9-a112-4ff6bdc17900 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:23.175369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b159c-dcf2-48e2-8362-aec44949f055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:23.183608 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b159c-dcf2-48e2-8362-aec44949f055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:23.184148 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b159c-dcf2-48e2-8362-aec44949f055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:23.184649 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b159c-dcf2-48e2-8362-aec44949f055 admin admin] PATH_INFO: `/v3/users/836ea11bb4c1453c910e3c458d851a5e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:23.192051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b159c-dcf2-48e2-8362-aec44949f055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=836ea11bb4c1453c910e3c458d851a5e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:23.196537 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b159c-dcf2-48e2-8362-aec44949f055 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:23.311493 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7df4d4-b0f6-49e8-a50a-69a667c18aec admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:23.318158 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1246b-9262-489b-bbc4-a3f5afc984b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:23.319318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1246b-9262-489b-bbc4-a3f5afc984b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:23.320052 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1246b-9262-489b-bbc4-a3f5afc984b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:23.320788 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1246b-9262-489b-bbc4-a3f5afc984b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:23.339930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1246b-9262-489b-bbc4-a3f5afc984b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:23.343926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1246b-9262-489b-bbc4-a3f5afc984b0 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:23.349856 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-330b159c-dcf2-48e2-8362-aec44949f055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '836ea11bb4c1453c910e3c458d851a5e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:23.365635 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-330b159c-dcf2-48e2-8362-aec44949f055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '836ea11bb4c1453c910e3c458d851a5e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:23.370317 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1189/2339] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:11:23.391759 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-330b159c-dcf2-48e2-8362-aec44949f055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '836ea11bb4c1453c910e3c458d851a5e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:23.399248 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-330b159c-dcf2-48e2-8362-aec44949f055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '836ea11bb4c1453c910e3c458d851a5e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:23.417066 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-330b159c-dcf2-48e2-8362-aec44949f055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '836ea11bb4c1453c910e3c458d851a5e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:23.440001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1151/2340] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:11:23 2022] DELETE /identity/v3/users/836ea11bb4c1453c910e3c458d851a5e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:11:23.443326 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afdfcb-7a2b-4150-bb11-3ca0d8973fc3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:23.443869 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afdfcb-7a2b-4150-bb11-3ca0d8973fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:23.444357 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afdfcb-7a2b-4150-bb11-3ca0d8973fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:23.479061 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b9afdfcb-7a2b-4150-bb11-3ca0d8973fc3 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:23.480825 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b9afdfcb-7a2b-4150-bb11-3ca0d8973fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:23.613350 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:23.679196 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1190/2341] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:23.701785 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b159c-dcf2-48e2-8362-aec44949f055 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:23.707728 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-330b159c-dcf2-48e2-8362-aec44949f055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:23.841333 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:23.875426 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b159c-dcf2-48e2-8362-aec44949f055 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:23.880749 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f084d-cada-4e22-b023-01a8d362d301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:23.881545 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f084d-cada-4e22-b023-01a8d362d301 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:23.881837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f084d-cada-4e22-b023-01a8d362d301 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:23.882109 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f084d-cada-4e22-b023-01a8d362d301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:23.903589 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f084d-cada-4e22-b023-01a8d362d301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:23.908132 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f084d-cada-4e22-b023-01a8d362d301 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:23.925043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1152/2342] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:11:24.675436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afdfcb-7a2b-4150-bb11-3ca0d8973fc3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:24.677316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b9afdfcb-7a2b-4150-bb11-3ca0d8973fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:24.704697 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afdfcb-7a2b-4150-bb11-3ca0d8973fc3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:24.719208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63e94b-028c-496a-a560-26dbb4831aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:24.721023 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63e94b-028c-496a-a560-26dbb4831aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:24.721688 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63e94b-028c-496a-a560-26dbb4831aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:24.722214 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63e94b-028c-496a-a560-26dbb4831aa6 admin admin] PATH_INFO: `/v3/projects/e2801c79310842da86c328de6ffaf3db` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:24.725586 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63e94b-028c-496a-a560-26dbb4831aa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2801c79310842da86c328de6ffaf3db)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:24.729749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63e94b-028c-496a-a560-26dbb4831aa6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:24.847378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0c63e94b-028c-496a-a560-26dbb4831aa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2801c79310842da86c328de6ffaf3db', 'request_id': 'req-0c63e94b-028c-496a-a560-26dbb4831aa6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:24.865816 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0c63e94b-028c-496a-a560-26dbb4831aa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2801c79310842da86c328de6ffaf3db', 'request_id': 'req-0c63e94b-028c-496a-a560-26dbb4831aa6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:24.890069 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0c63e94b-028c-496a-a560-26dbb4831aa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2801c79310842da86c328de6ffaf3db', 'request_id': 'req-0c63e94b-028c-496a-a560-26dbb4831aa6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:24.921938 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0c63e94b-028c-496a-a560-26dbb4831aa6 admin admin] The token cache is being invalidate because project e2801c79310842da86c328de6ffaf3db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:11:24.922517 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0c63e94b-028c-496a-a560-26dbb4831aa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:24.924972 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0c63e94b-028c-496a-a560-26dbb4831aa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:24.931017 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1191/2343] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:11:24 2022] DELETE /identity/v3/projects/e2801c79310842da86c328de6ffaf3db => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:24.938117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d99e1-65d3-4580-b22f-0240e9e38920 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:24.938694 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d99e1-65d3-4580-b22f-0240e9e38920 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:24.938808 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d99e1-65d3-4580-b22f-0240e9e38920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:24.987572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1b4d99e1-65d3-4580-b22f-0240e9e38920 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:24.990572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1b4d99e1-65d3-4580-b22f-0240e9e38920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:25.117584 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1153/2344] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:11:25.131284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4a350-3362-4506-b097-5129da161297 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:25.132192 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4a350-3362-4506-b097-5129da161297 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:25.132933 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4a350-3362-4506-b097-5129da161297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:25.176464 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-90b4a350-3362-4506-b097-5129da161297 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:25.178766 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-90b4a350-3362-4506-b097-5129da161297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:25.225112 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1192/2345] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:11:25.231447 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d99e1-65d3-4580-b22f-0240e9e38920 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:25.255209 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d99e1-65d3-4580-b22f-0240e9e38920 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:25.260252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915eff8-b5ac-4e97-80fb-d95d2c9a948e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:25.261013 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915eff8-b5ac-4e97-80fb-d95d2c9a948e admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:25.261309 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915eff8-b5ac-4e97-80fb-d95d2c9a948e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:25.261578 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915eff8-b5ac-4e97-80fb-d95d2c9a948e admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:25.262357 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915eff8-b5ac-4e97-80fb-d95d2c9a948e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:11:25.262662 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915eff8-b5ac-4e97-80fb-d95d2c9a948e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:25.264681 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915eff8-b5ac-4e97-80fb-d95d2c9a948e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:25.295831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1154/2346] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:11:25.300614 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4a350-3362-4506-b097-5129da161297 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:25.316423 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4a350-3362-4506-b097-5129da161297 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:25.322007 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c58e5-d868-4664-ba6b-717d4180b014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:25.322914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c58e5-d868-4664-ba6b-717d4180b014 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:25.323274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c58e5-d868-4664-ba6b-717d4180b014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:25.323654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c58e5-d868-4664-ba6b-717d4180b014 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:25.324471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c58e5-d868-4664-ba6b-717d4180b014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:25.327218 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c58e5-d868-4664-ba6b-717d4180b014 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:25.400444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1193/2347] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:11:25 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:11:25.402700 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915eff8-b5ac-4e97-80fb-d95d2c9a948e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:25.434829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915eff8-b5ac-4e97-80fb-d95d2c9a948e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:25.508051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c58e5-d868-4664-ba6b-717d4180b014 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:25.513929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a38c58e5-d868-4664-ba6b-717d4180b014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:25.721854 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c4f45-90d0-419d-8cac-b9fffe3c8872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:25.723450 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c4f45-90d0-419d-8cac-b9fffe3c8872 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:25.724339 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c4f45-90d0-419d-8cac-b9fffe3c8872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:25.725161 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c4f45-90d0-419d-8cac-b9fffe3c8872 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:25.726869 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c4f45-90d0-419d-8cac-b9fffe3c8872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:25.731186 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c4f45-90d0-419d-8cac-b9fffe3c8872 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:25.821129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1155/2348] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:11:25 2022] POST /identity/v3/users => generated 282 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:11:25.824530 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c4f45-90d0-419d-8cac-b9fffe3c8872 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:25.875131 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c4f45-90d0-419d-8cac-b9fffe3c8872 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:25.884447 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c58e5-d868-4664-ba6b-717d4180b014 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:25.912338 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79480b12-d5d1-4680-9271-e17ae58ceb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:25.914350 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79480b12-d5d1-4680-9271-e17ae58ceb2f admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:25.914849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79480b12-d5d1-4680-9271-e17ae58ceb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:25.915270 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79480b12-d5d1-4680-9271-e17ae58ceb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:25.919955 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e2816-f986-4491-8491-558f93c0e062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:25.921525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e2816-f986-4491-8491-558f93c0e062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:25.922484 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e2816-f986-4491-8491-558f93c0e062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:25.922484 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e2816-f986-4491-8491-558f93c0e062 admin admin] PATH_INFO: `/v3/projects/42b3a387f03841ce927a22ce28f1c694` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:25.929582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79480b12-d5d1-4680-9271-e17ae58ceb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:25.933855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e2816-f986-4491-8491-558f93c0e062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42b3a387f03841ce927a22ce28f1c694)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:25.937047 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e2816-f986-4491-8491-558f93c0e062 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:25.944332 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79480b12-d5d1-4680-9271-e17ae58ceb2f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:26.002516 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1156/2349] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:11:26.010439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79480b12-d5d1-4680-9271-e17ae58ceb2f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:26.064041 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79480b12-d5d1-4680-9271-e17ae58ceb2f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:26.079268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607d753-706e-4550-81b5-f2b961cbd65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:26.080551 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607d753-706e-4550-81b5-f2b961cbd65a admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:26.081223 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607d753-706e-4550-81b5-f2b961cbd65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:26.081725 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607d753-706e-4550-81b5-f2b961cbd65a admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:26.083467 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607d753-706e-4550-81b5-f2b961cbd65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:26.086916 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607d753-706e-4550-81b5-f2b961cbd65a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:26.121197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1157/2350] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:11:26.128525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607d753-706e-4550-81b5-f2b961cbd65a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:26.165087 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607d753-706e-4550-81b5-f2b961cbd65a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:26.189569 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:26.236265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-284e2816-f986-4491-8491-558f93c0e062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b3a387f03841ce927a22ce28f1c694', 'request_id': 'req-284e2816-f986-4491-8491-558f93c0e062'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:26.250378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-284e2816-f986-4491-8491-558f93c0e062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b3a387f03841ce927a22ce28f1c694', 'request_id': 'req-284e2816-f986-4491-8491-558f93c0e062'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:26.250806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:26.268837 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-284e2816-f986-4491-8491-558f93c0e062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b3a387f03841ce927a22ce28f1c694', 'request_id': 'req-284e2816-f986-4491-8491-558f93c0e062'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:26.297538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434835ee-659d-44c1-a532-0fd2afab2abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:26.298508 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434835ee-659d-44c1-a532-0fd2afab2abf admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:26.298796 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434835ee-659d-44c1-a532-0fd2afab2abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:26.299183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434835ee-659d-44c1-a532-0fd2afab2abf admin admin] PATH_INFO: `/v3/projects/6926ace0074b4a64915678c9ad43c89e/users/a2ad2cd2633b462d8a85e8687513cfab/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:26.302217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-284e2816-f986-4491-8491-558f93c0e062 admin admin] The token cache is being invalidate because project 42b3a387f03841ce927a22ce28f1c694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:11:26.302561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-284e2816-f986-4491-8491-558f93c0e062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:26.303646 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-284e2816-f986-4491-8491-558f93c0e062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:26.306480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1194/2351] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:11:25 2022] DELETE /identity/v3/projects/42b3a387f03841ce927a22ce28f1c694 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:26.314757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f2c4-c3cb-4457-a532-825926ab9667 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:26.315090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f2c4-c3cb-4457-a532-825926ab9667 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:26.315401 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f2c4-c3cb-4457-a532-825926ab9667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:26.349402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434835ee-659d-44c1-a532-0fd2afab2abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6926ace0074b4a64915678c9ad43c89e, user_id=a2ad2cd2633b462d8a85e8687513cfab, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:26.358126 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434835ee-659d-44c1-a532-0fd2afab2abf admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:26.373850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3407f2c4-c3cb-4457-a532-825926ab9667 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:26.375426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3407f2c4-c3cb-4457-a532-825926ab9667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:26.391320 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1158/2352] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:11:26 2022] PUT /identity/v3/projects/6926ace0074b4a64915678c9ad43c89e/users/a2ad2cd2633b462d8a85e8687513cfab/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:26.408780 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1195/2353] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:11:26.415665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb2f1b-3001-49d1-94bc-fcbe477e1bb9 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:26.416443 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb2f1b-3001-49d1-94bc-fcbe477e1bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:26.417131 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb2f1b-3001-49d1-94bc-fcbe477e1bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:26.420465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a124f-47e4-4775-b3f6-ee972a5abbd4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:26.421602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a124f-47e4-4775-b3f6-ee972a5abbd4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:26.423986 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a124f-47e4-4775-b3f6-ee972a5abbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:26.507631 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d08a124f-47e4-4775-b3f6-ee972a5abbd4 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:26.513741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d08a124f-47e4-4775-b3f6-ee972a5abbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:26.516372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-41cb2f1b-3001-49d1-94bc-fcbe477e1bb9 None None] MFA Rules not processed for user `a2ad2cd2633b462d8a85e8687513cfab`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:26.521950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-41cb2f1b-3001-49d1-94bc-fcbe477e1bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:26.742132 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1159/2354] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:26 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:11:26.774158 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb2f1b-3001-49d1-94bc-fcbe477e1bb9 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:26.782114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-41cb2f1b-3001-49d1-94bc-fcbe477e1bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:26.783434 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1196/2355] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:26.786330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a124f-47e4-4775-b3f6-ee972a5abbd4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:26.834049 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a124f-47e4-4775-b3f6-ee972a5abbd4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:26.853594 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cd4be-c747-4cf6-b3c1-273aad3fb6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:26.855744 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cd4be-c747-4cf6-b3c1-273aad3fb6db admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:26.856674 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cd4be-c747-4cf6-b3c1-273aad3fb6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:26.857382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cd4be-c747-4cf6-b3c1-273aad3fb6db admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:26.859416 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cd4be-c747-4cf6-b3c1-273aad3fb6db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:11:26.860552 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cd4be-c747-4cf6-b3c1-273aad3fb6db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:26.862735 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cd4be-c747-4cf6-b3c1-273aad3fb6db admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:26.893019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1197/2356] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:11:26.896365 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cd4be-c747-4cf6-b3c1-273aad3fb6db admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:26.913091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cd4be-c747-4cf6-b3c1-273aad3fb6db admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:26.921259 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb404376-8f54-4905-ab8c-c4fa83802a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:26.922406 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb404376-8f54-4905-ab8c-c4fa83802a53 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:26.927598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb404376-8f54-4905-ab8c-c4fa83802a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:26.927984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb404376-8f54-4905-ab8c-c4fa83802a53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:26.928783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb404376-8f54-4905-ab8c-c4fa83802a53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:26.930830 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb404376-8f54-4905-ab8c-c4fa83802a53 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:26.940392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb2f1b-3001-49d1-94bc-fcbe477e1bb9 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:26.956494 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad95c7-8176-40ad-8fff-87afa0a1d7ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:26.957408 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad95c7-8176-40ad-8fff-87afa0a1d7ff service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:26.961576 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad95c7-8176-40ad-8fff-87afa0a1d7ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:26.962082 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad95c7-8176-40ad-8fff-87afa0a1d7ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:26.999818 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad95c7-8176-40ad-8fff-87afa0a1d7ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:27.002204 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad95c7-8176-40ad-8fff-87afa0a1d7ff service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:27.037177 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1198/2357] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:11:26 2022] POST /identity/v3/projects => generated 367 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:11:27.037505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1160/2358] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:26 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:11:27.038181 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb404376-8f54-4905-ab8c-c4fa83802a53 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:27.316361 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb404376-8f54-4905-ab8c-c4fa83802a53 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:27.329720 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5db481-9c1d-4113-a5f8-266172d4c94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:27.332081 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5db481-9c1d-4113-a5f8-266172d4c94c admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:27.333488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5db481-9c1d-4113-a5f8-266172d4c94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:27.334857 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5db481-9c1d-4113-a5f8-266172d4c94c admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:27.337363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5db481-9c1d-4113-a5f8-266172d4c94c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:27.346559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5db481-9c1d-4113-a5f8-266172d4c94c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:27.415896 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1199/2359] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:11:27 2022] POST /identity/v3/users => generated 284 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:11:27.421788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad95c7-8176-40ad-8fff-87afa0a1d7ff service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:27.444773 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad95c7-8176-40ad-8fff-87afa0a1d7ff service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:27.460077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b7408-be82-427c-9df8-9181d6f6fe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:27.462733 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b7408-be82-427c-9df8-9181d6f6fe19 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:27.464279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b7408-be82-427c-9df8-9181d6f6fe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:27.465187 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b7408-be82-427c-9df8-9181d6f6fe19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:27.468180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b7408-be82-427c-9df8-9181d6f6fe19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:27.471004 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b7408-be82-427c-9df8-9181d6f6fe19 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:27.512170 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1161/2360] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:11:27.513805 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5db481-9c1d-4113-a5f8-266172d4c94c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:27.552360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5db481-9c1d-4113-a5f8-266172d4c94c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:27.589923 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b7408-be82-427c-9df8-9181d6f6fe19 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:27.593965 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a25b7408-be82-427c-9df8-9181d6f6fe19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:27.616793 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86133526-bfbb-4d0e-a17c-f2267a0b85d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:27.618932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86133526-bfbb-4d0e-a17c-f2267a0b85d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:27.622685 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86133526-bfbb-4d0e-a17c-f2267a0b85d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:27.623903 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86133526-bfbb-4d0e-a17c-f2267a0b85d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:27.626068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86133526-bfbb-4d0e-a17c-f2267a0b85d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:27.626687 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b7408-be82-427c-9df8-9181d6f6fe19 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:27.632219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86133526-bfbb-4d0e-a17c-f2267a0b85d4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:27.643836 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ddee0-ace1-4e89-8d68-6df0149fee90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:27.644797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ddee0-ace1-4e89-8d68-6df0149fee90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:27.646070 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ddee0-ace1-4e89-8d68-6df0149fee90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:27.646070 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ddee0-ace1-4e89-8d68-6df0149fee90 admin admin] PATH_INFO: `/v3/users/73efc34b6a9149b98d8b586b760190a7` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:27.647123 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ddee0-ace1-4e89-8d68-6df0149fee90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73efc34b6a9149b98d8b586b760190a7)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:27.649191 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ddee0-ace1-4e89-8d68-6df0149fee90 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:27.668078 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1200/2361] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:11:27.676656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86133526-bfbb-4d0e-a17c-f2267a0b85d4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:27.693774 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:27.722959 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86133526-bfbb-4d0e-a17c-f2267a0b85d4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:27.738697 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa894f3-fae0-4bf7-81c1-0e7b476d26f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:27.753630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa894f3-fae0-4bf7-81c1-0e7b476d26f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:27.762557 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa894f3-fae0-4bf7-81c1-0e7b476d26f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:27.762857 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa894f3-fae0-4bf7-81c1-0e7b476d26f2 admin admin] PATH_INFO: `/v3/projects/a3b158e367154ff186e6d145f86f2a9d/users/e5fb39852a5e433ba6f51c8147929a48/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:27.781077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:27.832364 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-790ddee0-ace1-4e89-8d68-6df0149fee90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73efc34b6a9149b98d8b586b760190a7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:27.834762 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa894f3-fae0-4bf7-81c1-0e7b476d26f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b158e367154ff186e6d145f86f2a9d, user_id=e5fb39852a5e433ba6f51c8147929a48, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:27.842162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa894f3-fae0-4bf7-81c1-0e7b476d26f2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:27.862065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-790ddee0-ace1-4e89-8d68-6df0149fee90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73efc34b6a9149b98d8b586b760190a7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:27.914088 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-790ddee0-ace1-4e89-8d68-6df0149fee90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73efc34b6a9149b98d8b586b760190a7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:27.920809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-790ddee0-ace1-4e89-8d68-6df0149fee90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73efc34b6a9149b98d8b586b760190a7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:27.955117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-790ddee0-ace1-4e89-8d68-6df0149fee90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73efc34b6a9149b98d8b586b760190a7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:27.959456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1201/2362] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:11:27 2022] PUT /identity/v3/projects/a3b158e367154ff186e6d145f86f2a9d/users/e5fb39852a5e433ba6f51c8147929a48/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:27.982931 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252423be-bd1a-41fc-afd8-00fd6187b3dd None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:27.986844 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252423be-bd1a-41fc-afd8-00fd6187b3dd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:27.987686 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252423be-bd1a-41fc-afd8-00fd6187b3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:28.000261 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1162/2363] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:11:27 2022] DELETE /identity/v3/users/73efc34b6a9149b98d8b586b760190a7 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:11:28.013514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e5e01-3d81-45ab-ae4d-374964840670 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:28.014403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e5e01-3d81-45ab-ae4d-374964840670 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:28.015125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e5e01-3d81-45ab-ae4d-374964840670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:28.081904 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f39e5e01-3d81-45ab-ae4d-374964840670 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:28.084599 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f39e5e01-3d81-45ab-ae4d-374964840670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:28.120930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-252423be-bd1a-41fc-afd8-00fd6187b3dd None None] MFA Rules not processed for user `e5fb39852a5e433ba6f51c8147929a48`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:28.136567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-252423be-bd1a-41fc-afd8-00fd6187b3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:28.251006 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1163/2364] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:28.274166 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1202/2365] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:11:28.280384 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e5e01-3d81-45ab-ae4d-374964840670 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:28.282286 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f39e5e01-3d81-45ab-ae4d-374964840670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:28.303045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252423be-bd1a-41fc-afd8-00fd6187b3dd None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:28.305194 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-252423be-bd1a-41fc-afd8-00fd6187b3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:28.415120 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e5e01-3d81-45ab-ae4d-374964840670 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:28.420560 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa8cd4-40a8-43d4-978f-986f2079cab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:28.421676 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa8cd4-40a8-43d4-978f-986f2079cab3 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:28.431386 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa8cd4-40a8-43d4-978f-986f2079cab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:28.432874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa8cd4-40a8-43d4-978f-986f2079cab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:28.459905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252423be-bd1a-41fc-afd8-00fd6187b3dd None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:28.465541 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa8cd4-40a8-43d4-978f-986f2079cab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:28.466107 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a22103-e76c-4fe8-8031-abf90bf0ec1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:28.467076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a22103-e76c-4fe8-8031-abf90bf0ec1d service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:28.467594 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a22103-e76c-4fe8-8031-abf90bf0ec1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:28.467822 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa8cd4-40a8-43d4-978f-986f2079cab3 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:28.468307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a22103-e76c-4fe8-8031-abf90bf0ec1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:28.484287 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a22103-e76c-4fe8-8031-abf90bf0ec1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:28.485770 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a22103-e76c-4fe8-8031-abf90bf0ec1d service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:28.497940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1164/2366] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:11:28.499638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1203/2367] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:11:29.682942 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa8cd4-40a8-43d4-978f-986f2079cab3 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:29.687852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dafa8cd4-40a8-43d4-978f-986f2079cab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:29.720699 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa8cd4-40a8-43d4-978f-986f2079cab3 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:29.729602 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ebc28-5a7f-4804-9e72-0dc464f9e760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:29.734332 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ebc28-5a7f-4804-9e72-0dc464f9e760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:29.735389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ebc28-5a7f-4804-9e72-0dc464f9e760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:29.736121 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ebc28-5a7f-4804-9e72-0dc464f9e760 admin admin] PATH_INFO: `/v3/projects/0d8b101e89a54bd5b89e8834d8feedff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:29.750964 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ebc28-5a7f-4804-9e72-0dc464f9e760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8b101e89a54bd5b89e8834d8feedff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:29.756943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ebc28-5a7f-4804-9e72-0dc464f9e760 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:29.941508 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:29.949116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e39ebc28-5a7f-4804-9e72-0dc464f9e760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8b101e89a54bd5b89e8834d8feedff', 'request_id': 'req-e39ebc28-5a7f-4804-9e72-0dc464f9e760'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:29.971360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e39ebc28-5a7f-4804-9e72-0dc464f9e760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8b101e89a54bd5b89e8834d8feedff', 'request_id': 'req-e39ebc28-5a7f-4804-9e72-0dc464f9e760'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:29.983340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e39ebc28-5a7f-4804-9e72-0dc464f9e760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8b101e89a54bd5b89e8834d8feedff', 'request_id': 'req-e39ebc28-5a7f-4804-9e72-0dc464f9e760'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:30.029380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e39ebc28-5a7f-4804-9e72-0dc464f9e760 admin admin] The token cache is being invalidate because project 0d8b101e89a54bd5b89e8834d8feedff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:11:30.030539 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e39ebc28-5a7f-4804-9e72-0dc464f9e760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:30.032049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e39ebc28-5a7f-4804-9e72-0dc464f9e760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:30.035783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1165/2368] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:11:29 2022] DELETE /identity/v3/projects/0d8b101e89a54bd5b89e8834d8feedff => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:30.042539 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb748e9-9db2-483f-ab25-bc89ae7c8b7e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:30.043384 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb748e9-9db2-483f-ab25-bc89ae7c8b7e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:30.043584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb748e9-9db2-483f-ab25-bc89ae7c8b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:30.108884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1bb748e9-9db2-483f-ab25-bc89ae7c8b7e None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:30.110517 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1bb748e9-9db2-483f-ab25-bc89ae7c8b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:30.285230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1204/2369] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:30.287631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07997a-26d4-4c66-8ada-3189b19e333c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:30.288123 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07997a-26d4-4c66-8ada-3189b19e333c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:30.288631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07997a-26d4-4c66-8ada-3189b19e333c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:30.347164 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-bf07997a-26d4-4c66-8ada-3189b19e333c None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:30.350583 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bf07997a-26d4-4c66-8ada-3189b19e333c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:30.379712 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1166/2370] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:30.387073 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb748e9-9db2-483f-ab25-bc89ae7c8b7e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:30.408009 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb748e9-9db2-483f-ab25-bc89ae7c8b7e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:30.416378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3249742-765c-4430-a2f4-9c8ed42e55aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:30.417608 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3249742-765c-4430-a2f4-9c8ed42e55aa admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:30.418084 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3249742-765c-4430-a2f4-9c8ed42e55aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:30.418526 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3249742-765c-4430-a2f4-9c8ed42e55aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:30.420206 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3249742-765c-4430-a2f4-9c8ed42e55aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:11:30.420816 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3249742-765c-4430-a2f4-9c8ed42e55aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:30.424735 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3249742-765c-4430-a2f4-9c8ed42e55aa admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:30.450304 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:30.463984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1205/2371] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:11:30.468746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07997a-26d4-4c66-8ada-3189b19e333c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:30.481460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07997a-26d4-4c66-8ada-3189b19e333c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:30.488892 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52366840-e73e-4c02-b5f0-fd51a436eff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:30.490256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52366840-e73e-4c02-b5f0-fd51a436eff4 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:30.490831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52366840-e73e-4c02-b5f0-fd51a436eff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:30.491336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52366840-e73e-4c02-b5f0-fd51a436eff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:30.492401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52366840-e73e-4c02-b5f0-fd51a436eff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:30.494816 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52366840-e73e-4c02-b5f0-fd51a436eff4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:30.539875 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1167/2372] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:11:30 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:11:30.543813 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3249742-765c-4430-a2f4-9c8ed42e55aa admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:30.561047 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3249742-765c-4430-a2f4-9c8ed42e55aa admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:30.690213 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed38dfc-b6be-4d77-abd8-e9bded66bb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:30.691314 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed38dfc-b6be-4d77-abd8-e9bded66bb4e admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:30.691718 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed38dfc-b6be-4d77-abd8-e9bded66bb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:30.692105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed38dfc-b6be-4d77-abd8-e9bded66bb4e admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:30.692995 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed38dfc-b6be-4d77-abd8-e9bded66bb4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:30.695400 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed38dfc-b6be-4d77-abd8-e9bded66bb4e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:30.806735 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1206/2373] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:11:30 2022] POST /identity/v3/users => generated 286 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:11:30.812512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52366840-e73e-4c02-b5f0-fd51a436eff4 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:30.862188 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52366840-e73e-4c02-b5f0-fd51a436eff4 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:30.885059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d06e9-cc14-46c4-8e7a-44045d90f6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:30.886993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d06e9-cc14-46c4-8e7a-44045d90f6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:30.887894 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d06e9-cc14-46c4-8e7a-44045d90f6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:30.899529 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d06e9-cc14-46c4-8e7a-44045d90f6e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:30.901280 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d06e9-cc14-46c4-8e7a-44045d90f6e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:30.907707 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d06e9-cc14-46c4-8e7a-44045d90f6e1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:30.956868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed38dfc-b6be-4d77-abd8-e9bded66bb4e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:30.964229 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1168/2374] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:11:30.968313 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed38dfc-b6be-4d77-abd8-e9bded66bb4e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:30.991427 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd1310-8ab2-4270-ae5c-ab49adbceb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:30.992123 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd1310-8ab2-4270-ae5c-ab49adbceb1e admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:30.992407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd1310-8ab2-4270-ae5c-ab49adbceb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:30.992680 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd1310-8ab2-4270-ae5c-ab49adbceb1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:30.995780 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd1310-8ab2-4270-ae5c-ab49adbceb1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:30.997691 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd1310-8ab2-4270-ae5c-ab49adbceb1e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:31.032761 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1207/2375] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:11:31.038631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d06e9-cc14-46c4-8e7a-44045d90f6e1 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:31.077241 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d06e9-cc14-46c4-8e7a-44045d90f6e1 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:31.101111 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95a565-0d69-4503-9a52-a7ecf8f41057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:31.103902 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95a565-0d69-4503-9a52-a7ecf8f41057 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:31.106775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95a565-0d69-4503-9a52-a7ecf8f41057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:31.107415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95a565-0d69-4503-9a52-a7ecf8f41057 admin admin] PATH_INFO: `/v3/projects/c207c813c8c6453db745024047cb51fc/users/fb812e889e654f9798317d7a223ff30e/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:31.188767 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95a565-0d69-4503-9a52-a7ecf8f41057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c207c813c8c6453db745024047cb51fc, user_id=fb812e889e654f9798317d7a223ff30e, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:31.194895 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95a565-0d69-4503-9a52-a7ecf8f41057 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:31.229760 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1169/2376] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:11:31 2022] PUT /identity/v3/projects/c207c813c8c6453db745024047cb51fc/users/fb812e889e654f9798317d7a223ff30e/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:31.247679 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367885c3-01b2-49ae-ba83-343f28017a8f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:31.248665 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367885c3-01b2-49ae-ba83-343f28017a8f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:31.248665 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367885c3-01b2-49ae-ba83-343f28017a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:31.326926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-367885c3-01b2-49ae-ba83-343f28017a8f None None] MFA Rules not processed for user `fb812e889e654f9798317d7a223ff30e`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:31.328189 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-367885c3-01b2-49ae-ba83-343f28017a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:31.512750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1208/2377] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:31.532494 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95a565-0d69-4503-9a52-a7ecf8f41057 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:31.534499 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3a95a565-0d69-4503-9a52-a7ecf8f41057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:31.657437 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95a565-0d69-4503-9a52-a7ecf8f41057 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:31.662854 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc263c7d-c2ea-442f-aded-c0a274c709a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:31.664198 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc263c7d-c2ea-442f-aded-c0a274c709a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:31.664918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc263c7d-c2ea-442f-aded-c0a274c709a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:31.666882 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc263c7d-c2ea-442f-aded-c0a274c709a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:31.684020 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc263c7d-c2ea-442f-aded-c0a274c709a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:31.686246 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc263c7d-c2ea-442f-aded-c0a274c709a9 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:31.704771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1170/2378] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:11:32.963560 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367885c3-01b2-49ae-ba83-343f28017a8f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:33.151105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367885c3-01b2-49ae-ba83-343f28017a8f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:33.169818 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afb715-29d6-4ae3-9474-f56fc4606582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:33.170879 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afb715-29d6-4ae3-9474-f56fc4606582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:33.171171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afb715-29d6-4ae3-9474-f56fc4606582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:33.171477 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afb715-29d6-4ae3-9474-f56fc4606582 admin admin] PATH_INFO: `/v3/users/fb812e889e654f9798317d7a223ff30e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:33.173702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afb715-29d6-4ae3-9474-f56fc4606582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb812e889e654f9798317d7a223ff30e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:33.175705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afb715-29d6-4ae3-9474-f56fc4606582 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:33.200609 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:33.317979 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-31afb715-29d6-4ae3-9474-f56fc4606582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb812e889e654f9798317d7a223ff30e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:33.351187 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-31afb715-29d6-4ae3-9474-f56fc4606582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb812e889e654f9798317d7a223ff30e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:33.370060 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-31afb715-29d6-4ae3-9474-f56fc4606582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb812e889e654f9798317d7a223ff30e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:33.371911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-31afb715-29d6-4ae3-9474-f56fc4606582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb812e889e654f9798317d7a223ff30e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:33.373514 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-31afb715-29d6-4ae3-9474-f56fc4606582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb812e889e654f9798317d7a223ff30e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:33.467292 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1209/2379] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:11:32 2022] DELETE /identity/v3/users/fb812e889e654f9798317d7a223ff30e => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:33.471100 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bd72e-20c3-4a1c-9064-680cc3bc3075 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:33.472564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bd72e-20c3-4a1c-9064-680cc3bc3075 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:33.473272 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bd72e-20c3-4a1c-9064-680cc3bc3075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:33.509329 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-653bd72e-20c3-4a1c-9064-680cc3bc3075 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:33.512517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-653bd72e-20c3-4a1c-9064-680cc3bc3075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:33.729682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1171/2380] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:33.749442 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afb715-29d6-4ae3-9474-f56fc4606582 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:33.751115 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-31afb715-29d6-4ae3-9474-f56fc4606582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:33.892525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afb715-29d6-4ae3-9474-f56fc4606582 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:33.899692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb11656-adef-4113-a76f-bf5e43d8b28c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:33.900956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb11656-adef-4113-a76f-bf5e43d8b28c service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:33.901346 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb11656-adef-4113-a76f-bf5e43d8b28c service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:33.901569 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb11656-adef-4113-a76f-bf5e43d8b28c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:33.928523 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb11656-adef-4113-a76f-bf5e43d8b28c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:33.932974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb11656-adef-4113-a76f-bf5e43d8b28c service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:33.948036 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1210/2381] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:11:34.484024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bd72e-20c3-4a1c-9064-680cc3bc3075 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:34.487621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-653bd72e-20c3-4a1c-9064-680cc3bc3075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:34.514194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bd72e-20c3-4a1c-9064-680cc3bc3075 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:34.524595 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92068190-e85a-4a50-8758-b59c4a4547a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:34.526396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92068190-e85a-4a50-8758-b59c4a4547a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:34.527043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92068190-e85a-4a50-8758-b59c4a4547a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:34.527596 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92068190-e85a-4a50-8758-b59c4a4547a4 admin admin] PATH_INFO: `/v3/projects/c207c813c8c6453db745024047cb51fc` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:34.530503 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92068190-e85a-4a50-8758-b59c4a4547a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c207c813c8c6453db745024047cb51fc)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:34.534507 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92068190-e85a-4a50-8758-b59c4a4547a4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:34.554069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:34.638139 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-92068190-e85a-4a50-8758-b59c4a4547a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c207c813c8c6453db745024047cb51fc', 'request_id': 'req-92068190-e85a-4a50-8758-b59c4a4547a4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:34.652217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-92068190-e85a-4a50-8758-b59c4a4547a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c207c813c8c6453db745024047cb51fc', 'request_id': 'req-92068190-e85a-4a50-8758-b59c4a4547a4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:34.665147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-92068190-e85a-4a50-8758-b59c4a4547a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c207c813c8c6453db745024047cb51fc', 'request_id': 'req-92068190-e85a-4a50-8758-b59c4a4547a4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:34.680263 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-92068190-e85a-4a50-8758-b59c4a4547a4 admin admin] The token cache is being invalidate because project c207c813c8c6453db745024047cb51fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:11:34.681375 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-92068190-e85a-4a50-8758-b59c4a4547a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:34.681556 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-92068190-e85a-4a50-8758-b59c4a4547a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:34.684218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1172/2382] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:11:34 2022] DELETE /identity/v3/projects/c207c813c8c6453db745024047cb51fc => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:34.690610 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0723e15-b52d-4977-8bd1-95b0ed7114da None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:34.692071 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0723e15-b52d-4977-8bd1-95b0ed7114da None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:34.692071 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0723e15-b52d-4977-8bd1-95b0ed7114da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:34.719106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b0723e15-b52d-4977-8bd1-95b0ed7114da None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:34.720517 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b0723e15-b52d-4977-8bd1-95b0ed7114da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:34.819442 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1211/2383] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:34.830085 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049968b-fa6d-4b13-833c-5120b907873c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:34.833270 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049968b-fa6d-4b13-833c-5120b907873c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:34.833270 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049968b-fa6d-4b13-833c-5120b907873c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:34.869065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b049968b-fa6d-4b13-833c-5120b907873c None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:34.871645 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b049968b-fa6d-4b13-833c-5120b907873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:34.886531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1173/2384] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:34.891868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0723e15-b52d-4977-8bd1-95b0ed7114da None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:34.905389 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0723e15-b52d-4977-8bd1-95b0ed7114da None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:34.913127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b1bd9-510a-4edb-a632-89ddc88c967e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:34.914024 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b1bd9-510a-4edb-a632-89ddc88c967e admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:34.914396 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b1bd9-510a-4edb-a632-89ddc88c967e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:34.914851 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b1bd9-510a-4edb-a632-89ddc88c967e admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:34.915974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b1bd9-510a-4edb-a632-89ddc88c967e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:11:34.916434 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b1bd9-510a-4edb-a632-89ddc88c967e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:34.918905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b1bd9-510a-4edb-a632-89ddc88c967e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:34.946970 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1212/2385] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:11:34.950400 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049968b-fa6d-4b13-833c-5120b907873c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:34.974896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049968b-fa6d-4b13-833c-5120b907873c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:34.984483 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39dbc8f-b916-4707-be81-7fa7a6179668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:34.990778 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dbc8f-b916-4707-be81-7fa7a6179668 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:34.991293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dbc8f-b916-4707-be81-7fa7a6179668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:34.991796 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dbc8f-b916-4707-be81-7fa7a6179668 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:34.994308 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39dbc8f-b916-4707-be81-7fa7a6179668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:34.999273 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39dbc8f-b916-4707-be81-7fa7a6179668 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:35.050612 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1174/2386] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:11:34 2022] POST /identity/v3/projects => generated 353 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:11:35.052527 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b1bd9-510a-4edb-a632-89ddc88c967e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:35.085670 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b1bd9-510a-4edb-a632-89ddc88c967e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:35.146861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:35.237588 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5b2e9-a008-4b64-969d-a43ea4ecbd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:35.239018 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5b2e9-a008-4b64-969d-a43ea4ecbd8d admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:35.239701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5b2e9-a008-4b64-969d-a43ea4ecbd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:35.240247 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5b2e9-a008-4b64-969d-a43ea4ecbd8d admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:35.241505 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5b2e9-a008-4b64-969d-a43ea4ecbd8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:35.246249 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5b2e9-a008-4b64-969d-a43ea4ecbd8d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:35.289849 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1213/2387] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:11:35 2022] POST /identity/v3/users => generated 277 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:11:35.296011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39dbc8f-b916-4707-be81-7fa7a6179668 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:35.309475 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39dbc8f-b916-4707-be81-7fa7a6179668 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:35.318387 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f3dd5-85c6-4eac-85da-7aed7357da80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:35.319257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f3dd5-85c6-4eac-85da-7aed7357da80 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:35.319553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f3dd5-85c6-4eac-85da-7aed7357da80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:35.319947 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f3dd5-85c6-4eac-85da-7aed7357da80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:35.321104 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f3dd5-85c6-4eac-85da-7aed7357da80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:35.324428 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f3dd5-85c6-4eac-85da-7aed7357da80 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:35.340103 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1175/2388] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:11:35.349083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5b2e9-a008-4b64-969d-a43ea4ecbd8d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:35.373077 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5b2e9-a008-4b64-969d-a43ea4ecbd8d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:35.384575 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137dea3a-6e3d-4aab-a3af-96cc19d1ce91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:35.384575 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dea3a-6e3d-4aab-a3af-96cc19d1ce91 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:35.385504 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dea3a-6e3d-4aab-a3af-96cc19d1ce91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:35.386036 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dea3a-6e3d-4aab-a3af-96cc19d1ce91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:35.387489 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137dea3a-6e3d-4aab-a3af-96cc19d1ce91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:35.390281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137dea3a-6e3d-4aab-a3af-96cc19d1ce91 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:35.423834 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1214/2389] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:11:35.431206 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f3dd5-85c6-4eac-85da-7aed7357da80 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:35.453771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f3dd5-85c6-4eac-85da-7aed7357da80 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:35.462542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b14149-56de-4c9b-926f-e200a0db703b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:35.464594 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b14149-56de-4c9b-926f-e200a0db703b admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:35.465258 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b14149-56de-4c9b-926f-e200a0db703b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:35.465857 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b14149-56de-4c9b-926f-e200a0db703b admin admin] PATH_INFO: `/v3/projects/ed160f45b53b41f4a2dc388c5fd4985b/users/4a0c81c344fd40719673ed6fde028135/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:35.501938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b14149-56de-4c9b-926f-e200a0db703b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed160f45b53b41f4a2dc388c5fd4985b, user_id=4a0c81c344fd40719673ed6fde028135, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:35.508747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b14149-56de-4c9b-926f-e200a0db703b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:35.532654 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1176/2390] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:11:35 2022] PUT /identity/v3/projects/ed160f45b53b41f4a2dc388c5fd4985b/users/4a0c81c344fd40719673ed6fde028135/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:35.551619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d1c0a-eb7a-4ff5-9c31-e935e46544e0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:35.552098 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d1c0a-eb7a-4ff5-9c31-e935e46544e0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:35.552576 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d1c0a-eb7a-4ff5-9c31-e935e46544e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:35.609011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1b4d1c0a-eb7a-4ff5-9c31-e935e46544e0 None None] MFA Rules not processed for user `4a0c81c344fd40719673ed6fde028135`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:35.611379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1b4d1c0a-eb7a-4ff5-9c31-e935e46544e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:35.757936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1215/2391] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:35 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:35.783703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b14149-56de-4c9b-926f-e200a0db703b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:35.787723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-71b14149-56de-4c9b-926f-e200a0db703b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:35.885898 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b14149-56de-4c9b-926f-e200a0db703b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:35.890829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc49a1-b29f-417b-a4ba-44da55634d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:35.891526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc49a1-b29f-417b-a4ba-44da55634d20 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:35.892122 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc49a1-b29f-417b-a4ba-44da55634d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:35.892122 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc49a1-b29f-417b-a4ba-44da55634d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:35.907158 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc49a1-b29f-417b-a4ba-44da55634d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:35.909893 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc49a1-b29f-417b-a4ba-44da55634d20 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:35.940622 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1177/2392] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:35 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:11:42.067760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d1c0a-eb7a-4ff5-9c31-e935e46544e0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:42.217659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d1c0a-eb7a-4ff5-9c31-e935e46544e0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:42.226924 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876ad7e-a7e8-4369-9b6a-04cc7a58c0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:42.228614 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876ad7e-a7e8-4369-9b6a-04cc7a58c0db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:42.229249 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876ad7e-a7e8-4369-9b6a-04cc7a58c0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:42.230007 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876ad7e-a7e8-4369-9b6a-04cc7a58c0db admin admin] PATH_INFO: `/v3/users/4a0c81c344fd40719673ed6fde028135` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:42.233520 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876ad7e-a7e8-4369-9b6a-04cc7a58c0db admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a0c81c344fd40719673ed6fde028135)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:42.240228 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876ad7e-a7e8-4369-9b6a-04cc7a58c0db admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:42.290626 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:42.360353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4876ad7e-a7e8-4369-9b6a-04cc7a58c0db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a0c81c344fd40719673ed6fde028135'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:42.378867 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4876ad7e-a7e8-4369-9b6a-04cc7a58c0db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a0c81c344fd40719673ed6fde028135'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:42.402058 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4876ad7e-a7e8-4369-9b6a-04cc7a58c0db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a0c81c344fd40719673ed6fde028135'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:42.403226 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4876ad7e-a7e8-4369-9b6a-04cc7a58c0db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a0c81c344fd40719673ed6fde028135'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:42.405667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4876ad7e-a7e8-4369-9b6a-04cc7a58c0db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a0c81c344fd40719673ed6fde028135'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:42.479849 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1216/2393] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:11:42 2022] DELETE /identity/v3/users/4a0c81c344fd40719673ed6fde028135 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:42.484847 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b675e-57e7-4c90-be12-dc2034176e57 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:42.485496 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b675e-57e7-4c90-be12-dc2034176e57 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:42.485496 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b675e-57e7-4c90-be12-dc2034176e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:42.544975 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a21b675e-57e7-4c90-be12-dc2034176e57 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:42.547023 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a21b675e-57e7-4c90-be12-dc2034176e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:42.678801 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:42.768321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1178/2394] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:42.801852 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876ad7e-a7e8-4369-9b6a-04cc7a58c0db admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:42.803619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4876ad7e-a7e8-4369-9b6a-04cc7a58c0db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:42.965444 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876ad7e-a7e8-4369-9b6a-04cc7a58c0db admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:42.971614 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb7f77-c100-4dcf-ad53-7c6b2c94bf93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:42.973860 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb7f77-c100-4dcf-ad53-7c6b2c94bf93 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:42.974931 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb7f77-c100-4dcf-ad53-7c6b2c94bf93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:42.975499 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb7f77-c100-4dcf-ad53-7c6b2c94bf93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:43.005548 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb7f77-c100-4dcf-ad53-7c6b2c94bf93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:43.022765 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb7f77-c100-4dcf-ad53-7c6b2c94bf93 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:43.040568 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1217/2395] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:11:44.178965 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b675e-57e7-4c90-be12-dc2034176e57 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:44.180556 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a21b675e-57e7-4c90-be12-dc2034176e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:44.203128 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b675e-57e7-4c90-be12-dc2034176e57 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:44.217523 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d27fb-df0a-4af9-ae02-191e626d3622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:44.218517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d27fb-df0a-4af9-ae02-191e626d3622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:44.218985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d27fb-df0a-4af9-ae02-191e626d3622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:44.219473 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d27fb-df0a-4af9-ae02-191e626d3622 admin admin] PATH_INFO: `/v3/projects/ed160f45b53b41f4a2dc388c5fd4985b` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:44.221203 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d27fb-df0a-4af9-ae02-191e626d3622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed160f45b53b41f4a2dc388c5fd4985b)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:44.223681 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d27fb-df0a-4af9-ae02-191e626d3622 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:44.324363 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-923d27fb-df0a-4af9-ae02-191e626d3622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed160f45b53b41f4a2dc388c5fd4985b', 'request_id': 'req-923d27fb-df0a-4af9-ae02-191e626d3622'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:44.349334 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-923d27fb-df0a-4af9-ae02-191e626d3622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed160f45b53b41f4a2dc388c5fd4985b', 'request_id': 'req-923d27fb-df0a-4af9-ae02-191e626d3622'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:44.362330 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-923d27fb-df0a-4af9-ae02-191e626d3622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed160f45b53b41f4a2dc388c5fd4985b', 'request_id': 'req-923d27fb-df0a-4af9-ae02-191e626d3622'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:44.378416 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-923d27fb-df0a-4af9-ae02-191e626d3622 admin admin] The token cache is being invalidate because project ed160f45b53b41f4a2dc388c5fd4985b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:11:44.379045 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-923d27fb-df0a-4af9-ae02-191e626d3622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:44.383241 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-923d27fb-df0a-4af9-ae02-191e626d3622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:44.402724 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1179/2396] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:11:44 2022] DELETE /identity/v3/projects/ed160f45b53b41f4a2dc388c5fd4985b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:52.906045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb7f77-c100-4dcf-ad53-7c6b2c94bf93 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:52.907686 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-19eb7f77-c100-4dcf-ad53-7c6b2c94bf93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:52.939369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb7f77-c100-4dcf-ad53-7c6b2c94bf93 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:53.135345 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed11f94-a1b5-47bc-8224-6e92122ea51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:53.136697 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed11f94-a1b5-47bc-8224-6e92122ea51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:53.136989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed11f94-a1b5-47bc-8224-6e92122ea51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:53.137267 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed11f94-a1b5-47bc-8224-6e92122ea51d admin admin] PATH_INFO: `/v3/users/e5fb39852a5e433ba6f51c8147929a48` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:53.138742 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed11f94-a1b5-47bc-8224-6e92122ea51d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5fb39852a5e433ba6f51c8147929a48)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:53.140882 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed11f94-a1b5-47bc-8224-6e92122ea51d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:53.253324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4ed11f94-a1b5-47bc-8224-6e92122ea51d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5fb39852a5e433ba6f51c8147929a48'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:53.256449 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:53.271065 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4ed11f94-a1b5-47bc-8224-6e92122ea51d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5fb39852a5e433ba6f51c8147929a48'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:53.282945 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4ed11f94-a1b5-47bc-8224-6e92122ea51d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5fb39852a5e433ba6f51c8147929a48'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:53.284461 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4ed11f94-a1b5-47bc-8224-6e92122ea51d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5fb39852a5e433ba6f51c8147929a48'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:53.284663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4ed11f94-a1b5-47bc-8224-6e92122ea51d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5fb39852a5e433ba6f51c8147929a48'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:53.315387 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1218/2397] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:11:52 2022] DELETE /identity/v3/users/e5fb39852a5e433ba6f51c8147929a48 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:11:53.322485 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0ca29-118c-4db4-bdc8-675e816151d0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:53.323067 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0ca29-118c-4db4-bdc8-675e816151d0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:53.323389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0ca29-118c-4db4-bdc8-675e816151d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:53.352274 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-29e0ca29-118c-4db4-bdc8-675e816151d0 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:53.354211 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-29e0ca29-118c-4db4-bdc8-675e816151d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:53.455263 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1180/2398] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:53.468587 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed11f94-a1b5-47bc-8224-6e92122ea51d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:53.471820 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4ed11f94-a1b5-47bc-8224-6e92122ea51d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:53.593455 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed11f94-a1b5-47bc-8224-6e92122ea51d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:53.600143 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45da76-fbea-47ff-9879-87e187ddd2a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:53.602255 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45da76-fbea-47ff-9879-87e187ddd2a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:53.602255 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45da76-fbea-47ff-9879-87e187ddd2a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:53.602644 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45da76-fbea-47ff-9879-87e187ddd2a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:53.622957 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45da76-fbea-47ff-9879-87e187ddd2a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:53.626119 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45da76-fbea-47ff-9879-87e187ddd2a2 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:53.638028 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1219/2399] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:11:54.207530 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0ca29-118c-4db4-bdc8-675e816151d0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:54.223487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-29e0ca29-118c-4db4-bdc8-675e816151d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:54.264011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0ca29-118c-4db4-bdc8-675e816151d0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:54.280494 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5389e-5946-47f1-ad34-02bf07de579c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:54.282115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5389e-5946-47f1-ad34-02bf07de579c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:54.283004 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5389e-5946-47f1-ad34-02bf07de579c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:54.283397 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5389e-5946-47f1-ad34-02bf07de579c admin admin] PATH_INFO: `/v3/projects/a3b158e367154ff186e6d145f86f2a9d` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:54.287857 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5389e-5946-47f1-ad34-02bf07de579c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3b158e367154ff186e6d145f86f2a9d)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:54.289929 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5389e-5946-47f1-ad34-02bf07de579c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:54.391502 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-15c5389e-5946-47f1-ad34-02bf07de579c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b158e367154ff186e6d145f86f2a9d', 'request_id': 'req-15c5389e-5946-47f1-ad34-02bf07de579c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:54.401617 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-15c5389e-5946-47f1-ad34-02bf07de579c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b158e367154ff186e6d145f86f2a9d', 'request_id': 'req-15c5389e-5946-47f1-ad34-02bf07de579c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:54.406516 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:54.421225 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-15c5389e-5946-47f1-ad34-02bf07de579c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b158e367154ff186e6d145f86f2a9d', 'request_id': 'req-15c5389e-5946-47f1-ad34-02bf07de579c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:54.457333 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-15c5389e-5946-47f1-ad34-02bf07de579c admin admin] The token cache is being invalidate because project a3b158e367154ff186e6d145f86f2a9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:11:54.458151 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-15c5389e-5946-47f1-ad34-02bf07de579c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:54.459204 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-15c5389e-5946-47f1-ad34-02bf07de579c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:54.462358 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1181/2400] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:11:54 2022] DELETE /identity/v3/projects/a3b158e367154ff186e6d145f86f2a9d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:54.469511 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc1d4a-c42f-4396-9e9e-a66961aa40a0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:54.470062 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc1d4a-c42f-4396-9e9e-a66961aa40a0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:54.470162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc1d4a-c42f-4396-9e9e-a66961aa40a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:54.508160 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dcdc1d4a-c42f-4396-9e9e-a66961aa40a0 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:54.509952 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dcdc1d4a-c42f-4396-9e9e-a66961aa40a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:54.706577 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1220/2401] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:54.714357 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe221806-c039-4995-a668-1b59f240c24b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:54.714861 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe221806-c039-4995-a668-1b59f240c24b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:54.715236 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe221806-c039-4995-a668-1b59f240c24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:54.741480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fe221806-c039-4995-a668-1b59f240c24b None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:54.743825 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fe221806-c039-4995-a668-1b59f240c24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:54.759976 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1182/2402] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:54.760783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc1d4a-c42f-4396-9e9e-a66961aa40a0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:54.774425 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc1d4a-c42f-4396-9e9e-a66961aa40a0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:54.781460 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b760d39-f27e-406c-8dd4-80649d1e1340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:54.783808 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b760d39-f27e-406c-8dd4-80649d1e1340 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:54.784511 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b760d39-f27e-406c-8dd4-80649d1e1340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:54.791331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b760d39-f27e-406c-8dd4-80649d1e1340 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:54.794760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b760d39-f27e-406c-8dd4-80649d1e1340 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:11:54.795462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b760d39-f27e-406c-8dd4-80649d1e1340 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:54.799776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b760d39-f27e-406c-8dd4-80649d1e1340 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:54.833660 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1221/2403] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:11:54.840263 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe221806-c039-4995-a668-1b59f240c24b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:54.874197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe221806-c039-4995-a668-1b59f240c24b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:54.891728 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7be950-a831-4a96-a7c2-dd6a12145267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:54.892878 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7be950-a831-4a96-a7c2-dd6a12145267 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:54.893271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7be950-a831-4a96-a7c2-dd6a12145267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:54.893645 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7be950-a831-4a96-a7c2-dd6a12145267 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:54.894726 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7be950-a831-4a96-a7c2-dd6a12145267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:54.897074 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7be950-a831-4a96-a7c2-dd6a12145267 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:54.965510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1183/2404] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:11:54 2022] POST /identity/v3/projects => generated 359 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:11:54.970792 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b760d39-f27e-406c-8dd4-80649d1e1340 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:55.016228 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b760d39-f27e-406c-8dd4-80649d1e1340 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:55.166398 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:55.190542 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4d455-139a-4b27-b286-9c37860f5eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:55.191306 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4d455-139a-4b27-b286-9c37860f5eee admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:55.191571 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4d455-139a-4b27-b286-9c37860f5eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:55.193179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4d455-139a-4b27-b286-9c37860f5eee admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:55.193179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4d455-139a-4b27-b286-9c37860f5eee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:55.194597 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4d455-139a-4b27-b286-9c37860f5eee admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:55.236520 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1222/2405] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:11:54 2022] POST /identity/v3/users => generated 280 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:11:55.240996 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7be950-a831-4a96-a7c2-dd6a12145267 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:55.256896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7be950-a831-4a96-a7c2-dd6a12145267 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:55.276463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560908b-45b0-4c3f-9c97-42bee9ff6f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:55.279587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560908b-45b0-4c3f-9c97-42bee9ff6f03 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:55.279939 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560908b-45b0-4c3f-9c97-42bee9ff6f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:55.280455 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560908b-45b0-4c3f-9c97-42bee9ff6f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:55.282326 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560908b-45b0-4c3f-9c97-42bee9ff6f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:55.284705 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560908b-45b0-4c3f-9c97-42bee9ff6f03 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:55.315999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1184/2406] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:11:55.317650 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4d455-139a-4b27-b286-9c37860f5eee admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:55.329191 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4d455-139a-4b27-b286-9c37860f5eee admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:55.353674 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba72431-a7a0-4be7-98c6-9622bcef26df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:55.354882 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba72431-a7a0-4be7-98c6-9622bcef26df admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:55.355369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba72431-a7a0-4be7-98c6-9622bcef26df admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:55.356914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba72431-a7a0-4be7-98c6-9622bcef26df admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:55.357569 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba72431-a7a0-4be7-98c6-9622bcef26df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:55.361741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba72431-a7a0-4be7-98c6-9622bcef26df admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:55.405700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1223/2407] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:11:55.406268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560908b-45b0-4c3f-9c97-42bee9ff6f03 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:55.458481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560908b-45b0-4c3f-9c97-42bee9ff6f03 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:55.479611 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760cc34-65d7-40ab-ac2c-aca604c7dc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:55.481585 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760cc34-65d7-40ab-ac2c-aca604c7dc27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:55.482255 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760cc34-65d7-40ab-ac2c-aca604c7dc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:55.482889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760cc34-65d7-40ab-ac2c-aca604c7dc27 admin admin] PATH_INFO: `/v3/projects/c787bbf273f74c7d97c868372bb856ef/users/c7c8b46838874d5ba74860fa2db55379/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:55.530877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760cc34-65d7-40ab-ac2c-aca604c7dc27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c787bbf273f74c7d97c868372bb856ef, user_id=c7c8b46838874d5ba74860fa2db55379, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:55.535504 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760cc34-65d7-40ab-ac2c-aca604c7dc27 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:55.581183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1185/2408] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:11:55 2022] PUT /identity/v3/projects/c787bbf273f74c7d97c868372bb856ef/users/c7c8b46838874d5ba74860fa2db55379/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:55.592508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6305e-9391-4c9a-8b46-8f3cec31a2e0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:55.593910 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6305e-9391-4c9a-8b46-8f3cec31a2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:55.594481 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6305e-9391-4c9a-8b46-8f3cec31a2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:55.651514 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5fc6305e-9391-4c9a-8b46-8f3cec31a2e0 None None] MFA Rules not processed for user `c7c8b46838874d5ba74860fa2db55379`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:55.654140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5fc6305e-9391-4c9a-8b46-8f3cec31a2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:55.798589 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1224/2409] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:11:55 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:55.822183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760cc34-65d7-40ab-ac2c-aca604c7dc27 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:55.824368 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5760cc34-65d7-40ab-ac2c-aca604c7dc27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:55.951681 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760cc34-65d7-40ab-ac2c-aca604c7dc27 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:55.961708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9dabb-a6bb-4185-bcb7-3617cb98cc2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:55.962418 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9dabb-a6bb-4185-bcb7-3617cb98cc2f service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:55.962706 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9dabb-a6bb-4185-bcb7-3617cb98cc2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:55.963390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9dabb-a6bb-4185-bcb7-3617cb98cc2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:55.989535 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9dabb-a6bb-4185-bcb7-3617cb98cc2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:55.994233 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9dabb-a6bb-4185-bcb7-3617cb98cc2f service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:56.014765 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1186/2410] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:55 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:12:05.787903 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=41,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:06.004132 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:DELETE=2,keystone:SELECT=58,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:06.067452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6305e-9391-4c9a-8b46-8f3cec31a2e0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:06.069474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5fc6305e-9391-4c9a-8b46-8f3cec31a2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:06.202427 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6305e-9391-4c9a-8b46-8f3cec31a2e0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:06.214997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630d2b2-cb87-465f-a0c8-94ac669d0e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:06.216366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630d2b2-cb87-465f-a0c8-94ac669d0e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:06.216366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630d2b2-cb87-465f-a0c8-94ac669d0e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:06.216366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630d2b2-cb87-465f-a0c8-94ac669d0e67 admin admin] PATH_INFO: `/v3/users/f81bc4a07d1b4c988e126dddc764387b` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:06.219143 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630d2b2-cb87-465f-a0c8-94ac669d0e67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f81bc4a07d1b4c988e126dddc764387b)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:06.221720 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630d2b2-cb87-465f-a0c8-94ac669d0e67 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:06.394470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3630d2b2-cb87-465f-a0c8-94ac669d0e67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f81bc4a07d1b4c988e126dddc764387b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:06.407776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3630d2b2-cb87-465f-a0c8-94ac669d0e67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f81bc4a07d1b4c988e126dddc764387b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:06.421293 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3630d2b2-cb87-465f-a0c8-94ac669d0e67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f81bc4a07d1b4c988e126dddc764387b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:06.423151 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3630d2b2-cb87-465f-a0c8-94ac669d0e67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f81bc4a07d1b4c988e126dddc764387b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:06.425921 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3630d2b2-cb87-465f-a0c8-94ac669d0e67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f81bc4a07d1b4c988e126dddc764387b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:06.476132 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1225/2411] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:12:06 2022] DELETE /identity/v3/users/f81bc4a07d1b4c988e126dddc764387b => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:06.478587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe1315-3a9b-4bea-a363-7a687c8967a8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:06.478876 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe1315-3a9b-4bea-a363-7a687c8967a8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:06.479236 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe1315-3a9b-4bea-a363-7a687c8967a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:06.541477 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-eebe1315-3a9b-4bea-a363-7a687c8967a8 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:06.544886 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-eebe1315-3a9b-4bea-a363-7a687c8967a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:06.716588 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1187/2412] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:12:06.734613 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630d2b2-cb87-465f-a0c8-94ac669d0e67 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:06.739473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3630d2b2-cb87-465f-a0c8-94ac669d0e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:06.987145 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630d2b2-cb87-465f-a0c8-94ac669d0e67 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:06.996981 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805fbc8-a9a1-47be-ba3b-70826e5e399d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:06.998564 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805fbc8-a9a1-47be-ba3b-70826e5e399d service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:06.999217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805fbc8-a9a1-47be-ba3b-70826e5e399d service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:06.999907 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805fbc8-a9a1-47be-ba3b-70826e5e399d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:07.023756 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805fbc8-a9a1-47be-ba3b-70826e5e399d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:07.032679 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805fbc8-a9a1-47be-ba3b-70826e5e399d service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:07.074733 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1226/2413] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:12:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:12:07.798858 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe1315-3a9b-4bea-a363-7a687c8967a8 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:07.800698 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-eebe1315-3a9b-4bea-a363-7a687c8967a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:07.826285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe1315-3a9b-4bea-a363-7a687c8967a8 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:07.833562 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad3431-744f-422e-aef0-e0cb8354bbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:07.838346 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad3431-744f-422e-aef0-e0cb8354bbe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:07.839416 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad3431-744f-422e-aef0-e0cb8354bbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:07.840313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad3431-744f-422e-aef0-e0cb8354bbe7 admin admin] PATH_INFO: `/v3/projects/3a75957c9c4646de8b610bb126b8855a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:07.844113 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad3431-744f-422e-aef0-e0cb8354bbe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a75957c9c4646de8b610bb126b8855a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:07.855198 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad3431-744f-422e-aef0-e0cb8354bbe7 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:08.044382 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e8ad3431-744f-422e-aef0-e0cb8354bbe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a75957c9c4646de8b610bb126b8855a', 'request_id': 'req-e8ad3431-744f-422e-aef0-e0cb8354bbe7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:08.068048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e8ad3431-744f-422e-aef0-e0cb8354bbe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a75957c9c4646de8b610bb126b8855a', 'request_id': 'req-e8ad3431-744f-422e-aef0-e0cb8354bbe7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:08.089907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e8ad3431-744f-422e-aef0-e0cb8354bbe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a75957c9c4646de8b610bb126b8855a', 'request_id': 'req-e8ad3431-744f-422e-aef0-e0cb8354bbe7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:08.126680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e8ad3431-744f-422e-aef0-e0cb8354bbe7 admin admin] The token cache is being invalidate because project 3a75957c9c4646de8b610bb126b8855a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:12:08.127755 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e8ad3431-744f-422e-aef0-e0cb8354bbe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:08.134773 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e8ad3431-744f-422e-aef0-e0cb8354bbe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:08.143756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1188/2414] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:12:07 2022] DELETE /identity/v3/projects/3a75957c9c4646de8b610bb126b8855a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:08.151521 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b13a8-56a4-4014-a36b-318c9088635f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:08.152465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b13a8-56a4-4014-a36b-318c9088635f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:08.152931 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b13a8-56a4-4014-a36b-318c9088635f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:08.186884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-009b13a8-56a4-4014-a36b-318c9088635f None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:08.189132 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-009b13a8-56a4-4014-a36b-318c9088635f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:08.258003 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:08.382989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1227/2415] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:08.395668 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c038c-73bc-42d9-beb3-f460bd82004d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:08.396055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c038c-73bc-42d9-beb3-f460bd82004d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:08.396227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c038c-73bc-42d9-beb3-f460bd82004d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:08.444863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4c2c038c-73bc-42d9-beb3-f460bd82004d None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:08.444863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4c2c038c-73bc-42d9-beb3-f460bd82004d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:08.467521 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1189/2416] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:12:08.473264 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b13a8-56a4-4014-a36b-318c9088635f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:08.484487 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b13a8-56a4-4014-a36b-318c9088635f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:08.505415 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb73d6f-1293-408f-a868-618335f1530f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:08.505723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb73d6f-1293-408f-a868-618335f1530f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:08.506113 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb73d6f-1293-408f-a868-618335f1530f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:08.506113 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb73d6f-1293-408f-a868-618335f1530f admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:08.506908 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb73d6f-1293-408f-a868-618335f1530f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:12:08.507214 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb73d6f-1293-408f-a868-618335f1530f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:08.509508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb73d6f-1293-408f-a868-618335f1530f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:08.546577 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1228/2417] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:12:08.549627 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c038c-73bc-42d9-beb3-f460bd82004d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:08.568233 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c038c-73bc-42d9-beb3-f460bd82004d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:08.585665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8532ce-c9ae-4557-837d-e63d10634074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:08.590544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8532ce-c9ae-4557-837d-e63d10634074 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:08.590853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8532ce-c9ae-4557-837d-e63d10634074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:08.591145 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8532ce-c9ae-4557-837d-e63d10634074 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:08.592160 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8532ce-c9ae-4557-837d-e63d10634074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:08.594525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8532ce-c9ae-4557-837d-e63d10634074 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:08.634332 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1190/2418] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:12:08 2022] POST /identity/v3/projects => generated 389 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:12:08.640998 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb73d6f-1293-408f-a868-618335f1530f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:08.672642 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb73d6f-1293-408f-a868-618335f1530f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:08.846125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a756f9c-451c-4675-ae7f-19bad18ed28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:08.847137 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a756f9c-451c-4675-ae7f-19bad18ed28b admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:08.847575 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a756f9c-451c-4675-ae7f-19bad18ed28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:08.848035 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a756f9c-451c-4675-ae7f-19bad18ed28b admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:08.848953 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a756f9c-451c-4675-ae7f-19bad18ed28b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:08.851407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a756f9c-451c-4675-ae7f-19bad18ed28b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:08.914270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1229/2419] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:12:08 2022] POST /identity/v3/users => generated 295 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:12:08.920600 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8532ce-c9ae-4557-837d-e63d10634074 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:08.976376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8532ce-c9ae-4557-837d-e63d10634074 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:08.999695 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88c5ab-6acb-4c5d-ad9e-e2c43c52d624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:09.000860 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88c5ab-6acb-4c5d-ad9e-e2c43c52d624 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:09.001342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88c5ab-6acb-4c5d-ad9e-e2c43c52d624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:09.001824 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88c5ab-6acb-4c5d-ad9e-e2c43c52d624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:09.003210 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88c5ab-6acb-4c5d-ad9e-e2c43c52d624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:09.010702 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88c5ab-6acb-4c5d-ad9e-e2c43c52d624 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:09.063802 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1191/2420] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:12:09.070925 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a756f9c-451c-4675-ae7f-19bad18ed28b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:09.108667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a756f9c-451c-4675-ae7f-19bad18ed28b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:09.133665 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb00f6b-3138-4d4a-aa83-d027cff4461a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:09.142166 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb00f6b-3138-4d4a-aa83-d027cff4461a admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:09.143208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb00f6b-3138-4d4a-aa83-d027cff4461a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:09.143975 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb00f6b-3138-4d4a-aa83-d027cff4461a admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:09.156851 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb00f6b-3138-4d4a-aa83-d027cff4461a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:09.163698 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb00f6b-3138-4d4a-aa83-d027cff4461a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:09.200130 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88c5ab-6acb-4c5d-ad9e-e2c43c52d624 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:09.208100 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1230/2421] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:12:09.218479 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88c5ab-6acb-4c5d-ad9e-e2c43c52d624 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:09.226123 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f76b4-b489-4bbf-a8b1-83d24ebebfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:09.227614 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f76b4-b489-4bbf-a8b1-83d24ebebfda admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:09.228084 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f76b4-b489-4bbf-a8b1-83d24ebebfda admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:09.228859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f76b4-b489-4bbf-a8b1-83d24ebebfda admin admin] PATH_INFO: `/v3/projects/af2b378d6223478b8fbbdb78492345f3/users/380d72712d7944dda14b40bbdeb2723d/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:09.266511 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f76b4-b489-4bbf-a8b1-83d24ebebfda admin admin] RBAC: Authorizing `identity:create_grant(project_id=af2b378d6223478b8fbbdb78492345f3, user_id=380d72712d7944dda14b40bbdeb2723d, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:09.272270 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f76b4-b489-4bbf-a8b1-83d24ebebfda admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:09.325104 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1192/2422] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:12:09 2022] PUT /identity/v3/projects/af2b378d6223478b8fbbdb78492345f3/users/380d72712d7944dda14b40bbdeb2723d/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:09.331667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a4166-415f-4b12-a182-af44d663d65f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:09.334147 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a4166-415f-4b12-a182-af44d663d65f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:09.334880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a4166-415f-4b12-a182-af44d663d65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:09.403840 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-388a4166-415f-4b12-a182-af44d663d65f None None] MFA Rules not processed for user `380d72712d7944dda14b40bbdeb2723d`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:09.406134 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-388a4166-415f-4b12-a182-af44d663d65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:09.581083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1231/2423] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:12:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:09.610462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f76b4-b489-4bbf-a8b1-83d24ebebfda admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:09.611908 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5c4f76b4-b489-4bbf-a8b1-83d24ebebfda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:09.648974 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:09.735115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f76b4-b489-4bbf-a8b1-83d24ebebfda admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:09.742279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfd845-af6f-492d-9f14-f8c1b50bb568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:09.743438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfd845-af6f-492d-9f14-f8c1b50bb568 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:09.743927 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfd845-af6f-492d-9f14-f8c1b50bb568 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:09.744453 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfd845-af6f-492d-9f14-f8c1b50bb568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:09.763350 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfd845-af6f-492d-9f14-f8c1b50bb568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:09.766705 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfd845-af6f-492d-9f14-f8c1b50bb568 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:09.792214 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1193/2424] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:12:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:12:19.505782 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a4166-415f-4b12-a182-af44d663d65f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:19.509249 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-388a4166-415f-4b12-a182-af44d663d65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:19.548388 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:19.677434 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a4166-415f-4b12-a182-af44d663d65f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:19.714112 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e134e-4f27-4487-a27d-7689cd02de47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:19.715638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e134e-4f27-4487-a27d-7689cd02de47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:19.716682 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e134e-4f27-4487-a27d-7689cd02de47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:19.716682 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e134e-4f27-4487-a27d-7689cd02de47 admin admin] PATH_INFO: `/v3/users/c7c8b46838874d5ba74860fa2db55379` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:19.719001 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e134e-4f27-4487-a27d-7689cd02de47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7c8b46838874d5ba74860fa2db55379)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:19.722860 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e134e-4f27-4487-a27d-7689cd02de47 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:19.779674 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=17 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:19.895672 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-436e134e-4f27-4487-a27d-7689cd02de47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7c8b46838874d5ba74860fa2db55379'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:19.921981 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-436e134e-4f27-4487-a27d-7689cd02de47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7c8b46838874d5ba74860fa2db55379'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:19.942882 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-436e134e-4f27-4487-a27d-7689cd02de47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7c8b46838874d5ba74860fa2db55379'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:19.944267 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-436e134e-4f27-4487-a27d-7689cd02de47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7c8b46838874d5ba74860fa2db55379'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:19.945445 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-436e134e-4f27-4487-a27d-7689cd02de47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7c8b46838874d5ba74860fa2db55379'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:19.981881 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1232/2425] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:12:19 2022] DELETE /identity/v3/users/c7c8b46838874d5ba74860fa2db55379 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:12:19.987699 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb73db3-02ce-4d72-a868-4d7bed3602c2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:19.988507 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb73db3-02ce-4d72-a868-4d7bed3602c2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:19.989286 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb73db3-02ce-4d72-a868-4d7bed3602c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:20.041797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4bb73db3-02ce-4d72-a868-4d7bed3602c2 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:20.044946 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4bb73db3-02ce-4d72-a868-4d7bed3602c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:20.200045 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1194/2426] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:12:20.257944 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e134e-4f27-4487-a27d-7689cd02de47 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:20.261061 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-436e134e-4f27-4487-a27d-7689cd02de47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:20.357303 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e134e-4f27-4487-a27d-7689cd02de47 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:20.364095 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c857df6-7b4b-4f0c-9d81-39722ea16b69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:20.364992 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c857df6-7b4b-4f0c-9d81-39722ea16b69 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:20.365374 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c857df6-7b4b-4f0c-9d81-39722ea16b69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:20.365741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c857df6-7b4b-4f0c-9d81-39722ea16b69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:20.381878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c857df6-7b4b-4f0c-9d81-39722ea16b69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:20.384559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c857df6-7b4b-4f0c-9d81-39722ea16b69 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:20.405994 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1233/2427] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:12:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:12:21.231090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb73db3-02ce-4d72-a868-4d7bed3602c2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:21.234407 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4bb73db3-02ce-4d72-a868-4d7bed3602c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:21.271590 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb73db3-02ce-4d72-a868-4d7bed3602c2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:21.284250 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15dbdf5-0772-4fce-9872-5bb9648fd258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:21.286886 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dbdf5-0772-4fce-9872-5bb9648fd258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:21.287415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dbdf5-0772-4fce-9872-5bb9648fd258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:21.288293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dbdf5-0772-4fce-9872-5bb9648fd258 admin admin] PATH_INFO: `/v3/projects/c787bbf273f74c7d97c868372bb856ef` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:21.290827 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15dbdf5-0772-4fce-9872-5bb9648fd258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c787bbf273f74c7d97c868372bb856ef)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:21.297401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15dbdf5-0772-4fce-9872-5bb9648fd258 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:21.485806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b15dbdf5-0772-4fce-9872-5bb9648fd258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c787bbf273f74c7d97c868372bb856ef', 'request_id': 'req-b15dbdf5-0772-4fce-9872-5bb9648fd258'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:21.518215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b15dbdf5-0772-4fce-9872-5bb9648fd258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c787bbf273f74c7d97c868372bb856ef', 'request_id': 'req-b15dbdf5-0772-4fce-9872-5bb9648fd258'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:21.546709 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b15dbdf5-0772-4fce-9872-5bb9648fd258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c787bbf273f74c7d97c868372bb856ef', 'request_id': 'req-b15dbdf5-0772-4fce-9872-5bb9648fd258'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:21.584614 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b15dbdf5-0772-4fce-9872-5bb9648fd258 admin admin] The token cache is being invalidate because project c787bbf273f74c7d97c868372bb856ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:12:21.585256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b15dbdf5-0772-4fce-9872-5bb9648fd258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:21.586509 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b15dbdf5-0772-4fce-9872-5bb9648fd258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:21.596390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1195/2428] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:12:21 2022] DELETE /identity/v3/projects/c787bbf273f74c7d97c868372bb856ef => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:21.606564 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcfe89-ca59-45b0-9ec1-4c10ecc7a869 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:21.607215 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcfe89-ca59-45b0-9ec1-4c10ecc7a869 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:21.607589 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcfe89-ca59-45b0-9ec1-4c10ecc7a869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:21.668090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5adcfe89-ca59-45b0-9ec1-4c10ecc7a869 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:21.670871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5adcfe89-ca59-45b0-9ec1-4c10ecc7a869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:21.759508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:21.817118 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1234/2429] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:21.827865 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071b5e0-12b1-4fc7-a35d-38ddf791c284 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:21.828766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071b5e0-12b1-4fc7-a35d-38ddf791c284 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:21.829347 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071b5e0-12b1-4fc7-a35d-38ddf791c284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:21.895733 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7071b5e0-12b1-4fc7-a35d-38ddf791c284 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:21.901936 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7071b5e0-12b1-4fc7-a35d-38ddf791c284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:21.929550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1196/2430] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:21.935816 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcfe89-ca59-45b0-9ec1-4c10ecc7a869 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:21.954390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcfe89-ca59-45b0-9ec1-4c10ecc7a869 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:21.964031 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54336d-94cf-42fb-954b-750c9287dbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:21.966225 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54336d-94cf-42fb-954b-750c9287dbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:21.967114 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54336d-94cf-42fb-954b-750c9287dbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:21.969835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54336d-94cf-42fb-954b-750c9287dbb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:21.972052 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54336d-94cf-42fb-954b-750c9287dbb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:12:21.973051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54336d-94cf-42fb-954b-750c9287dbb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:21.976945 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54336d-94cf-42fb-954b-750c9287dbb3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:22.014210 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1235/2431] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:12:22.018649 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071b5e0-12b1-4fc7-a35d-38ddf791c284 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:22.038740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071b5e0-12b1-4fc7-a35d-38ddf791c284 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:22.048506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bc518-23bd-4f6c-93fc-265fa414a6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:22.050332 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bc518-23bd-4f6c-93fc-265fa414a6d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:22.051086 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bc518-23bd-4f6c-93fc-265fa414a6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:22.051902 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bc518-23bd-4f6c-93fc-265fa414a6d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:22.054782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bc518-23bd-4f6c-93fc-265fa414a6d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:22.060445 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bc518-23bd-4f6c-93fc-265fa414a6d3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:22.133576 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1197/2432] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:12:22 2022] POST /identity/v3/projects => generated 359 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:12:22.138277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54336d-94cf-42fb-954b-750c9287dbb3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:22.162375 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54336d-94cf-42fb-954b-750c9287dbb3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:22.318646 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4870a5b-87dc-4417-8b5f-797cb5e42963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:22.321050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4870a5b-87dc-4417-8b5f-797cb5e42963 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:22.322032 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4870a5b-87dc-4417-8b5f-797cb5e42963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:22.322796 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4870a5b-87dc-4417-8b5f-797cb5e42963 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:22.331305 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4870a5b-87dc-4417-8b5f-797cb5e42963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:22.341614 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4870a5b-87dc-4417-8b5f-797cb5e42963 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:22.387899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1236/2433] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:12:22 2022] POST /identity/v3/users => generated 280 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:12:22.393861 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bc518-23bd-4f6c-93fc-265fa414a6d3 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:22.408243 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bc518-23bd-4f6c-93fc-265fa414a6d3 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:22.414915 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba0f4b-77c6-46e7-a7c3-469602d3f584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:22.415789 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba0f4b-77c6-46e7-a7c3-469602d3f584 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:22.416164 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba0f4b-77c6-46e7-a7c3-469602d3f584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:22.416521 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba0f4b-77c6-46e7-a7c3-469602d3f584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:22.417417 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba0f4b-77c6-46e7-a7c3-469602d3f584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:22.419475 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba0f4b-77c6-46e7-a7c3-469602d3f584 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:22.433949 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1198/2434] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:12:22.439828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4870a5b-87dc-4417-8b5f-797cb5e42963 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:22.458320 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4870a5b-87dc-4417-8b5f-797cb5e42963 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:22.464832 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899585ff-3c04-4b26-97b6-6149f815be8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:22.465758 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899585ff-3c04-4b26-97b6-6149f815be8f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:22.466050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899585ff-3c04-4b26-97b6-6149f815be8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:22.466363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899585ff-3c04-4b26-97b6-6149f815be8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:22.467200 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899585ff-3c04-4b26-97b6-6149f815be8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:22.469038 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899585ff-3c04-4b26-97b6-6149f815be8f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:22.482741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1237/2435] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:12:22.487864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba0f4b-77c6-46e7-a7c3-469602d3f584 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:22.502524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba0f4b-77c6-46e7-a7c3-469602d3f584 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:22.510364 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a629d-8bfe-4221-b736-f58fd8776bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:22.511705 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a629d-8bfe-4221-b736-f58fd8776bbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:22.512218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a629d-8bfe-4221-b736-f58fd8776bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:22.512670 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a629d-8bfe-4221-b736-f58fd8776bbb admin admin] PATH_INFO: `/v3/projects/e599e0778ff546ea93834c558e803055/users/4ae1e4e79d0340ba966b847ff6d6f333/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:22.545571 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a629d-8bfe-4221-b736-f58fd8776bbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e599e0778ff546ea93834c558e803055, user_id=4ae1e4e79d0340ba966b847ff6d6f333, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:22.549838 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a629d-8bfe-4221-b736-f58fd8776bbb admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:22.581573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1199/2436] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:12:22 2022] PUT /identity/v3/projects/e599e0778ff546ea93834c558e803055/users/4ae1e4e79d0340ba966b847ff6d6f333/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:22.594534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada25ff-4456-41cc-a496-0800e7fd3a68 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:22.594842 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada25ff-4456-41cc-a496-0800e7fd3a68 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:22.595136 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada25ff-4456-41cc-a496-0800e7fd3a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:22.647190 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4ada25ff-4456-41cc-a496-0800e7fd3a68 None None] MFA Rules not processed for user `4ae1e4e79d0340ba966b847ff6d6f333`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:22.651002 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4ada25ff-4456-41cc-a496-0800e7fd3a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:22.840141 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1238/2437] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:12:22 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:22.859104 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a629d-8bfe-4221-b736-f58fd8776bbb admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:22.863085 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-695a629d-8bfe-4221-b736-f58fd8776bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:22.956432 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:23.064077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a629d-8bfe-4221-b736-f58fd8776bbb admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:23.072079 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fdc3f-a067-42fb-87fe-07f0bc1ba43e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:23.073090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fdc3f-a067-42fb-87fe-07f0bc1ba43e service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:23.073562 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fdc3f-a067-42fb-87fe-07f0bc1ba43e service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:23.074170 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fdc3f-a067-42fb-87fe-07f0bc1ba43e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:23.085604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fdc3f-a067-42fb-87fe-07f0bc1ba43e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:23.087264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fdc3f-a067-42fb-87fe-07f0bc1ba43e service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:23.111139 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1200/2438] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:12:22 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:12:32.820851 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:33.099043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=17 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:37.687148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada25ff-4456-41cc-a496-0800e7fd3a68 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:37.689454 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4ada25ff-4456-41cc-a496-0800e7fd3a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:37.795320 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada25ff-4456-41cc-a496-0800e7fd3a68 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:37.808512 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dfdf2-8d35-4237-90dc-6234f6f72acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:37.810205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dfdf2-8d35-4237-90dc-6234f6f72acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:37.810740 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dfdf2-8d35-4237-90dc-6234f6f72acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:37.811283 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dfdf2-8d35-4237-90dc-6234f6f72acf admin admin] PATH_INFO: `/v3/users/380d72712d7944dda14b40bbdeb2723d` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:37.813902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dfdf2-8d35-4237-90dc-6234f6f72acf admin admin] RBAC: Authorizing `identity:delete_user(user_id=380d72712d7944dda14b40bbdeb2723d)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:37.817162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dfdf2-8d35-4237-90dc-6234f6f72acf admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:37.898795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7f6dfdf2-8d35-4237-90dc-6234f6f72acf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '380d72712d7944dda14b40bbdeb2723d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:37.916195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7f6dfdf2-8d35-4237-90dc-6234f6f72acf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '380d72712d7944dda14b40bbdeb2723d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:37.940163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7f6dfdf2-8d35-4237-90dc-6234f6f72acf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '380d72712d7944dda14b40bbdeb2723d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:37.942639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7f6dfdf2-8d35-4237-90dc-6234f6f72acf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '380d72712d7944dda14b40bbdeb2723d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:37.944293 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7f6dfdf2-8d35-4237-90dc-6234f6f72acf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '380d72712d7944dda14b40bbdeb2723d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:37.992427 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1239/2439] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:12:37 2022] DELETE /identity/v3/users/380d72712d7944dda14b40bbdeb2723d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:37.999919 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36958545-98a2-4357-a1f4-aedf29baed65 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:38.000909 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36958545-98a2-4357-a1f4-aedf29baed65 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:38.000909 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36958545-98a2-4357-a1f4-aedf29baed65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:38.027337 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-36958545-98a2-4357-a1f4-aedf29baed65 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:38.029122 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-36958545-98a2-4357-a1f4-aedf29baed65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:38.136798 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1201/2440] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:38.171137 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dfdf2-8d35-4237-90dc-6234f6f72acf admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:38.172786 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7f6dfdf2-8d35-4237-90dc-6234f6f72acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:38.303514 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dfdf2-8d35-4237-90dc-6234f6f72acf admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:38.313312 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b08c06-9377-4fcb-bfe2-8d7427b6c144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:38.314981 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b08c06-9377-4fcb-bfe2-8d7427b6c144 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:38.315819 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b08c06-9377-4fcb-bfe2-8d7427b6c144 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:38.316689 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b08c06-9377-4fcb-bfe2-8d7427b6c144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:38.352014 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b08c06-9377-4fcb-bfe2-8d7427b6c144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:38.357002 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b08c06-9377-4fcb-bfe2-8d7427b6c144 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:38.379919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1240/2441] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:12:39.959524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36958545-98a2-4357-a1f4-aedf29baed65 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:39.961511 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-36958545-98a2-4357-a1f4-aedf29baed65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:39.983695 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36958545-98a2-4357-a1f4-aedf29baed65 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:39.993959 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c34ef-8783-4aa1-9dde-457750fd9162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:39.995262 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c34ef-8783-4aa1-9dde-457750fd9162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:39.995802 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c34ef-8783-4aa1-9dde-457750fd9162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:39.996287 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c34ef-8783-4aa1-9dde-457750fd9162 admin admin] PATH_INFO: `/v3/projects/af2b378d6223478b8fbbdb78492345f3` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:39.998231 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c34ef-8783-4aa1-9dde-457750fd9162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af2b378d6223478b8fbbdb78492345f3)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:40.001662 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c34ef-8783-4aa1-9dde-457750fd9162 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:40.095781 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d85c34ef-8783-4aa1-9dde-457750fd9162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af2b378d6223478b8fbbdb78492345f3', 'request_id': 'req-d85c34ef-8783-4aa1-9dde-457750fd9162'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:40.108395 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d85c34ef-8783-4aa1-9dde-457750fd9162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af2b378d6223478b8fbbdb78492345f3', 'request_id': 'req-d85c34ef-8783-4aa1-9dde-457750fd9162'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:40.118991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d85c34ef-8783-4aa1-9dde-457750fd9162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af2b378d6223478b8fbbdb78492345f3', 'request_id': 'req-d85c34ef-8783-4aa1-9dde-457750fd9162'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:40.136759 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d85c34ef-8783-4aa1-9dde-457750fd9162 admin admin] The token cache is being invalidate because project af2b378d6223478b8fbbdb78492345f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:12:40.137444 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d85c34ef-8783-4aa1-9dde-457750fd9162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:40.138726 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d85c34ef-8783-4aa1-9dde-457750fd9162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:40.141220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1202/2442] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:12:39 2022] DELETE /identity/v3/projects/af2b378d6223478b8fbbdb78492345f3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:40.149259 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf7ba2-ff51-49f1-a96f-a06add0f560d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:40.150489 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf7ba2-ff51-49f1-a96f-a06add0f560d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:40.150980 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf7ba2-ff51-49f1-a96f-a06add0f560d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:40.178191 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7adf7ba2-ff51-49f1-a96f-a06add0f560d None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:40.180270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7adf7ba2-ff51-49f1-a96f-a06add0f560d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:40.225273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:40.303976 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1241/2443] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:12:40.313143 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ccf90-c40a-4087-a85f-66125b875976 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:40.327231 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ccf90-c40a-4087-a85f-66125b875976 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:40.328348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ccf90-c40a-4087-a85f-66125b875976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:40.356178 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f30ccf90-c40a-4087-a85f-66125b875976 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:40.359621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f30ccf90-c40a-4087-a85f-66125b875976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:40.383957 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf7ba2-ff51-49f1-a96f-a06add0f560d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:40.392416 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1203/2444] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:40.397691 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf7ba2-ff51-49f1-a96f-a06add0f560d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:40.409891 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd850e4-258b-4d3c-8d57-b4ca19743e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:40.410736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd850e4-258b-4d3c-8d57-b4ca19743e76 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:40.411022 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd850e4-258b-4d3c-8d57-b4ca19743e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:40.411303 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd850e4-258b-4d3c-8d57-b4ca19743e76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:40.413426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd850e4-258b-4d3c-8d57-b4ca19743e76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:12:40.413741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd850e4-258b-4d3c-8d57-b4ca19743e76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:40.415812 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd850e4-258b-4d3c-8d57-b4ca19743e76 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:40.444315 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ccf90-c40a-4087-a85f-66125b875976 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:40.456874 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1242/2445] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:12:40.467752 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ccf90-c40a-4087-a85f-66125b875976 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:40.482964 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650225d-0554-4120-800f-35347f4087f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:40.488919 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650225d-0554-4120-800f-35347f4087f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:40.489843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650225d-0554-4120-800f-35347f4087f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:40.490296 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650225d-0554-4120-800f-35347f4087f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:40.491327 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650225d-0554-4120-800f-35347f4087f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:40.493960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650225d-0554-4120-800f-35347f4087f6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:40.570508 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1204/2446] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:12:40 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:12:40.572156 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd850e4-258b-4d3c-8d57-b4ca19743e76 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:40.584341 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd850e4-258b-4d3c-8d57-b4ca19743e76 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:40.780438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71c63c-9e8c-46f6-9e3c-73e68f9136b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:40.783395 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71c63c-9e8c-46f6-9e3c-73e68f9136b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:40.783395 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71c63c-9e8c-46f6-9e3c-73e68f9136b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:40.783395 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71c63c-9e8c-46f6-9e3c-73e68f9136b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:40.784078 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71c63c-9e8c-46f6-9e3c-73e68f9136b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:40.803322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71c63c-9e8c-46f6-9e3c-73e68f9136b2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:40.862676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1243/2447] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:12:40 2022] POST /identity/v3/users => generated 290 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:12:40.868919 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650225d-0554-4120-800f-35347f4087f6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:40.905082 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650225d-0554-4120-800f-35347f4087f6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:40.910911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734d323-6ac5-4b2d-bc2b-7d77d9e365c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:40.911629 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734d323-6ac5-4b2d-bc2b-7d77d9e365c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:40.911912 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734d323-6ac5-4b2d-bc2b-7d77d9e365c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:40.912187 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734d323-6ac5-4b2d-bc2b-7d77d9e365c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:40.913078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734d323-6ac5-4b2d-bc2b-7d77d9e365c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:40.915308 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734d323-6ac5-4b2d-bc2b-7d77d9e365c1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:40.986512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1205/2448] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:12:40.990274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71c63c-9e8c-46f6-9e3c-73e68f9136b2 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:41.006244 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71c63c-9e8c-46f6-9e3c-73e68f9136b2 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:41.038576 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469e867-de2c-468e-8a8d-22f3e1d3650f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:41.039875 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469e867-de2c-468e-8a8d-22f3e1d3650f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:41.040429 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469e867-de2c-468e-8a8d-22f3e1d3650f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:41.041128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469e867-de2c-468e-8a8d-22f3e1d3650f admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:41.045112 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469e867-de2c-468e-8a8d-22f3e1d3650f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:41.050121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469e867-de2c-468e-8a8d-22f3e1d3650f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:41.091934 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1244/2449] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:12:41.097317 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734d323-6ac5-4b2d-bc2b-7d77d9e365c1 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:41.126168 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734d323-6ac5-4b2d-bc2b-7d77d9e365c1 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:41.139289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7cd3f8-1199-481f-a85a-dbff0d685650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:41.143625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cd3f8-1199-481f-a85a-dbff0d685650 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:41.145160 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cd3f8-1199-481f-a85a-dbff0d685650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:41.145727 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cd3f8-1199-481f-a85a-dbff0d685650 admin admin] PATH_INFO: `/v3/projects/b50c87c7241442b78a25e6b951e94b6f/users/b9bfeb41f7734f5da3e8a90f3469ce88/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:41.210149 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7cd3f8-1199-481f-a85a-dbff0d685650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b50c87c7241442b78a25e6b951e94b6f, user_id=b9bfeb41f7734f5da3e8a90f3469ce88, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:41.223235 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7cd3f8-1199-481f-a85a-dbff0d685650 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:41.278594 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1206/2450] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:12:41 2022] PUT /identity/v3/projects/b50c87c7241442b78a25e6b951e94b6f/users/b9bfeb41f7734f5da3e8a90f3469ce88/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:41.281524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd3ea5-ea56-4cf6-ba18-9e110683059d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:41.284560 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd3ea5-ea56-4cf6-ba18-9e110683059d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:41.286931 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd3ea5-ea56-4cf6-ba18-9e110683059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:41.469627 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dbcd3ea5-ea56-4cf6-ba18-9e110683059d None None] MFA Rules not processed for user `b9bfeb41f7734f5da3e8a90f3469ce88`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:41.472049 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dbcd3ea5-ea56-4cf6-ba18-9e110683059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:41.811633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1245/2451] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:12:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 532 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:12:41.872849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7cd3f8-1199-481f-a85a-dbff0d685650 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:41.875500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1b7cd3f8-1199-481f-a85a-dbff0d685650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:41.937778 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:42.039817 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7cd3f8-1199-481f-a85a-dbff0d685650 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:42.056881 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435cd06-f568-41a8-b6d1-a9e04059db7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:42.075656 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435cd06-f568-41a8-b6d1-a9e04059db7e service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:42.081254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435cd06-f568-41a8-b6d1-a9e04059db7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:42.082201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435cd06-f568-41a8-b6d1-a9e04059db7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:42.109771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435cd06-f568-41a8-b6d1-a9e04059db7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:42.114946 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435cd06-f568-41a8-b6d1-a9e04059db7e service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:42.139186 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1207/2452] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:12:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:12:42.255043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd3ea5-ea56-4cf6-ba18-9e110683059d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:42.300411 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:42.432899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd3ea5-ea56-4cf6-ba18-9e110683059d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:42.451658 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f06a3-b05c-43fc-a8ed-9999dd3f5e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:42.452626 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f06a3-b05c-43fc-a8ed-9999dd3f5e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:42.453064 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f06a3-b05c-43fc-a8ed-9999dd3f5e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:42.453456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f06a3-b05c-43fc-a8ed-9999dd3f5e5f admin admin] PATH_INFO: `/v3/users/b9bfeb41f7734f5da3e8a90f3469ce88` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:42.458985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f06a3-b05c-43fc-a8ed-9999dd3f5e5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9bfeb41f7734f5da3e8a90f3469ce88)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:42.461712 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f06a3-b05c-43fc-a8ed-9999dd3f5e5f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:42.579667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-076f06a3-b05c-43fc-a8ed-9999dd3f5e5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9bfeb41f7734f5da3e8a90f3469ce88'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:42.604256 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-076f06a3-b05c-43fc-a8ed-9999dd3f5e5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9bfeb41f7734f5da3e8a90f3469ce88'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:42.627353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-076f06a3-b05c-43fc-a8ed-9999dd3f5e5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9bfeb41f7734f5da3e8a90f3469ce88'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:42.628473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-076f06a3-b05c-43fc-a8ed-9999dd3f5e5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9bfeb41f7734f5da3e8a90f3469ce88'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:42.629262 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-076f06a3-b05c-43fc-a8ed-9999dd3f5e5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9bfeb41f7734f5da3e8a90f3469ce88'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:42.670978 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1246/2453] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:12:42 2022] DELETE /identity/v3/users/b9bfeb41f7734f5da3e8a90f3469ce88 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:42.675871 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d22aec-f630-4677-961f-b0f61439d92f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:42.676460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d22aec-f630-4677-961f-b0f61439d92f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:42.676931 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d22aec-f630-4677-961f-b0f61439d92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:42.716377 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e2d22aec-f630-4677-961f-b0f61439d92f None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:42.717749 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e2d22aec-f630-4677-961f-b0f61439d92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:42.865766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1208/2454] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:12:42.892808 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f06a3-b05c-43fc-a8ed-9999dd3f5e5f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:42.896055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-076f06a3-b05c-43fc-a8ed-9999dd3f5e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:43.048649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f06a3-b05c-43fc-a8ed-9999dd3f5e5f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:43.061726 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ab04a-b01e-4b8a-a17f-5611a3a44473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:43.062429 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ab04a-b01e-4b8a-a17f-5611a3a44473 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:43.062713 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ab04a-b01e-4b8a-a17f-5611a3a44473 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:43.062991 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ab04a-b01e-4b8a-a17f-5611a3a44473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:43.098088 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ab04a-b01e-4b8a-a17f-5611a3a44473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:43.102885 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ab04a-b01e-4b8a-a17f-5611a3a44473 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:43.156063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1247/2455] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:12:43.256168 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d22aec-f630-4677-961f-b0f61439d92f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:43.260338 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e2d22aec-f630-4677-961f-b0f61439d92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:43.323370 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d22aec-f630-4677-961f-b0f61439d92f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:43.333436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab4b22-acc1-412a-94fa-1c611ad3e78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:43.335563 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab4b22-acc1-412a-94fa-1c611ad3e78b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:43.336145 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab4b22-acc1-412a-94fa-1c611ad3e78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:43.336685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab4b22-acc1-412a-94fa-1c611ad3e78b admin admin] PATH_INFO: `/v3/users/4ae1e4e79d0340ba966b847ff6d6f333` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:43.340545 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab4b22-acc1-412a-94fa-1c611ad3e78b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ae1e4e79d0340ba966b847ff6d6f333)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:43.343467 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab4b22-acc1-412a-94fa-1c611ad3e78b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:43.429594 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5fab4b22-acc1-412a-94fa-1c611ad3e78b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ae1e4e79d0340ba966b847ff6d6f333'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:43.448453 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5fab4b22-acc1-412a-94fa-1c611ad3e78b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ae1e4e79d0340ba966b847ff6d6f333'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:43.486579 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5fab4b22-acc1-412a-94fa-1c611ad3e78b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ae1e4e79d0340ba966b847ff6d6f333'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:43.488191 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5fab4b22-acc1-412a-94fa-1c611ad3e78b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ae1e4e79d0340ba966b847ff6d6f333'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:43.499714 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5fab4b22-acc1-412a-94fa-1c611ad3e78b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ae1e4e79d0340ba966b847ff6d6f333'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:43.509919 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1209/2456] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:12:43 2022] DELETE /identity/v3/users/4ae1e4e79d0340ba966b847ff6d6f333 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:43.520038 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227af11-1e72-4f20-9a3b-95da902026ac None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:43.520657 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227af11-1e72-4f20-9a3b-95da902026ac None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:43.522041 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227af11-1e72-4f20-9a3b-95da902026ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:43.548918 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d227af11-1e72-4f20-9a3b-95da902026ac None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:43.550965 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d227af11-1e72-4f20-9a3b-95da902026ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:43.613858 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:43.708521 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1248/2457] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:43.719680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab4b22-acc1-412a-94fa-1c611ad3e78b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:43.721988 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5fab4b22-acc1-412a-94fa-1c611ad3e78b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:43.832223 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:43.879893 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab4b22-acc1-412a-94fa-1c611ad3e78b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:43.888971 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db2b6a-05d8-4d6e-8a36-f0cbd000f9b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:43.889531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db2b6a-05d8-4d6e-8a36-f0cbd000f9b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:43.889826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db2b6a-05d8-4d6e-8a36-f0cbd000f9b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:43.892624 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db2b6a-05d8-4d6e-8a36-f0cbd000f9b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:43.906962 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db2b6a-05d8-4d6e-8a36-f0cbd000f9b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:43.908484 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db2b6a-05d8-4d6e-8a36-f0cbd000f9b5 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:43.925762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1210/2458] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:12:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:12:44.241931 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227af11-1e72-4f20-9a3b-95da902026ac None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:44.244820 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d227af11-1e72-4f20-9a3b-95da902026ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:44.268640 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227af11-1e72-4f20-9a3b-95da902026ac None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:44.280094 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7312727-26c5-43fb-b68c-f70aed3bb44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:44.281841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7312727-26c5-43fb-b68c-f70aed3bb44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:44.282342 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7312727-26c5-43fb-b68c-f70aed3bb44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:44.282908 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7312727-26c5-43fb-b68c-f70aed3bb44b admin admin] PATH_INFO: `/v3/projects/e599e0778ff546ea93834c558e803055` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:44.286666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7312727-26c5-43fb-b68c-f70aed3bb44b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e599e0778ff546ea93834c558e803055)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:44.290181 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7312727-26c5-43fb-b68c-f70aed3bb44b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:44.437132 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c7312727-26c5-43fb-b68c-f70aed3bb44b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e599e0778ff546ea93834c558e803055', 'request_id': 'req-c7312727-26c5-43fb-b68c-f70aed3bb44b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:44.476541 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c7312727-26c5-43fb-b68c-f70aed3bb44b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e599e0778ff546ea93834c558e803055', 'request_id': 'req-c7312727-26c5-43fb-b68c-f70aed3bb44b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:44.501021 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c7312727-26c5-43fb-b68c-f70aed3bb44b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e599e0778ff546ea93834c558e803055', 'request_id': 'req-c7312727-26c5-43fb-b68c-f70aed3bb44b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:44.541852 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c7312727-26c5-43fb-b68c-f70aed3bb44b admin admin] The token cache is being invalidate because project e599e0778ff546ea93834c558e803055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:12:44.544277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c7312727-26c5-43fb-b68c-f70aed3bb44b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:44.546608 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c7312727-26c5-43fb-b68c-f70aed3bb44b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:44.558495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1249/2459] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:12:44 2022] DELETE /identity/v3/projects/e599e0778ff546ea93834c558e803055 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:44.975780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db2b6a-05d8-4d6e-8a36-f0cbd000f9b5 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:44.978548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-35db2b6a-05d8-4d6e-8a36-f0cbd000f9b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:45.003717 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db2b6a-05d8-4d6e-8a36-f0cbd000f9b5 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:45.126382 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0431ea2-93c1-4ff9-86b4-b03cc7a99bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:45.127344 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0431ea2-93c1-4ff9-86b4-b03cc7a99bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:45.127631 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0431ea2-93c1-4ff9-86b4-b03cc7a99bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:45.127904 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0431ea2-93c1-4ff9-86b4-b03cc7a99bc5 admin admin] PATH_INFO: `/v3/projects/b50c87c7241442b78a25e6b951e94b6f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:45.129402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0431ea2-93c1-4ff9-86b4-b03cc7a99bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b50c87c7241442b78a25e6b951e94b6f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:45.131420 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0431ea2-93c1-4ff9-86b4-b03cc7a99bc5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:45.218150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f0431ea2-93c1-4ff9-86b4-b03cc7a99bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b50c87c7241442b78a25e6b951e94b6f', 'request_id': 'req-f0431ea2-93c1-4ff9-86b4-b03cc7a99bc5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:45.232229 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f0431ea2-93c1-4ff9-86b4-b03cc7a99bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b50c87c7241442b78a25e6b951e94b6f', 'request_id': 'req-f0431ea2-93c1-4ff9-86b4-b03cc7a99bc5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:45.241510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f0431ea2-93c1-4ff9-86b4-b03cc7a99bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b50c87c7241442b78a25e6b951e94b6f', 'request_id': 'req-f0431ea2-93c1-4ff9-86b4-b03cc7a99bc5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:45.256784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f0431ea2-93c1-4ff9-86b4-b03cc7a99bc5 admin admin] The token cache is being invalidate because project b50c87c7241442b78a25e6b951e94b6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:12:45.256784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f0431ea2-93c1-4ff9-86b4-b03cc7a99bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:45.257696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f0431ea2-93c1-4ff9-86b4-b03cc7a99bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:45.259657 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1211/2460] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:12:44 2022] DELETE /identity/v3/projects/b50c87c7241442b78a25e6b951e94b6f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:54.528483 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:55.253135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=61,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:58.816306 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b16cf0-a951-41c5-b478-efe8bcf93040 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:58.820561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b16cf0-a951-41c5-b478-efe8bcf93040 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:58.828403 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b16cf0-a951-41c5-b478-efe8bcf93040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:58.904179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-73b16cf0-a951-41c5-b478-efe8bcf93040 None None] MFA Rules not processed for user `c83195bd720846fc8ed75aedd152a505`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:58.907367 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-73b16cf0-a951-41c5-b478-efe8bcf93040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:59.168543 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1250/2461] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:12:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:01.056343 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0431ea2-93c1-4ff9-86b4-b03cc7a99bc5 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:01.057970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f0431ea2-93c1-4ff9-86b4-b03cc7a99bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:01.377964 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0431ea2-93c1-4ff9-86b4-b03cc7a99bc5 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:01.402176 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfda2d0-5172-4b5f-a5dd-c9aaaf639c24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:01.414177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfda2d0-5172-4b5f-a5dd-c9aaaf639c24 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:01.415088 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfda2d0-5172-4b5f-a5dd-c9aaaf639c24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:01.415796 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfda2d0-5172-4b5f-a5dd-c9aaaf639c24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:01.420278 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9cfda2d0-5172-4b5f-a5dd-c9aaaf639c24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:01.454322 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfda2d0-5172-4b5f-a5dd-c9aaaf639c24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:01.460805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfda2d0-5172-4b5f-a5dd-c9aaaf639c24 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:01.495649 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1212/2462] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:13:02.438864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b16cf0-a951-41c5-b478-efe8bcf93040 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:02.442730 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-73b16cf0-a951-41c5-b478-efe8bcf93040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:02.693005 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b16cf0-a951-41c5-b478-efe8bcf93040 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:02.706332 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafd158-39cc-4a1e-96f0-93cbf3ff0b7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:02.707083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafd158-39cc-4a1e-96f0-93cbf3ff0b7c service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:02.707474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafd158-39cc-4a1e-96f0-93cbf3ff0b7c service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:02.707833 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafd158-39cc-4a1e-96f0-93cbf3ff0b7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:02.710416 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-daafd158-39cc-4a1e-96f0-93cbf3ff0b7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:02.737153 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafd158-39cc-4a1e-96f0-93cbf3ff0b7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:02.740276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafd158-39cc-4a1e-96f0-93cbf3ff0b7c service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:02.776887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1251/2463] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:11.480681 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=39 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:12.753697 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=72 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:23.227200 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfda2d0-5172-4b5f-a5dd-c9aaaf639c24 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:23.228829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9cfda2d0-5172-4b5f-a5dd-c9aaaf639c24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:23.355327 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfda2d0-5172-4b5f-a5dd-c9aaaf639c24 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:23.363881 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fc0b5-6709-4aca-aae9-485143f9b81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:23.365080 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fc0b5-6709-4aca-aae9-485143f9b81a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:23.365364 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fc0b5-6709-4aca-aae9-485143f9b81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:23.365641 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fc0b5-6709-4aca-aae9-485143f9b81a admin admin] PATH_INFO: `/v3/users/a2ad2cd2633b462d8a85e8687513cfab` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:23.367114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fc0b5-6709-4aca-aae9-485143f9b81a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2ad2cd2633b462d8a85e8687513cfab)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:23.369257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fc0b5-6709-4aca-aae9-485143f9b81a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:23.436558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-849fc0b5-6709-4aca-aae9-485143f9b81a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2ad2cd2633b462d8a85e8687513cfab'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:23.453943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-849fc0b5-6709-4aca-aae9-485143f9b81a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2ad2cd2633b462d8a85e8687513cfab'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:23.477668 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-849fc0b5-6709-4aca-aae9-485143f9b81a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2ad2cd2633b462d8a85e8687513cfab'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:23.479091 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-849fc0b5-6709-4aca-aae9-485143f9b81a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2ad2cd2633b462d8a85e8687513cfab'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:23.494746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-849fc0b5-6709-4aca-aae9-485143f9b81a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2ad2cd2633b462d8a85e8687513cfab'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:23.505311 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1213/2464] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:13:23 2022] DELETE /identity/v3/users/a2ad2cd2633b462d8a85e8687513cfab => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:13:23.511190 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdd653-a546-4d41-b295-b82fe4cf5537 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:23.512091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdd653-a546-4d41-b295-b82fe4cf5537 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:23.512091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdd653-a546-4d41-b295-b82fe4cf5537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:23.546694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4acdd653-a546-4d41-b295-b82fe4cf5537 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:23.548248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4acdd653-a546-4d41-b295-b82fe4cf5537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:23.641895 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1252/2465] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:23.655053 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fc0b5-6709-4aca-aae9-485143f9b81a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:23.657643 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-849fc0b5-6709-4aca-aae9-485143f9b81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:23.747614 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:23.780994 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fc0b5-6709-4aca-aae9-485143f9b81a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:23.785406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b58883-ffa5-45bd-ae51-36fa0b3aeb5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:23.786240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b58883-ffa5-45bd-ae51-36fa0b3aeb5b service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:23.786592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b58883-ffa5-45bd-ae51-36fa0b3aeb5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:23.787476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b58883-ffa5-45bd-ae51-36fa0b3aeb5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:23.799939 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b58883-ffa5-45bd-ae51-36fa0b3aeb5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:23.801892 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b58883-ffa5-45bd-ae51-36fa0b3aeb5b service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:23.815566 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1214/2466] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:24.139024 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdd653-a546-4d41-b295-b82fe4cf5537 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:24.141324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4acdd653-a546-4d41-b295-b82fe4cf5537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:24.157988 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdd653-a546-4d41-b295-b82fe4cf5537 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:24.163891 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a9b8d-8f7b-45d8-9d80-e0b0b7899079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:24.165609 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a9b8d-8f7b-45d8-9d80-e0b0b7899079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:24.165609 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a9b8d-8f7b-45d8-9d80-e0b0b7899079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:24.165609 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a9b8d-8f7b-45d8-9d80-e0b0b7899079 admin admin] PATH_INFO: `/v3/projects/6926ace0074b4a64915678c9ad43c89e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:24.167667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a9b8d-8f7b-45d8-9d80-e0b0b7899079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6926ace0074b4a64915678c9ad43c89e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:24.170037 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a9b8d-8f7b-45d8-9d80-e0b0b7899079 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:24.288872 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-788a9b8d-8f7b-45d8-9d80-e0b0b7899079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6926ace0074b4a64915678c9ad43c89e', 'request_id': 'req-788a9b8d-8f7b-45d8-9d80-e0b0b7899079'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:24.304755 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-788a9b8d-8f7b-45d8-9d80-e0b0b7899079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6926ace0074b4a64915678c9ad43c89e', 'request_id': 'req-788a9b8d-8f7b-45d8-9d80-e0b0b7899079'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:24.315649 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-788a9b8d-8f7b-45d8-9d80-e0b0b7899079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6926ace0074b4a64915678c9ad43c89e', 'request_id': 'req-788a9b8d-8f7b-45d8-9d80-e0b0b7899079'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:24.343806 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-788a9b8d-8f7b-45d8-9d80-e0b0b7899079 admin admin] The token cache is being invalidate because project 6926ace0074b4a64915678c9ad43c89e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:13:24.344619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-788a9b8d-8f7b-45d8-9d80-e0b0b7899079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:24.345769 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-788a9b8d-8f7b-45d8-9d80-e0b0b7899079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:24.348135 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1253/2467] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:13:24 2022] DELETE /identity/v3/projects/6926ace0074b4a64915678c9ad43c89e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:13:24.355577 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c6dcd-698c-4da3-bdfe-64bc99be24b6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:24.356766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c6dcd-698c-4da3-bdfe-64bc99be24b6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:24.357385 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c6dcd-698c-4da3-bdfe-64bc99be24b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:24.454111 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-618c6dcd-698c-4da3-bdfe-64bc99be24b6 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:24.455379 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-618c6dcd-698c-4da3-bdfe-64bc99be24b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:24.548989 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1215/2468] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:24.557588 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9603ad1-70b7-48d3-86ae-266edac61c73 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:24.558469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9603ad1-70b7-48d3-86ae-266edac61c73 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:24.558469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9603ad1-70b7-48d3-86ae-266edac61c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:24.579182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e9603ad1-70b7-48d3-86ae-266edac61c73 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:24.581091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e9603ad1-70b7-48d3-86ae-266edac61c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:24.592151 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1254/2469] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:24.598213 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c6dcd-698c-4da3-bdfe-64bc99be24b6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:24.614519 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c6dcd-698c-4da3-bdfe-64bc99be24b6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:24.622363 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf007446-c03e-448f-8eed-f151ff07803b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:24.623470 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf007446-c03e-448f-8eed-f151ff07803b admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:24.623968 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf007446-c03e-448f-8eed-f151ff07803b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:24.624429 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf007446-c03e-448f-8eed-f151ff07803b admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:24.625468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf007446-c03e-448f-8eed-f151ff07803b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:13:24.626017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf007446-c03e-448f-8eed-f151ff07803b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:24.629177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf007446-c03e-448f-8eed-f151ff07803b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:24.654937 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1216/2470] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:13:24.659520 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9603ad1-70b7-48d3-86ae-266edac61c73 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:24.670605 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9603ad1-70b7-48d3-86ae-266edac61c73 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:24.677029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766a35e-0970-4053-9fbd-66bc0edab898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:24.678202 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766a35e-0970-4053-9fbd-66bc0edab898 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:24.678489 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766a35e-0970-4053-9fbd-66bc0edab898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:24.679881 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766a35e-0970-4053-9fbd-66bc0edab898 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:24.679881 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766a35e-0970-4053-9fbd-66bc0edab898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:24.682574 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766a35e-0970-4053-9fbd-66bc0edab898 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:24.734379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1255/2471] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:13:24 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:13:24.740982 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf007446-c03e-448f-8eed-f151ff07803b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:24.786931 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf007446-c03e-448f-8eed-f151ff07803b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:24.922208 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb412c-ed41-4be9-b3c9-32a997da8750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:24.923641 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb412c-ed41-4be9-b3c9-32a997da8750 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:24.924243 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb412c-ed41-4be9-b3c9-32a997da8750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:24.924845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb412c-ed41-4be9-b3c9-32a997da8750 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:24.925995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb412c-ed41-4be9-b3c9-32a997da8750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:24.929910 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb412c-ed41-4be9-b3c9-32a997da8750 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:24.966335 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1217/2472] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:13:24 2022] POST /identity/v3/users => generated 292 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:13:24.971219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766a35e-0970-4053-9fbd-66bc0edab898 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:24.989281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766a35e-0970-4053-9fbd-66bc0edab898 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:24.996168 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286e980-2870-4366-88ed-9723da3266ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:24.997440 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286e980-2870-4366-88ed-9723da3266ea admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:24.997730 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286e980-2870-4366-88ed-9723da3266ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:24.998006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286e980-2870-4366-88ed-9723da3266ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:24.998907 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286e980-2870-4366-88ed-9723da3266ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:25.001126 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286e980-2870-4366-88ed-9723da3266ea admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:25.019576 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1256/2473] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:13:25.020984 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb412c-ed41-4be9-b3c9-32a997da8750 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:25.033906 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb412c-ed41-4be9-b3c9-32a997da8750 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:25.041032 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dea488-2165-4f27-a47c-84a54b328fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:25.042423 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dea488-2165-4f27-a47c-84a54b328fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:25.042423 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dea488-2165-4f27-a47c-84a54b328fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:25.042423 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dea488-2165-4f27-a47c-84a54b328fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:25.044565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dea488-2165-4f27-a47c-84a54b328fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:25.046122 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dea488-2165-4f27-a47c-84a54b328fd0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:25.072782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1218/2474] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:13:25.076210 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286e980-2870-4366-88ed-9723da3266ea admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:25.095847 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286e980-2870-4366-88ed-9723da3266ea admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:25.104777 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586c7ed-2fab-4695-80e7-a4c09dcb816f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:25.107881 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586c7ed-2fab-4695-80e7-a4c09dcb816f admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:25.110181 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586c7ed-2fab-4695-80e7-a4c09dcb816f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:25.111028 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586c7ed-2fab-4695-80e7-a4c09dcb816f admin admin] PATH_INFO: `/v3/projects/ceca4b8f75974b8fb4b7c713cc3007fb/users/6ca195ef98cd49c68c14e1b9b8e8432c/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:25.159573 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586c7ed-2fab-4695-80e7-a4c09dcb816f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceca4b8f75974b8fb4b7c713cc3007fb, user_id=6ca195ef98cd49c68c14e1b9b8e8432c, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:25.162947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586c7ed-2fab-4695-80e7-a4c09dcb816f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:25.206379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1257/2475] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:13:25 2022] PUT /identity/v3/projects/ceca4b8f75974b8fb4b7c713cc3007fb/users/6ca195ef98cd49c68c14e1b9b8e8432c/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:13:25.208375 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dd8a4-facb-4ffe-a8c1-ed08454b7bb9 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:25.208860 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dd8a4-facb-4ffe-a8c1-ed08454b7bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:25.209227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dd8a4-facb-4ffe-a8c1-ed08454b7bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:25.317342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-181dd8a4-facb-4ffe-a8c1-ed08454b7bb9 None None] MFA Rules not processed for user `6ca195ef98cd49c68c14e1b9b8e8432c`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:25.319574 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-181dd8a4-facb-4ffe-a8c1-ed08454b7bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:25.328154 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:25.483258 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1219/2476] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:13:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:13:25.501258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586c7ed-2fab-4695-80e7-a4c09dcb816f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:25.504458 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0586c7ed-2fab-4695-80e7-a4c09dcb816f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:25.534171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:25.635449 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586c7ed-2fab-4695-80e7-a4c09dcb816f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:25.644792 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60723f36-f872-46e9-a2b4-e600cf3d4aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:25.646162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60723f36-f872-46e9-a2b4-e600cf3d4aad service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:25.646449 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60723f36-f872-46e9-a2b4-e600cf3d4aad service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:25.646725 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60723f36-f872-46e9-a2b4-e600cf3d4aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:25.660785 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60723f36-f872-46e9-a2b4-e600cf3d4aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:25.662726 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60723f36-f872-46e9-a2b4-e600cf3d4aad service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:25.686495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1258/2477] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:27.034088 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dd8a4-facb-4ffe-a8c1-ed08454b7bb9 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:27.037911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-181dd8a4-facb-4ffe-a8c1-ed08454b7bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:27.470845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dd8a4-facb-4ffe-a8c1-ed08454b7bb9 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:27.497762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a6504-219b-4af3-8bd3-718715008f87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:27.498948 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a6504-219b-4af3-8bd3-718715008f87 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:27.499457 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a6504-219b-4af3-8bd3-718715008f87 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:27.500172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a6504-219b-4af3-8bd3-718715008f87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:27.504641 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1c1a6504-219b-4af3-8bd3-718715008f87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:27.533467 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a6504-219b-4af3-8bd3-718715008f87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:27.537916 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a6504-219b-4af3-8bd3-718715008f87 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:27.566451 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1220/2478] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:35.323073 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60723f36-f872-46e9-a2b4-e600cf3d4aad service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:35.325631 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-60723f36-f872-46e9-a2b4-e600cf3d4aad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:35.521631 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60723f36-f872-46e9-a2b4-e600cf3d4aad service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:35.528799 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb096d76-0959-4d8f-a650-b964697ce000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:35.529740 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb096d76-0959-4d8f-a650-b964697ce000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:35.529993 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb096d76-0959-4d8f-a650-b964697ce000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:35.530449 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb096d76-0959-4d8f-a650-b964697ce000 admin admin] PATH_INFO: `/v3/users/2f3eaf04063e4785af248a43ab09f1e9` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:35.531936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb096d76-0959-4d8f-a650-b964697ce000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f3eaf04063e4785af248a43ab09f1e9)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:35.535326 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb096d76-0959-4d8f-a650-b964697ce000 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:35.651730 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bb096d76-0959-4d8f-a650-b964697ce000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f3eaf04063e4785af248a43ab09f1e9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:35.665587 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bb096d76-0959-4d8f-a650-b964697ce000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f3eaf04063e4785af248a43ab09f1e9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:35.679950 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bb096d76-0959-4d8f-a650-b964697ce000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f3eaf04063e4785af248a43ab09f1e9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:35.680830 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bb096d76-0959-4d8f-a650-b964697ce000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f3eaf04063e4785af248a43ab09f1e9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:35.681874 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bb096d76-0959-4d8f-a650-b964697ce000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f3eaf04063e4785af248a43ab09f1e9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:35.708831 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1259/2479] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:13:35 2022] DELETE /identity/v3/users/2f3eaf04063e4785af248a43ab09f1e9 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:13:35.713719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9745fbe-c2c6-476d-8dba-52b8f57b4661 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:35.714260 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9745fbe-c2c6-476d-8dba-52b8f57b4661 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:35.714260 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9745fbe-c2c6-476d-8dba-52b8f57b4661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:35.738601 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c9745fbe-c2c6-476d-8dba-52b8f57b4661 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:35.740641 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c9745fbe-c2c6-476d-8dba-52b8f57b4661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:35.854534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1221/2480] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:35.897633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb096d76-0959-4d8f-a650-b964697ce000 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:35.899154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bb096d76-0959-4d8f-a650-b964697ce000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:35.968420 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:36.005901 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb096d76-0959-4d8f-a650-b964697ce000 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:36.009238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9ce77-9d1a-4cfd-8d5e-a4d86b707602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:36.009926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9ce77-9d1a-4cfd-8d5e-a4d86b707602 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:36.010375 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9ce77-9d1a-4cfd-8d5e-a4d86b707602 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:36.011965 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9ce77-9d1a-4cfd-8d5e-a4d86b707602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:36.022893 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9ce77-9d1a-4cfd-8d5e-a4d86b707602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:36.024680 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9ce77-9d1a-4cfd-8d5e-a4d86b707602 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:36.039206 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1260/2481] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:36.564527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9745fbe-c2c6-476d-8dba-52b8f57b4661 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:36.566006 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c9745fbe-c2c6-476d-8dba-52b8f57b4661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:36.580349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:36.586037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9745fbe-c2c6-476d-8dba-52b8f57b4661 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:36.593093 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de059b45-c370-41b1-9a77-2d52f6ca55ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:36.597155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de059b45-c370-41b1-9a77-2d52f6ca55ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:36.597456 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de059b45-c370-41b1-9a77-2d52f6ca55ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:36.597747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de059b45-c370-41b1-9a77-2d52f6ca55ac admin admin] PATH_INFO: `/v3/projects/3b638c2a1b7441eead2b1db106455e4e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:36.601095 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de059b45-c370-41b1-9a77-2d52f6ca55ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b638c2a1b7441eead2b1db106455e4e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:36.603126 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de059b45-c370-41b1-9a77-2d52f6ca55ac admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:36.688411 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-de059b45-c370-41b1-9a77-2d52f6ca55ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b638c2a1b7441eead2b1db106455e4e', 'request_id': 'req-de059b45-c370-41b1-9a77-2d52f6ca55ac'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:36.704131 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-de059b45-c370-41b1-9a77-2d52f6ca55ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b638c2a1b7441eead2b1db106455e4e', 'request_id': 'req-de059b45-c370-41b1-9a77-2d52f6ca55ac'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:36.711759 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-de059b45-c370-41b1-9a77-2d52f6ca55ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b638c2a1b7441eead2b1db106455e4e', 'request_id': 'req-de059b45-c370-41b1-9a77-2d52f6ca55ac'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:36.727879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-de059b45-c370-41b1-9a77-2d52f6ca55ac admin admin] The token cache is being invalidate because project 3b638c2a1b7441eead2b1db106455e4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:13:36.728965 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-de059b45-c370-41b1-9a77-2d52f6ca55ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:36.729332 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-de059b45-c370-41b1-9a77-2d52f6ca55ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:36.731339 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1222/2482] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:13:36 2022] DELETE /identity/v3/projects/3b638c2a1b7441eead2b1db106455e4e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:13:36.737056 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4d93b-460d-4547-8252-f9f413652577 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:36.737682 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4d93b-460d-4547-8252-f9f413652577 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:36.737977 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4d93b-460d-4547-8252-f9f413652577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:36.761605 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e6c4d93b-460d-4547-8252-f9f413652577 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:36.763345 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e6c4d93b-460d-4547-8252-f9f413652577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:36.858161 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1261/2483] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:36.866879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ccc18-4d47-4136-9314-f08d29e6d4a2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:36.867229 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ccc18-4d47-4136-9314-f08d29e6d4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:36.867507 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ccc18-4d47-4136-9314-f08d29e6d4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:36.900521 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-760ccc18-4d47-4136-9314-f08d29e6d4a2 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:36.902886 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-760ccc18-4d47-4136-9314-f08d29e6d4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:36.932687 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1223/2484] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:36.937821 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4d93b-460d-4547-8252-f9f413652577 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:36.961500 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4d93b-460d-4547-8252-f9f413652577 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:36.969268 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091c8cc-999e-42a4-9603-f1cda86b955d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:36.970799 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091c8cc-999e-42a4-9603-f1cda86b955d admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:36.971360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091c8cc-999e-42a4-9603-f1cda86b955d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:36.971860 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091c8cc-999e-42a4-9603-f1cda86b955d admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:36.973667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091c8cc-999e-42a4-9603-f1cda86b955d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:13:36.974316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091c8cc-999e-42a4-9603-f1cda86b955d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:36.977745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091c8cc-999e-42a4-9603-f1cda86b955d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:36.977947 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ccc18-4d47-4136-9314-f08d29e6d4a2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:36.980078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-760ccc18-4d47-4136-9314-f08d29e6d4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:37.004771 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1262/2485] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:13:37.008070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091c8cc-999e-42a4-9603-f1cda86b955d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:37.023086 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091c8cc-999e-42a4-9603-f1cda86b955d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:37.030220 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a7cfc-4524-4320-a709-f5133a952be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:37.030926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a7cfc-4524-4320-a709-f5133a952be4 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:37.031717 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a7cfc-4524-4320-a709-f5133a952be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:37.032015 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a7cfc-4524-4320-a709-f5133a952be4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:37.032774 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a7cfc-4524-4320-a709-f5133a952be4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:37.035033 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a7cfc-4524-4320-a709-f5133a952be4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:37.088008 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1263/2486] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:13:37 2022] POST /identity/v3/projects => generated 393 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:13:37.093355 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a7cfc-4524-4320-a709-f5133a952be4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:37.115856 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ccc18-4d47-4136-9314-f08d29e6d4a2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:37.216817 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0610eea-bbe1-46aa-9c97-200845d7b5de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:37.218022 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0610eea-bbe1-46aa-9c97-200845d7b5de service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:37.218466 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0610eea-bbe1-46aa-9c97-200845d7b5de service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:37.218908 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0610eea-bbe1-46aa-9c97-200845d7b5de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:37.221557 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a0610eea-bbe1-46aa-9c97-200845d7b5de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:37.243527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0610eea-bbe1-46aa-9c97-200845d7b5de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:37.245996 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0610eea-bbe1-46aa-9c97-200845d7b5de service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:37.247160 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a7cfc-4524-4320-a709-f5133a952be4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:37.258964 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce11e17-bdcd-4fdd-9db7-538c712a963b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:37.260306 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce11e17-bdcd-4fdd-9db7-538c712a963b admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:37.261026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce11e17-bdcd-4fdd-9db7-538c712a963b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:37.261909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce11e17-bdcd-4fdd-9db7-538c712a963b admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:37.262920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1224/2487] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:37.263187 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce11e17-bdcd-4fdd-9db7-538c712a963b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:37.269056 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce11e17-bdcd-4fdd-9db7-538c712a963b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:37.329319 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1264/2488] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:13:37 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:13:37.330766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0610eea-bbe1-46aa-9c97-200845d7b5de service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:37.342309 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:37.349398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0610eea-bbe1-46aa-9c97-200845d7b5de service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:37.368483 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab06e9-dbb9-4557-92ab-f90a93292453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:37.370419 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab06e9-dbb9-4557-92ab-f90a93292453 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:37.371315 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab06e9-dbb9-4557-92ab-f90a93292453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:37.373992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab06e9-dbb9-4557-92ab-f90a93292453 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:37.375228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab06e9-dbb9-4557-92ab-f90a93292453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:37.379480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab06e9-dbb9-4557-92ab-f90a93292453 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:37.399096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1225/2489] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:13:37.403651 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce11e17-bdcd-4fdd-9db7-538c712a963b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:37.419413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce11e17-bdcd-4fdd-9db7-538c712a963b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:37.433566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32367e74-bebe-4526-ac51-fd5303204286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:37.433566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32367e74-bebe-4526-ac51-fd5303204286 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:37.433939 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32367e74-bebe-4526-ac51-fd5303204286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:37.435228 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32367e74-bebe-4526-ac51-fd5303204286 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:37.435228 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32367e74-bebe-4526-ac51-fd5303204286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:37.443279 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32367e74-bebe-4526-ac51-fd5303204286 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:37.460149 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1265/2490] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:13:37.461283 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab06e9-dbb9-4557-92ab-f90a93292453 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:37.474339 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab06e9-dbb9-4557-92ab-f90a93292453 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:37.480573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc976e9-86d3-403c-ad39-2963a6fb4e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:37.481604 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc976e9-86d3-403c-ad39-2963a6fb4e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:37.481987 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc976e9-86d3-403c-ad39-2963a6fb4e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:37.482400 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc976e9-86d3-403c-ad39-2963a6fb4e8a admin admin] PATH_INFO: `/v3/projects/de625bf0c7944e3492adfe75ca4a0ade/users/cd6eb735514542e0b1c7484f4f44e295/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:37.502879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc976e9-86d3-403c-ad39-2963a6fb4e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=de625bf0c7944e3492adfe75ca4a0ade, user_id=cd6eb735514542e0b1c7484f4f44e295, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:37.506291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc976e9-86d3-403c-ad39-2963a6fb4e8a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:37.529215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1226/2491] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:13:37 2022] PUT /identity/v3/projects/de625bf0c7944e3492adfe75ca4a0ade/users/cd6eb735514542e0b1c7484f4f44e295/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:13:37.542177 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23a5c6-712f-4281-9433-dd92a899bb8a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:37.542758 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23a5c6-712f-4281-9433-dd92a899bb8a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:37.543360 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23a5c6-712f-4281-9433-dd92a899bb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:37.584109 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0e23a5c6-712f-4281-9433-dd92a899bb8a None None] MFA Rules not processed for user `cd6eb735514542e0b1c7484f4f44e295`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:37.586595 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0e23a5c6-712f-4281-9433-dd92a899bb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:37.609490 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:37.740950 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1266/2492] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:13:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:37.746318 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc976e9-86d3-403c-ad39-2963a6fb4e8a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:37.878299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc976e9-86d3-403c-ad39-2963a6fb4e8a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:37.886230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e80f2c-ea3b-45bd-ad9d-600f2c6e629e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:37.887590 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e80f2c-ea3b-45bd-ad9d-600f2c6e629e admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:37.888078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e80f2c-ea3b-45bd-ad9d-600f2c6e629e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:37.888578 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e80f2c-ea3b-45bd-ad9d-600f2c6e629e admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:37.890213 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e80f2c-ea3b-45bd-ad9d-600f2c6e629e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:37.894108 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e80f2c-ea3b-45bd-ad9d-600f2c6e629e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:37.952313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1227/2493] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:13:37 2022] POST /identity/v3/projects => generated 391 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:13:37.954313 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23a5c6-712f-4281-9433-dd92a899bb8a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:37.966902 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23a5c6-712f-4281-9433-dd92a899bb8a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:38.050972 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c515f0a-375b-4300-9b4a-8276819d70ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:38.051913 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c515f0a-375b-4300-9b4a-8276819d70ff admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:38.052694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c515f0a-375b-4300-9b4a-8276819d70ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:38.053051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c515f0a-375b-4300-9b4a-8276819d70ff admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:38.054234 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c515f0a-375b-4300-9b4a-8276819d70ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:38.056858 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c515f0a-375b-4300-9b4a-8276819d70ff admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:38.093116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e80f2c-ea3b-45bd-ad9d-600f2c6e629e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:38.107760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1267/2494] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:13:37 2022] POST /identity/v3/users => generated 302 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:13:38.117637 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e80f2c-ea3b-45bd-ad9d-600f2c6e629e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:38.125046 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b93dd1-4ecb-4ca4-8458-34e386f12246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:38.126234 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b93dd1-4ecb-4ca4-8458-34e386f12246 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:38.126869 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b93dd1-4ecb-4ca4-8458-34e386f12246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:38.127163 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b93dd1-4ecb-4ca4-8458-34e386f12246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:38.128144 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b93dd1-4ecb-4ca4-8458-34e386f12246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:38.131977 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b93dd1-4ecb-4ca4-8458-34e386f12246 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:38.158066 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1228/2495] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:13:38.158777 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c515f0a-375b-4300-9b4a-8276819d70ff admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:38.171217 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c515f0a-375b-4300-9b4a-8276819d70ff admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:38.178952 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32468d-bafc-432a-ae6e-8764ba0bcdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:38.180211 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32468d-bafc-432a-ae6e-8764ba0bcdf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:38.180504 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32468d-bafc-432a-ae6e-8764ba0bcdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:38.180828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32468d-bafc-432a-ae6e-8764ba0bcdf4 admin admin] PATH_INFO: `/v3/projects/c7fefdf15da9497e9bbca4d6577b4927/users/b834e13b0a7a4269b9a2b1eed9d79c44/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:38.204198 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32468d-bafc-432a-ae6e-8764ba0bcdf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7fefdf15da9497e9bbca4d6577b4927, user_id=b834e13b0a7a4269b9a2b1eed9d79c44, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:38.208006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32468d-bafc-432a-ae6e-8764ba0bcdf4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:38.232125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1268/2496] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:13:38 2022] PUT /identity/v3/projects/c7fefdf15da9497e9bbca4d6577b4927/users/b834e13b0a7a4269b9a2b1eed9d79c44/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:13:38.236618 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b93dd1-4ecb-4ca4-8458-34e386f12246 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:38.250909 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b93dd1-4ecb-4ca4-8458-34e386f12246 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:38.357856 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88814d-a001-40ec-9034-4121d88560e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:38.358815 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88814d-a001-40ec-9034-4121d88560e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:38.359387 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88814d-a001-40ec-9034-4121d88560e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:38.359881 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88814d-a001-40ec-9034-4121d88560e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:38.360870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88814d-a001-40ec-9034-4121d88560e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:38.363416 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88814d-a001-40ec-9034-4121d88560e0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:38.379234 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1229/2497] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:13:38.383452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32468d-bafc-432a-ae6e-8764ba0bcdf4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:38.399976 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32468d-bafc-432a-ae6e-8764ba0bcdf4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:38.405861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c328d5-4796-4935-8fb1-aeab5e628ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:38.407012 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c328d5-4796-4935-8fb1-aeab5e628ae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:38.407408 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c328d5-4796-4935-8fb1-aeab5e628ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:38.407791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c328d5-4796-4935-8fb1-aeab5e628ae9 admin admin] PATH_INFO: `/v3/projects/c7fefdf15da9497e9bbca4d6577b4927/users/b834e13b0a7a4269b9a2b1eed9d79c44/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:38.410597 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c328d5-4796-4935-8fb1-aeab5e628ae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7fefdf15da9497e9bbca4d6577b4927, user_id=b834e13b0a7a4269b9a2b1eed9d79c44, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:38.424774 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c328d5-4796-4935-8fb1-aeab5e628ae9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:38.451950 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1269/2498] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:13:38 2022] PUT /identity/v3/projects/c7fefdf15da9497e9bbca4d6577b4927/users/b834e13b0a7a4269b9a2b1eed9d79c44/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:13:38.466411 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead02725-e3cb-4559-abc8-11e8ec19b44d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:38.467425 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead02725-e3cb-4559-abc8-11e8ec19b44d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:38.468650 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead02725-e3cb-4559-abc8-11e8ec19b44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:38.563193 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ead02725-e3cb-4559-abc8-11e8ec19b44d None None] MFA Rules not processed for user `b834e13b0a7a4269b9a2b1eed9d79c44`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:38.566463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ead02725-e3cb-4559-abc8-11e8ec19b44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:38.645190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:38.803418 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1230/2499] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:13:38 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:38.821594 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c328d5-4796-4935-8fb1-aeab5e628ae9 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:38.823851 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-72c328d5-4796-4935-8fb1-aeab5e628ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:38.941964 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:38.952942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c328d5-4796-4935-8fb1-aeab5e628ae9 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:38.965254 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a487cf-44e5-4be9-934e-5e3f5bb429a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:38.966072 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a487cf-44e5-4be9-934e-5e3f5bb429a8 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:38.966670 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a487cf-44e5-4be9-934e-5e3f5bb429a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:38.967472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a487cf-44e5-4be9-934e-5e3f5bb429a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:39.066942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a487cf-44e5-4be9-934e-5e3f5bb429a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:39.069905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a487cf-44e5-4be9-934e-5e3f5bb429a8 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:39.088700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1270/2500] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:44.342387 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead02725-e3cb-4559-abc8-11e8ec19b44d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:44.346396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ead02725-e3cb-4559-abc8-11e8ec19b44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:44.458199 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead02725-e3cb-4559-abc8-11e8ec19b44d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:44.462233 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bfb74-6b5d-496a-b1cb-49a56b73dc7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:44.463594 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bfb74-6b5d-496a-b1cb-49a56b73dc7f service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:44.463594 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bfb74-6b5d-496a-b1cb-49a56b73dc7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:44.463594 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bfb74-6b5d-496a-b1cb-49a56b73dc7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:44.478334 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bfb74-6b5d-496a-b1cb-49a56b73dc7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:44.481463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bfb74-6b5d-496a-b1cb-49a56b73dc7f service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:44.509360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1231/2501] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:49.080391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=27 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:50.144508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79108f-01c6-4336-b097-cad575975522 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:50.146002 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79108f-01c6-4336-b097-cad575975522 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:50.146472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79108f-01c6-4336-b097-cad575975522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:50.179172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7f79108f-01c6-4336-b097-cad575975522 None None] MFA Rules not processed for user `cd6eb735514542e0b1c7484f4f44e295`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:50.181272 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7f79108f-01c6-4336-b097-cad575975522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:50.200834 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1271/2502] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:13:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:54.488182 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=42 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:55.382665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bfb74-6b5d-496a-b1cb-49a56b73dc7f service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:55.384845 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8e2bfb74-6b5d-496a-b1cb-49a56b73dc7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:55.500962 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bfb74-6b5d-496a-b1cb-49a56b73dc7f service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:55.507662 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff516b7-833c-4435-85d2-861eb2d9ea7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:55.509243 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff516b7-833c-4435-85d2-861eb2d9ea7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:55.509741 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff516b7-833c-4435-85d2-861eb2d9ea7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:55.510217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff516b7-833c-4435-85d2-861eb2d9ea7f admin admin] PATH_INFO: `/v3/users/6ca195ef98cd49c68c14e1b9b8e8432c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:55.511945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff516b7-833c-4435-85d2-861eb2d9ea7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ca195ef98cd49c68c14e1b9b8e8432c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:55.514458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff516b7-833c-4435-85d2-861eb2d9ea7f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:55.600561 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-aff516b7-833c-4435-85d2-861eb2d9ea7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ca195ef98cd49c68c14e1b9b8e8432c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:55.614275 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-aff516b7-833c-4435-85d2-861eb2d9ea7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ca195ef98cd49c68c14e1b9b8e8432c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:55.647232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-aff516b7-833c-4435-85d2-861eb2d9ea7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ca195ef98cd49c68c14e1b9b8e8432c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:55.648611 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-aff516b7-833c-4435-85d2-861eb2d9ea7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ca195ef98cd49c68c14e1b9b8e8432c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:55.665897 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-aff516b7-833c-4435-85d2-861eb2d9ea7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ca195ef98cd49c68c14e1b9b8e8432c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:55.682109 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1232/2503] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:13:55 2022] DELETE /identity/v3/users/6ca195ef98cd49c68c14e1b9b8e8432c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:13:55.688260 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88096fc4-f67d-4aec-ac07-e2d3e033eec8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:55.689119 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88096fc4-f67d-4aec-ac07-e2d3e033eec8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:55.689292 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88096fc4-f67d-4aec-ac07-e2d3e033eec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:55.724092 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-88096fc4-f67d-4aec-ac07-e2d3e033eec8 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:55.725876 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-88096fc4-f67d-4aec-ac07-e2d3e033eec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:55.853120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1272/2504] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:13:55.872303 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff516b7-833c-4435-85d2-861eb2d9ea7f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:55.875235 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-aff516b7-833c-4435-85d2-861eb2d9ea7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:56.007973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff516b7-833c-4435-85d2-861eb2d9ea7f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:56.016648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a35a9c-61b7-4655-b1ac-d674cea29156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:56.018272 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a35a9c-61b7-4655-b1ac-d674cea29156 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:56.018943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a35a9c-61b7-4655-b1ac-d674cea29156 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:56.020770 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a35a9c-61b7-4655-b1ac-d674cea29156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:56.040393 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a35a9c-61b7-4655-b1ac-d674cea29156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:56.042928 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a35a9c-61b7-4655-b1ac-d674cea29156 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:56.059794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1233/2505] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:56.416032 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88096fc4-f67d-4aec-ac07-e2d3e033eec8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:56.419148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-88096fc4-f67d-4aec-ac07-e2d3e033eec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:56.452384 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88096fc4-f67d-4aec-ac07-e2d3e033eec8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:56.471116 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ec283-e60c-434c-a96a-0c480342f090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:56.473636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ec283-e60c-434c-a96a-0c480342f090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:56.474295 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ec283-e60c-434c-a96a-0c480342f090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:56.474944 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ec283-e60c-434c-a96a-0c480342f090 admin admin] PATH_INFO: `/v3/projects/ceca4b8f75974b8fb4b7c713cc3007fb` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:56.482104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ec283-e60c-434c-a96a-0c480342f090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceca4b8f75974b8fb4b7c713cc3007fb)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:56.483927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ec283-e60c-434c-a96a-0c480342f090 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:56.611352 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-814ec283-e60c-434c-a96a-0c480342f090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceca4b8f75974b8fb4b7c713cc3007fb', 'request_id': 'req-814ec283-e60c-434c-a96a-0c480342f090'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:56.621644 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-814ec283-e60c-434c-a96a-0c480342f090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceca4b8f75974b8fb4b7c713cc3007fb', 'request_id': 'req-814ec283-e60c-434c-a96a-0c480342f090'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:56.629776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-814ec283-e60c-434c-a96a-0c480342f090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceca4b8f75974b8fb4b7c713cc3007fb', 'request_id': 'req-814ec283-e60c-434c-a96a-0c480342f090'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:56.651326 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-814ec283-e60c-434c-a96a-0c480342f090 admin admin] The token cache is being invalidate because project ceca4b8f75974b8fb4b7c713cc3007fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:13:56.652399 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-814ec283-e60c-434c-a96a-0c480342f090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:56.653418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-814ec283-e60c-434c-a96a-0c480342f090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:56.656031 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1273/2506] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:13:56 2022] DELETE /identity/v3/projects/ceca4b8f75974b8fb4b7c713cc3007fb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:13:56.662250 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eac9a-a957-46a1-8d8d-5c1ae9a40a14 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:56.663429 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eac9a-a957-46a1-8d8d-5c1ae9a40a14 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:56.663916 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eac9a-a957-46a1-8d8d-5c1ae9a40a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:56.686206 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4b4eac9a-a957-46a1-8d8d-5c1ae9a40a14 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:56.688169 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4b4eac9a-a957-46a1-8d8d-5c1ae9a40a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:56.717885 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:56.786411 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1234/2507] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:13:56.795661 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9c353-fc2f-4a2d-b6a9-b307d3dd9e49 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:56.796672 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9c353-fc2f-4a2d-b6a9-b307d3dd9e49 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:56.796998 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9c353-fc2f-4a2d-b6a9-b307d3dd9e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:56.822221 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8fb9c353-fc2f-4a2d-b6a9-b307d3dd9e49 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:56.823674 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8fb9c353-fc2f-4a2d-b6a9-b307d3dd9e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:56.838620 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1274/2508] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:13:56.843568 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4eac9a-a957-46a1-8d8d-5c1ae9a40a14 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:56.855953 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4eac9a-a957-46a1-8d8d-5c1ae9a40a14 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:56.863042 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6b504-038d-4209-bf46-0e1e52359f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:56.863900 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6b504-038d-4209-bf46-0e1e52359f9c admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:56.864183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6b504-038d-4209-bf46-0e1e52359f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:56.864462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6b504-038d-4209-bf46-0e1e52359f9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:56.865269 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6b504-038d-4209-bf46-0e1e52359f9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:13:56.865583 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6b504-038d-4209-bf46-0e1e52359f9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:56.867360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6b504-038d-4209-bf46-0e1e52359f9c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:56.883929 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1235/2509] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:13:56.890157 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9c353-fc2f-4a2d-b6a9-b307d3dd9e49 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:56.901407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9c353-fc2f-4a2d-b6a9-b307d3dd9e49 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:56.908377 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c68b1-5e57-49cc-8e00-e9dece8e4729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:56.909045 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c68b1-5e57-49cc-8e00-e9dece8e4729 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:56.909329 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c68b1-5e57-49cc-8e00-e9dece8e4729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:56.909604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c68b1-5e57-49cc-8e00-e9dece8e4729 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:56.910525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c68b1-5e57-49cc-8e00-e9dece8e4729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:56.912834 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c68b1-5e57-49cc-8e00-e9dece8e4729 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:56.953826 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1275/2510] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:13:56 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:13:56.958445 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6b504-038d-4209-bf46-0e1e52359f9c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:56.970414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6b504-038d-4209-bf46-0e1e52359f9c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:57.058332 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd7d05-c3bc-4fdd-b9ee-4171cdf6efa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:57.059081 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd7d05-c3bc-4fdd-b9ee-4171cdf6efa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:57.059371 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd7d05-c3bc-4fdd-b9ee-4171cdf6efa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:57.059653 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd7d05-c3bc-4fdd-b9ee-4171cdf6efa1 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:57.060445 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd7d05-c3bc-4fdd-b9ee-4171cdf6efa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:57.062567 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd7d05-c3bc-4fdd-b9ee-4171cdf6efa1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:57.089254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1236/2511] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:13:56 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:13:57.093767 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c68b1-5e57-49cc-8e00-e9dece8e4729 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:57.106039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c68b1-5e57-49cc-8e00-e9dece8e4729 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:57.111924 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83250b99-3b0e-48ec-af3e-d76aae613e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:57.112637 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83250b99-3b0e-48ec-af3e-d76aae613e71 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:57.113023 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83250b99-3b0e-48ec-af3e-d76aae613e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:57.113390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83250b99-3b0e-48ec-af3e-d76aae613e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:57.114545 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83250b99-3b0e-48ec-af3e-d76aae613e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:57.116340 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83250b99-3b0e-48ec-af3e-d76aae613e71 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:57.131818 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1276/2512] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:13:57.135509 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd7d05-c3bc-4fdd-b9ee-4171cdf6efa1 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:57.147869 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd7d05-c3bc-4fdd-b9ee-4171cdf6efa1 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:57.153089 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b881d3-7367-461b-982c-b90a69b1504e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:57.153806 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b881d3-7367-461b-982c-b90a69b1504e admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:57.154093 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b881d3-7367-461b-982c-b90a69b1504e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:57.154374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b881d3-7367-461b-982c-b90a69b1504e admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:57.155137 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b881d3-7367-461b-982c-b90a69b1504e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:57.156894 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b881d3-7367-461b-982c-b90a69b1504e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:57.170410 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1237/2513] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:13:57.174572 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83250b99-3b0e-48ec-af3e-d76aae613e71 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:57.191028 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83250b99-3b0e-48ec-af3e-d76aae613e71 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:57.196622 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abefaa-f75c-4c00-95de-0fd6b73913bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:57.197629 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abefaa-f75c-4c00-95de-0fd6b73913bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:57.197976 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abefaa-f75c-4c00-95de-0fd6b73913bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:57.198226 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abefaa-f75c-4c00-95de-0fd6b73913bd admin admin] PATH_INFO: `/v3/projects/23eb8e40b45c450f9b52f737140f8ee8/users/bca86a340d0547ef8ac6c2a5ec182494/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:57.223576 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abefaa-f75c-4c00-95de-0fd6b73913bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=23eb8e40b45c450f9b52f737140f8ee8, user_id=bca86a340d0547ef8ac6c2a5ec182494, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:57.228379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abefaa-f75c-4c00-95de-0fd6b73913bd admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:57.256485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1277/2514] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:13:57 2022] PUT /identity/v3/projects/23eb8e40b45c450f9b52f737140f8ee8/users/bca86a340d0547ef8ac6c2a5ec182494/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:13:57.273034 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a89a7-e3bb-42f5-afbc-6f78430cfb7a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:57.273530 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a89a7-e3bb-42f5-afbc-6f78430cfb7a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:57.274006 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a89a7-e3bb-42f5-afbc-6f78430cfb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:57.314950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-802a89a7-e3bb-42f5-afbc-6f78430cfb7a None None] MFA Rules not processed for user `bca86a340d0547ef8ac6c2a5ec182494`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:57.316271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-802a89a7-e3bb-42f5-afbc-6f78430cfb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:57.407466 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1238/2515] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:13:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:57.413169 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abefaa-f75c-4c00-95de-0fd6b73913bd admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:57.432780 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:57.508117 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abefaa-f75c-4c00-95de-0fd6b73913bd admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:57.513928 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96690f-677b-43a3-b95a-0b5828023c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:57.514663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96690f-677b-43a3-b95a-0b5828023c47 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:57.514942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96690f-677b-43a3-b95a-0b5828023c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:57.515211 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96690f-677b-43a3-b95a-0b5828023c47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:57.515932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96690f-677b-43a3-b95a-0b5828023c47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:57.517937 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96690f-677b-43a3-b95a-0b5828023c47 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:57.549148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1278/2516] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:13:57 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:13:57.555384 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a89a7-e3bb-42f5-afbc-6f78430cfb7a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:57.569217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a89a7-e3bb-42f5-afbc-6f78430cfb7a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:57.590951 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:57.653375 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991a604-61ba-4e9a-a889-bd3e4fa5c93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:57.654684 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991a604-61ba-4e9a-a889-bd3e4fa5c93d admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:57.655062 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991a604-61ba-4e9a-a889-bd3e4fa5c93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:57.655443 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991a604-61ba-4e9a-a889-bd3e4fa5c93d admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:57.656307 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991a604-61ba-4e9a-a889-bd3e4fa5c93d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:57.658735 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991a604-61ba-4e9a-a889-bd3e4fa5c93d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:57.683550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1239/2517] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:13:57 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:13:57.688051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96690f-677b-43a3-b95a-0b5828023c47 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:57.700771 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96690f-677b-43a3-b95a-0b5828023c47 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:57.706764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9ce66-8e79-4d9d-9b85-7173f32fcd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:57.707952 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9ce66-8e79-4d9d-9b85-7173f32fcd9f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:57.708459 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9ce66-8e79-4d9d-9b85-7173f32fcd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:57.709000 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9ce66-8e79-4d9d-9b85-7173f32fcd9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:57.710421 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9ce66-8e79-4d9d-9b85-7173f32fcd9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:57.713155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9ce66-8e79-4d9d-9b85-7173f32fcd9f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:57.733075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1279/2518] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:13:57.738434 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991a604-61ba-4e9a-a889-bd3e4fa5c93d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:57.749962 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991a604-61ba-4e9a-a889-bd3e4fa5c93d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:57.755904 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde94ce8-b35b-4282-bc9e-ad945c085f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:57.756906 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde94ce8-b35b-4282-bc9e-ad945c085f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:57.757197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde94ce8-b35b-4282-bc9e-ad945c085f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:57.757475 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde94ce8-b35b-4282-bc9e-ad945c085f63 admin admin] PATH_INFO: `/v3/projects/4c5756a9fb974d32934527de149d16de/users/213a0881985f4fc1bb474e020929870a/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:57.778369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde94ce8-b35b-4282-bc9e-ad945c085f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5756a9fb974d32934527de149d16de, user_id=213a0881985f4fc1bb474e020929870a, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:57.781292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde94ce8-b35b-4282-bc9e-ad945c085f63 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:57.803521 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1240/2519] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:13:57 2022] PUT /identity/v3/projects/4c5756a9fb974d32934527de149d16de/users/213a0881985f4fc1bb474e020929870a/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:13:57.810067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9ce66-8e79-4d9d-9b85-7173f32fcd9f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:57.822311 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9ce66-8e79-4d9d-9b85-7173f32fcd9f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:57.899917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab9b77-f801-4526-8505-8bdf8da5c565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:57.900683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab9b77-f801-4526-8505-8bdf8da5c565 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:57.901123 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab9b77-f801-4526-8505-8bdf8da5c565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:57.901395 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab9b77-f801-4526-8505-8bdf8da5c565 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:57.902145 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab9b77-f801-4526-8505-8bdf8da5c565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:57.903800 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab9b77-f801-4526-8505-8bdf8da5c565 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:57.916643 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1280/2520] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:13:57.921606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde94ce8-b35b-4282-bc9e-ad945c085f63 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:57.935328 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde94ce8-b35b-4282-bc9e-ad945c085f63 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:57.941386 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212ecff-7399-461b-bbc8-688583447157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:57.942386 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212ecff-7399-461b-bbc8-688583447157 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:57.942675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212ecff-7399-461b-bbc8-688583447157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:57.942963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212ecff-7399-461b-bbc8-688583447157 admin admin] PATH_INFO: `/v3/projects/4c5756a9fb974d32934527de149d16de/users/213a0881985f4fc1bb474e020929870a/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:57.945249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212ecff-7399-461b-bbc8-688583447157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5756a9fb974d32934527de149d16de, user_id=213a0881985f4fc1bb474e020929870a, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:57.948033 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212ecff-7399-461b-bbc8-688583447157 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:57.960607 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1241/2521] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:13:57 2022] PUT /identity/v3/projects/4c5756a9fb974d32934527de149d16de/users/213a0881985f4fc1bb474e020929870a/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:13:57.972965 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f8507-077f-4914-b87f-2ef189a826ea None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:57.973293 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f8507-077f-4914-b87f-2ef189a826ea None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:57.973616 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f8507-077f-4914-b87f-2ef189a826ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:58.009381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3f5f8507-077f-4914-b87f-2ef189a826ea None None] MFA Rules not processed for user `213a0881985f4fc1bb474e020929870a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:58.011440 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3f5f8507-077f-4914-b87f-2ef189a826ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:58.143236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1281/2522] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:13:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:58.158652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212ecff-7399-461b-bbc8-688583447157 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:58.160935 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2212ecff-7399-461b-bbc8-688583447157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:58.272744 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212ecff-7399-461b-bbc8-688583447157 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:58.277899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd10108-7678-4e83-b7dd-870381a5e32d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:58.278988 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd10108-7678-4e83-b7dd-870381a5e32d service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:58.279457 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd10108-7678-4e83-b7dd-870381a5e32d service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:58.279855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd10108-7678-4e83-b7dd-870381a5e32d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:58.365410 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd10108-7678-4e83-b7dd-870381a5e32d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:58.366922 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd10108-7678-4e83-b7dd-870381a5e32d service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:58.378140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1242/2523] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:14:00.947645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f8507-077f-4914-b87f-2ef189a826ea None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:14:00.949835 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3f5f8507-077f-4914-b87f-2ef189a826ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:00.974430 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f8507-077f-4914-b87f-2ef189a826ea None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:14:00.980818 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52453716-c25d-476c-96a5-48a883967625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:14:00.981678 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52453716-c25d-476c-96a5-48a883967625 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:00.982062 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52453716-c25d-476c-96a5-48a883967625 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:00.982481 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52453716-c25d-476c-96a5-48a883967625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:00.995550 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:14:00.999180 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52453716-c25d-476c-96a5-48a883967625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:14:01.001563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52453716-c25d-476c-96a5-48a883967625 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:14:01.015714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1282/2524] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:14:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:14:07.849143 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66f996-48ad-41ac-9cad-d906c8244cf0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:07.851040 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66f996-48ad-41ac-9cad-d906c8244cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:07.851801 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66f996-48ad-41ac-9cad-d906c8244cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:07.901301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-af66f996-48ad-41ac-9cad-d906c8244cf0 None None] MFA Rules not processed for user `bca86a340d0547ef8ac6c2a5ec182494`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:14:07.904116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-af66f996-48ad-41ac-9cad-d906c8244cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:07.926396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1243/2525] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:14:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:14:09.304146 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52453716-c25d-476c-96a5-48a883967625 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:14:09.314330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52453716-c25d-476c-96a5-48a883967625 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:14:09.319081 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b1d14-d12f-45df-975b-9e47dfdec67f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:14:09.319852 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b1d14-d12f-45df-975b-9e47dfdec67f service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:09.320194 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b1d14-d12f-45df-975b-9e47dfdec67f service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:09.320572 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b1d14-d12f-45df-975b-9e47dfdec67f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:09.322799 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ac0b1d14-d12f-45df-975b-9e47dfdec67f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:09.340176 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b1d14-d12f-45df-975b-9e47dfdec67f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:14:09.341851 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b1d14-d12f-45df-975b-9e47dfdec67f service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:14:09.352920 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1283/2526] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:14:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:14:14.090794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66f996-48ad-41ac-9cad-d906c8244cf0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:14:14.092350 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-af66f996-48ad-41ac-9cad-d906c8244cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:14.128740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:14:14.242809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66f996-48ad-41ac-9cad-d906c8244cf0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:14:14.249147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c7816-6cec-4acb-b3bd-337252b81839 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:14:14.249999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c7816-6cec-4acb-b3bd-337252b81839 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:14.250320 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c7816-6cec-4acb-b3bd-337252b81839 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:14.250572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c7816-6cec-4acb-b3bd-337252b81839 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:14.258064 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3b3c7816-6cec-4acb-b3bd-337252b81839 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:14.278541 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c7816-6cec-4acb-b3bd-337252b81839 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:14:14.280206 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c7816-6cec-4acb-b3bd-337252b81839 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:14:14.291807 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1244/2527] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:14:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:14:19.348702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=8 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:14:24.287006 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=33 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:05.508791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b1d14-d12f-45df-975b-9e47dfdec67f service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:05.511352 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ac0b1d14-d12f-45df-975b-9e47dfdec67f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:05.620247 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b1d14-d12f-45df-975b-9e47dfdec67f service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:05.624612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc397b-439b-406b-b7dc-24ed915d2b41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8112def59003484483552fc76f14e281', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:05.625480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc397b-439b-406b-b7dc-24ed915d2b41 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:05.625889 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc397b-439b-406b-b7dc-24ed915d2b41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:05.626200 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc397b-439b-406b-b7dc-24ed915d2b41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:05.628243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-40dc397b-439b-406b-b7dc-24ed915d2b41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:05.699860 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc397b-439b-406b-b7dc-24ed915d2b41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:05.701336 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc397b-439b-406b-b7dc-24ed915d2b41 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:05.712746 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1284/2528] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:15:15.707745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=57 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:19.511833 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df081914-e313-4232-a864-7db2d73b2373 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:19.512547 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df081914-e313-4232-a864-7db2d73b2373 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:19.512547 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df081914-e313-4232-a864-7db2d73b2373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:19.536047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-df081914-e313-4232-a864-7db2d73b2373 None None] MFA Rules not processed for user `c83195bd720846fc8ed75aedd152a505`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:19.538225 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-df081914-e313-4232-a864-7db2d73b2373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:19.550844 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1245/2529] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:15:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:19.616081 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc397b-439b-406b-b7dc-24ed915d2b41 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:19.627311 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc397b-439b-406b-b7dc-24ed915d2b41 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:19.631775 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f8452-6f9e-46f8-a001-7bc6e54f857a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8112def59003484483552fc76f14e281', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:19.632474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f8452-6f9e-46f8-a001-7bc6e54f857a service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:19.632781 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f8452-6f9e-46f8-a001-7bc6e54f857a service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:19.633078 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f8452-6f9e-46f8-a001-7bc6e54f857a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:19.635468 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3f1f8452-6f9e-46f8-a001-7bc6e54f857a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:19.726348 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f8452-6f9e-46f8-a001-7bc6e54f857a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:19.728495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f8452-6f9e-46f8-a001-7bc6e54f857a service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:19.743356 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1285/2530] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:15:20.687104 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df081914-e313-4232-a864-7db2d73b2373 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:20.700904 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df081914-e313-4232-a864-7db2d73b2373 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:20.705028 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb5968-07be-4ba7-af11-0f591bcffb12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:20.705748 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb5968-07be-4ba7-af11-0f591bcffb12 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:20.706033 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb5968-07be-4ba7-af11-0f591bcffb12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:20.706310 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb5968-07be-4ba7-af11-0f591bcffb12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:20.708411 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e7eb5968-07be-4ba7-af11-0f591bcffb12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:20.725031 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb5968-07be-4ba7-af11-0f591bcffb12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:20.727090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb5968-07be-4ba7-af11-0f591bcffb12 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:20.744036 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1246/2531] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:15:23.053974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f8452-6f9e-46f8-a001-7bc6e54f857a service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:23.067798 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f8452-6f9e-46f8-a001-7bc6e54f857a service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:23.073238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961e006-4a47-403d-b09b-957c66b83775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:23.074340 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961e006-4a47-403d-b09b-957c66b83775 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:23.074850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961e006-4a47-403d-b09b-957c66b83775 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:23.075498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961e006-4a47-403d-b09b-957c66b83775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:23.077905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4961e006-4a47-403d-b09b-957c66b83775 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:23.096625 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961e006-4a47-403d-b09b-957c66b83775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:23.098325 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961e006-4a47-403d-b09b-957c66b83775 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:23.116821 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1286/2532] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:15:30.736614 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=9 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:33.105342 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=40 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:43.695894 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb5968-07be-4ba7-af11-0f591bcffb12 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:43.707262 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb5968-07be-4ba7-af11-0f591bcffb12 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:43.711554 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb07806-c15b-487c-9752-371fdefffd60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:43.712343 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb07806-c15b-487c-9752-371fdefffd60 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:43.713430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb07806-c15b-487c-9752-371fdefffd60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:43.713963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb07806-c15b-487c-9752-371fdefffd60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:43.718392 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5cb07806-c15b-487c-9752-371fdefffd60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:43.866548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb07806-c15b-487c-9752-371fdefffd60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:43.868072 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb07806-c15b-487c-9752-371fdefffd60 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:43.884250 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1247/2533] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:15:44.077363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9740b13-ffca-49a1-ab96-c6341cb563a9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:44.077968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9740b13-ffca-49a1-ab96-c6341cb563a9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:44.078237 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9740b13-ffca-49a1-ab96-c6341cb563a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:44.108801 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a9740b13-ffca-49a1-ab96-c6341cb563a9 None None] MFA Rules not processed for user `bca86a340d0547ef8ac6c2a5ec182494`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:44.110793 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a9740b13-ffca-49a1-ab96-c6341cb563a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:44.122899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1287/2534] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:15:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:49.420816 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb07806-c15b-487c-9752-371fdefffd60 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:49.424548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5cb07806-c15b-487c-9752-371fdefffd60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:49.466529 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb07806-c15b-487c-9752-371fdefffd60 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:49.476416 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabba110-3e97-49db-b610-5221cf6f295a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:49.477597 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabba110-3e97-49db-b610-5221cf6f295a service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:49.478114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabba110-3e97-49db-b610-5221cf6f295a service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:49.478680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabba110-3e97-49db-b610-5221cf6f295a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:49.483319 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dabba110-3e97-49db-b610-5221cf6f295a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:49.508626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabba110-3e97-49db-b610-5221cf6f295a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:49.511517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabba110-3e97-49db-b610-5221cf6f295a service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:49.533453 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1248/2535] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:15:54.101339 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:59.524003 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=36 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:16:44.735789 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9740b13-ffca-49a1-ab96-c6341cb563a9 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:44.737447 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a9740b13-ffca-49a1-ab96-c6341cb563a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:44.756047 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9740b13-ffca-49a1-ab96-c6341cb563a9 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:44.761815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6897ed8-17b1-4c49-b731-ae1716dbde1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:44.762520 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6897ed8-17b1-4c49-b731-ae1716dbde1b service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:44.762803 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6897ed8-17b1-4c49-b731-ae1716dbde1b service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:44.763075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6897ed8-17b1-4c49-b731-ae1716dbde1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:44.765192 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e6897ed8-17b1-4c49-b731-ae1716dbde1b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:44.778299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6897ed8-17b1-4c49-b731-ae1716dbde1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:44.779952 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6897ed8-17b1-4c49-b731-ae1716dbde1b service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:44.792021 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1288/2536] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:16:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:16:54.391709 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabba110-3e97-49db-b610-5221cf6f295a service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:54.416046 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabba110-3e97-49db-b610-5221cf6f295a service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:54.437996 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c3332-4803-4783-a7e7-ae169dca7e0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:54.439543 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c3332-4803-4783-a7e7-ae169dca7e0a service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:54.440492 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c3332-4803-4783-a7e7-ae169dca7e0a service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:54.441557 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c3332-4803-4783-a7e7-ae169dca7e0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:54.446596 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0e6c3332-4803-4783-a7e7-ae169dca7e0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:54.474999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c3332-4803-4783-a7e7-ae169dca7e0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:54.478768 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c3332-4803-4783-a7e7-ae169dca7e0a service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:54.506680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1249/2537] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:16:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:16:54.787424 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:04.485760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce980b-f9be-41d1-af0b-707e549c8f77 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:04.487438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce980b-f9be-41d1-af0b-707e549c8f77 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:04.488134 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce980b-f9be-41d1-af0b-707e549c8f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:04.490428 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:04.527465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-69ce980b-f9be-41d1-af0b-707e549c8f77 None None] MFA Rules not processed for user `bca86a340d0547ef8ac6c2a5ec182494`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:04.529832 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-69ce980b-f9be-41d1-af0b-707e549c8f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:04.551323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1289/2538] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:17:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:17:13.621080 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c3332-4803-4783-a7e7-ae169dca7e0a service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:13.622865 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0e6c3332-4803-4783-a7e7-ae169dca7e0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:13.702163 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c3332-4803-4783-a7e7-ae169dca7e0a service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:13.707084 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeafa26-b6c5-413e-b98b-98b3eeb5ba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:13.708069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeafa26-b6c5-413e-b98b-98b3eeb5ba11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:13.708439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeafa26-b6c5-413e-b98b-98b3eeb5ba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:13.709508 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeafa26-b6c5-413e-b98b-98b3eeb5ba11 admin admin] PATH_INFO: `/v3/users/cd6eb735514542e0b1c7484f4f44e295` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:13.710995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeafa26-b6c5-413e-b98b-98b3eeb5ba11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd6eb735514542e0b1c7484f4f44e295)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:13.713092 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeafa26-b6c5-413e-b98b-98b3eeb5ba11 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:13.780328 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ebeafa26-b6c5-413e-b98b-98b3eeb5ba11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd6eb735514542e0b1c7484f4f44e295'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:13.791463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ebeafa26-b6c5-413e-b98b-98b3eeb5ba11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd6eb735514542e0b1c7484f4f44e295'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:13.807697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ebeafa26-b6c5-413e-b98b-98b3eeb5ba11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd6eb735514542e0b1c7484f4f44e295'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:13.809106 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ebeafa26-b6c5-413e-b98b-98b3eeb5ba11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd6eb735514542e0b1c7484f4f44e295'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:13.818108 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ebeafa26-b6c5-413e-b98b-98b3eeb5ba11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd6eb735514542e0b1c7484f4f44e295'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:13.825696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1250/2539] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:17:13 2022] DELETE /identity/v3/users/cd6eb735514542e0b1c7484f4f44e295 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:17:13.832215 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79005d47-6870-45ed-83d5-8ad0d6fa61c1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:13.833214 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79005d47-6870-45ed-83d5-8ad0d6fa61c1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:13.833214 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79005d47-6870-45ed-83d5-8ad0d6fa61c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:13.864578 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-79005d47-6870-45ed-83d5-8ad0d6fa61c1 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:13.865955 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-79005d47-6870-45ed-83d5-8ad0d6fa61c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:13.943435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1290/2540] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:17:13.955642 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeafa26-b6c5-413e-b98b-98b3eeb5ba11 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:13.957259 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ebeafa26-b6c5-413e-b98b-98b3eeb5ba11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:14.026788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeafa26-b6c5-413e-b98b-98b3eeb5ba11 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:14.031226 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ece89-5ab9-40cb-8c47-44f2d22612c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:14.031938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ece89-5ab9-40cb-8c47-44f2d22612c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:14.032225 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ece89-5ab9-40cb-8c47-44f2d22612c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:14.032505 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ece89-5ab9-40cb-8c47-44f2d22612c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:14.043959 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ece89-5ab9-40cb-8c47-44f2d22612c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:14.045866 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ece89-5ab9-40cb-8c47-44f2d22612c7 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:14.057829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1251/2541] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:17:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:17:14.305669 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79005d47-6870-45ed-83d5-8ad0d6fa61c1 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:14.309115 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-79005d47-6870-45ed-83d5-8ad0d6fa61c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:14.346866 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79005d47-6870-45ed-83d5-8ad0d6fa61c1 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:14.355487 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06891326-0729-46fc-9b0a-de33d06f85b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:14.357102 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06891326-0729-46fc-9b0a-de33d06f85b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:14.357550 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06891326-0729-46fc-9b0a-de33d06f85b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:14.358104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06891326-0729-46fc-9b0a-de33d06f85b7 admin admin] PATH_INFO: `/v3/projects/de625bf0c7944e3492adfe75ca4a0ade` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:14.361215 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06891326-0729-46fc-9b0a-de33d06f85b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de625bf0c7944e3492adfe75ca4a0ade)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:14.365910 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06891326-0729-46fc-9b0a-de33d06f85b7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:14.480305 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-06891326-0729-46fc-9b0a-de33d06f85b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de625bf0c7944e3492adfe75ca4a0ade', 'request_id': 'req-06891326-0729-46fc-9b0a-de33d06f85b7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:14.496538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-06891326-0729-46fc-9b0a-de33d06f85b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de625bf0c7944e3492adfe75ca4a0ade', 'request_id': 'req-06891326-0729-46fc-9b0a-de33d06f85b7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:14.508618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-06891326-0729-46fc-9b0a-de33d06f85b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de625bf0c7944e3492adfe75ca4a0ade', 'request_id': 'req-06891326-0729-46fc-9b0a-de33d06f85b7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:14.531811 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-06891326-0729-46fc-9b0a-de33d06f85b7 admin admin] The token cache is being invalidate because project de625bf0c7944e3492adfe75ca4a0ade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:17:14.532292 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-06891326-0729-46fc-9b0a-de33d06f85b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:14.533543 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-06891326-0729-46fc-9b0a-de33d06f85b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:14.536265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1291/2542] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:17:14 2022] DELETE /identity/v3/projects/de625bf0c7944e3492adfe75ca4a0ade => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:17:14.541965 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ece89-5ab9-40cb-8c47-44f2d22612c7 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:14.557070 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ece89-5ab9-40cb-8c47-44f2d22612c7 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:14.590687 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:14.656381 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06f9d5-90dc-4016-a385-a4e7f278bc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:14.657598 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06f9d5-90dc-4016-a385-a4e7f278bc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:14.658009 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06f9d5-90dc-4016-a385-a4e7f278bc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:14.658390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06f9d5-90dc-4016-a385-a4e7f278bc74 admin admin] PATH_INFO: `/v3/users/b834e13b0a7a4269b9a2b1eed9d79c44` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:14.660221 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06f9d5-90dc-4016-a385-a4e7f278bc74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b834e13b0a7a4269b9a2b1eed9d79c44)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:14.662533 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06f9d5-90dc-4016-a385-a4e7f278bc74 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:14.729166 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4f06f9d5-90dc-4016-a385-a4e7f278bc74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b834e13b0a7a4269b9a2b1eed9d79c44'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:14.741300 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4f06f9d5-90dc-4016-a385-a4e7f278bc74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b834e13b0a7a4269b9a2b1eed9d79c44'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:14.772359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4f06f9d5-90dc-4016-a385-a4e7f278bc74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b834e13b0a7a4269b9a2b1eed9d79c44'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:14.773729 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4f06f9d5-90dc-4016-a385-a4e7f278bc74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b834e13b0a7a4269b9a2b1eed9d79c44'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:14.788968 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4f06f9d5-90dc-4016-a385-a4e7f278bc74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b834e13b0a7a4269b9a2b1eed9d79c44'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:14.800217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1252/2543] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:17:14 2022] DELETE /identity/v3/users/b834e13b0a7a4269b9a2b1eed9d79c44 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:17:15.239574 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06891326-0729-46fc-9b0a-de33d06f85b7 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:15.241971 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-06891326-0729-46fc-9b0a-de33d06f85b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:15.257263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06891326-0729-46fc-9b0a-de33d06f85b7 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:15.347938 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620658fa-5880-41d0-b1cb-fa2aa7fd70a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:15.348887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620658fa-5880-41d0-b1cb-fa2aa7fd70a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:15.349171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620658fa-5880-41d0-b1cb-fa2aa7fd70a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:15.349478 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620658fa-5880-41d0-b1cb-fa2aa7fd70a7 admin admin] PATH_INFO: `/v3/projects/c7fefdf15da9497e9bbca4d6577b4927` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:15.350837 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620658fa-5880-41d0-b1cb-fa2aa7fd70a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7fefdf15da9497e9bbca4d6577b4927)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:15.352919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620658fa-5880-41d0-b1cb-fa2aa7fd70a7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:15.378167 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:15.408053 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-620658fa-5880-41d0-b1cb-fa2aa7fd70a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7fefdf15da9497e9bbca4d6577b4927', 'request_id': 'req-620658fa-5880-41d0-b1cb-fa2aa7fd70a7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:15.415464 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-620658fa-5880-41d0-b1cb-fa2aa7fd70a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7fefdf15da9497e9bbca4d6577b4927', 'request_id': 'req-620658fa-5880-41d0-b1cb-fa2aa7fd70a7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:15.422678 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-620658fa-5880-41d0-b1cb-fa2aa7fd70a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7fefdf15da9497e9bbca4d6577b4927', 'request_id': 'req-620658fa-5880-41d0-b1cb-fa2aa7fd70a7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:15.440322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-620658fa-5880-41d0-b1cb-fa2aa7fd70a7 admin admin] The token cache is being invalidate because project c7fefdf15da9497e9bbca4d6577b4927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:17:15.440322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-620658fa-5880-41d0-b1cb-fa2aa7fd70a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:15.440322 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-620658fa-5880-41d0-b1cb-fa2aa7fd70a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:15.442048 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1292/2544] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:17:15 2022] DELETE /identity/v3/projects/c7fefdf15da9497e9bbca4d6577b4927 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:17:24.794057 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=43,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:25.434910 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:55.287046 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06f9d5-90dc-4016-a385-a4e7f278bc74 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:55.290673 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4f06f9d5-90dc-4016-a385-a4e7f278bc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:55.367790 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06f9d5-90dc-4016-a385-a4e7f278bc74 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:55.449515 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f118f-ecc8-4f5d-b8fa-17829442e780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:55.449748 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f118f-ecc8-4f5d-b8fa-17829442e780 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:55.450331 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f118f-ecc8-4f5d-b8fa-17829442e780 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:55.450510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f118f-ecc8-4f5d-b8fa-17829442e780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:55.452929 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-978f118f-ecc8-4f5d-b8fa-17829442e780 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:55.538055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f118f-ecc8-4f5d-b8fa-17829442e780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:55.540664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f118f-ecc8-4f5d-b8fa-17829442e780 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:55.556412 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1253/2545] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:17:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:18:04.310083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620658fa-5880-41d0-b1cb-fa2aa7fd70a7 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:04.312932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-620658fa-5880-41d0-b1cb-fa2aa7fd70a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:04.333980 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620658fa-5880-41d0-b1cb-fa2aa7fd70a7 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:04.339925 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1fdbe-5b80-4cda-a568-7b6982589928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:04.340985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1fdbe-5b80-4cda-a568-7b6982589928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:04.341362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1fdbe-5b80-4cda-a568-7b6982589928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:04.341714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1fdbe-5b80-4cda-a568-7b6982589928 admin admin] PATH_INFO: `/v3/users/c83195bd720846fc8ed75aedd152a505` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:04.343095 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1fdbe-5b80-4cda-a568-7b6982589928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c83195bd720846fc8ed75aedd152a505)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:04.345353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1fdbe-5b80-4cda-a568-7b6982589928 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:04.421320 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f7b1fdbe-5b80-4cda-a568-7b6982589928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c83195bd720846fc8ed75aedd152a505'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:04.436443 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f7b1fdbe-5b80-4cda-a568-7b6982589928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c83195bd720846fc8ed75aedd152a505'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:04.456131 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f7b1fdbe-5b80-4cda-a568-7b6982589928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c83195bd720846fc8ed75aedd152a505'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:04.457302 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f7b1fdbe-5b80-4cda-a568-7b6982589928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c83195bd720846fc8ed75aedd152a505'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:04.458305 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f7b1fdbe-5b80-4cda-a568-7b6982589928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c83195bd720846fc8ed75aedd152a505'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:04.490422 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1293/2546] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:18:04 2022] DELETE /identity/v3/users/c83195bd720846fc8ed75aedd152a505 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:18:04.706037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f118f-ecc8-4f5d-b8fa-17829442e780 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:04.724864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f118f-ecc8-4f5d-b8fa-17829442e780 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:04.799920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e3af2-602c-40a3-a42c-b26faa69297a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:04.800766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e3af2-602c-40a3-a42c-b26faa69297a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:04.801053 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e3af2-602c-40a3-a42c-b26faa69297a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:04.802200 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e3af2-602c-40a3-a42c-b26faa69297a admin admin] PATH_INFO: `/v3/projects/ba0142145c80430c924113fbaae07ba5` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:04.803582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e3af2-602c-40a3-a42c-b26faa69297a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba0142145c80430c924113fbaae07ba5)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:04.805646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e3af2-602c-40a3-a42c-b26faa69297a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:04.816099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:18:04.878174 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a25e3af2-602c-40a3-a42c-b26faa69297a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba0142145c80430c924113fbaae07ba5', 'request_id': 'req-a25e3af2-602c-40a3-a42c-b26faa69297a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:04.888954 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a25e3af2-602c-40a3-a42c-b26faa69297a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba0142145c80430c924113fbaae07ba5', 'request_id': 'req-a25e3af2-602c-40a3-a42c-b26faa69297a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:04.896563 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a25e3af2-602c-40a3-a42c-b26faa69297a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba0142145c80430c924113fbaae07ba5', 'request_id': 'req-a25e3af2-602c-40a3-a42c-b26faa69297a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:04.909840 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a25e3af2-602c-40a3-a42c-b26faa69297a admin admin] The token cache is being invalidate because project ba0142145c80430c924113fbaae07ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:18:04.910133 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a25e3af2-602c-40a3-a42c-b26faa69297a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:04.911081 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a25e3af2-602c-40a3-a42c-b26faa69297a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:04.913214 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1254/2547] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:18:04 2022] DELETE /identity/v3/projects/ba0142145c80430c924113fbaae07ba5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:18:04.920657 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1fdbe-5b80-4cda-a568-7b6982589928 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:04.923521 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f7b1fdbe-5b80-4cda-a568-7b6982589928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:04.942935 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1fdbe-5b80-4cda-a568-7b6982589928 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:05.016414 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e86d3-22e4-4f88-9ec1-7e4b5f8d640e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:05.017382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e86d3-22e4-4f88-9ec1-7e4b5f8d640e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:05.017650 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e86d3-22e4-4f88-9ec1-7e4b5f8d640e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:05.017931 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e86d3-22e4-4f88-9ec1-7e4b5f8d640e admin admin] PATH_INFO: `/v3/users/c8c4e32232174c76b74183ca628b5575` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:05.019316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e86d3-22e4-4f88-9ec1-7e4b5f8d640e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8c4e32232174c76b74183ca628b5575)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:05.021847 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e86d3-22e4-4f88-9ec1-7e4b5f8d640e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:05.083768 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6b9e86d3-22e4-4f88-9ec1-7e4b5f8d640e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8c4e32232174c76b74183ca628b5575'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:05.094139 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6b9e86d3-22e4-4f88-9ec1-7e4b5f8d640e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8c4e32232174c76b74183ca628b5575'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:05.104082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6b9e86d3-22e4-4f88-9ec1-7e4b5f8d640e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8c4e32232174c76b74183ca628b5575'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:05.104957 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6b9e86d3-22e4-4f88-9ec1-7e4b5f8d640e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8c4e32232174c76b74183ca628b5575'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:05.105632 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6b9e86d3-22e4-4f88-9ec1-7e4b5f8d640e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8c4e32232174c76b74183ca628b5575'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:05.116621 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:18:05.132154 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1294/2548] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:18:04 2022] DELETE /identity/v3/users/c8c4e32232174c76b74183ca628b5575 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:18:05.383897 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e3af2-602c-40a3-a42c-b26faa69297a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:05.386085 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a25e3af2-602c-40a3-a42c-b26faa69297a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:05.407668 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e3af2-602c-40a3-a42c-b26faa69297a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:05.484703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e820c-5eb5-4766-924c-95a28378a135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:05.485892 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e820c-5eb5-4766-924c-95a28378a135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:05.486165 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e820c-5eb5-4766-924c-95a28378a135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:05.486439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e820c-5eb5-4766-924c-95a28378a135 admin admin] PATH_INFO: `/v3/projects/11c20ed8b61943f2bf3d814389229e7f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:05.487787 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e820c-5eb5-4766-924c-95a28378a135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11c20ed8b61943f2bf3d814389229e7f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:05.490308 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e820c-5eb5-4766-924c-95a28378a135 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:05.548104 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d09e820c-5eb5-4766-924c-95a28378a135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11c20ed8b61943f2bf3d814389229e7f', 'request_id': 'req-d09e820c-5eb5-4766-924c-95a28378a135'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:05.559285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d09e820c-5eb5-4766-924c-95a28378a135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11c20ed8b61943f2bf3d814389229e7f', 'request_id': 'req-d09e820c-5eb5-4766-924c-95a28378a135'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:05.568922 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d09e820c-5eb5-4766-924c-95a28378a135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11c20ed8b61943f2bf3d814389229e7f', 'request_id': 'req-d09e820c-5eb5-4766-924c-95a28378a135'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:05.583829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d09e820c-5eb5-4766-924c-95a28378a135 admin admin] The token cache is being invalidate because project 11c20ed8b61943f2bf3d814389229e7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:18:05.584288 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d09e820c-5eb5-4766-924c-95a28378a135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:05.585248 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d09e820c-5eb5-4766-924c-95a28378a135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:05.587296 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1255/2549] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:18:05 2022] DELETE /identity/v3/projects/11c20ed8b61943f2bf3d814389229e7f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:18:15.133074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:18:15.579784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=72,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:18:46.826596 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5941647-e3c2-4820-86ed-fb536106cbd8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:46.827268 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5941647-e3c2-4820-86ed-fb536106cbd8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:46.827891 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5941647-e3c2-4820-86ed-fb536106cbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:46.860007 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f5941647-e3c2-4820-86ed-fb536106cbd8 None None] MFA Rules not processed for user `bca86a340d0547ef8ac6c2a5ec182494`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:18:46.862132 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f5941647-e3c2-4820-86ed-fb536106cbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:46.981815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1295/2550] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:18:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:18:47.967732 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e820c-5eb5-4766-924c-95a28378a135 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:47.970414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d09e820c-5eb5-4766-924c-95a28378a135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:48.105597 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e820c-5eb5-4766-924c-95a28378a135 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:48.112564 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a858526-ba2c-455b-8d10-2b5b39727d56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:48.113772 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a858526-ba2c-455b-8d10-2b5b39727d56 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:48.114241 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a858526-ba2c-455b-8d10-2b5b39727d56 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:48.114816 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a858526-ba2c-455b-8d10-2b5b39727d56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:48.117766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8a858526-ba2c-455b-8d10-2b5b39727d56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:48.133774 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a858526-ba2c-455b-8d10-2b5b39727d56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:48.135431 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a858526-ba2c-455b-8d10-2b5b39727d56 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:48.149579 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1256/2551] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:18:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:18:56.741881 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5941647-e3c2-4820-86ed-fb536106cbd8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:56.744270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f5941647-e3c2-4820-86ed-fb536106cbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:56.851946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5941647-e3c2-4820-86ed-fb536106cbd8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:56.861161 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f0513-be5f-43b4-ba7b-05d7cf6c3fad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:56.862287 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f0513-be5f-43b4-ba7b-05d7cf6c3fad service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:56.862756 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f0513-be5f-43b4-ba7b-05d7cf6c3fad service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:56.863465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f0513-be5f-43b4-ba7b-05d7cf6c3fad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:56.873367 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-866f0513-be5f-43b4-ba7b-05d7cf6c3fad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:56.893663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f0513-be5f-43b4-ba7b-05d7cf6c3fad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:56.895791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f0513-be5f-43b4-ba7b-05d7cf6c3fad service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:56.908608 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1296/2552] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:18:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:18:58.091837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a858526-ba2c-455b-8d10-2b5b39727d56 service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:58.107180 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a858526-ba2c-455b-8d10-2b5b39727d56 service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:58.114372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e11ff-1676-43ad-b381-41e2bd0d9e51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:58.115051 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e11ff-1676-43ad-b381-41e2bd0d9e51 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:58.115324 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e11ff-1676-43ad-b381-41e2bd0d9e51 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:58.115594 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e11ff-1676-43ad-b381-41e2bd0d9e51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:58.117761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7f1e11ff-1676-43ad-b381-41e2bd0d9e51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:58.129838 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e11ff-1676-43ad-b381-41e2bd0d9e51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:58.131461 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e11ff-1676-43ad-b381-41e2bd0d9e51 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:58.142077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1257/2553] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:18:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:19:06.903356 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=59 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:08.137138 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=38 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:24.076874 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f0513-be5f-43b4-ba7b-05d7cf6c3fad service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:24.090320 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f0513-be5f-43b4-ba7b-05d7cf6c3fad service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:24.097546 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32763b54-8a2a-43e9-a789-0f7c7772b4b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:24.097858 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32763b54-8a2a-43e9-a789-0f7c7772b4b2 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:24.098031 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32763b54-8a2a-43e9-a789-0f7c7772b4b2 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:24.098330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32763b54-8a2a-43e9-a789-0f7c7772b4b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:24.101314 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-32763b54-8a2a-43e9-a789-0f7c7772b4b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:24.126158 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32763b54-8a2a-43e9-a789-0f7c7772b4b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:24.133662 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32763b54-8a2a-43e9-a789-0f7c7772b4b2 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:24.149818 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1297/2554] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:19:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:19:34.144253 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:20:04.620695 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e11ff-1676-43ad-b381-41e2bd0d9e51 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:04.622502 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7f1e11ff-1676-43ad-b381-41e2bd0d9e51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:04.701986 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e11ff-1676-43ad-b381-41e2bd0d9e51 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:04.706030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e913a1a-f9ad-4710-ab51-796b1692f55c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:04.706702 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e913a1a-f9ad-4710-ab51-796b1692f55c service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:04.706982 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e913a1a-f9ad-4710-ab51-796b1692f55c service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:04.707254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e913a1a-f9ad-4710-ab51-796b1692f55c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:04.709576 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9e913a1a-f9ad-4710-ab51-796b1692f55c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:04.787459 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e913a1a-f9ad-4710-ab51-796b1692f55c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:04.789111 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e913a1a-f9ad-4710-ab51-796b1692f55c service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:04.800553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1258/2555] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:20:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:20:10.488525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32763b54-8a2a-43e9-a789-0f7c7772b4b2 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:10.490369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-32763b54-8a2a-43e9-a789-0f7c7772b4b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:10.518887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32763b54-8a2a-43e9-a789-0f7c7772b4b2 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:10.529588 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99027c-ac89-4fd2-a8bf-6fc5a42d745e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:10.530273 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99027c-ac89-4fd2-a8bf-6fc5a42d745e service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:10.530550 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99027c-ac89-4fd2-a8bf-6fc5a42d745e service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:10.530831 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99027c-ac89-4fd2-a8bf-6fc5a42d745e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:10.533062 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-af99027c-ac89-4fd2-a8bf-6fc5a42d745e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:10.547412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99027c-ac89-4fd2-a8bf-6fc5a42d745e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:10.549140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99027c-ac89-4fd2-a8bf-6fc5a42d745e service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:10.562482 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1298/2556] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:20:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:20:14.795352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=50 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:20:15.403415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60055638-d4df-4c4a-b908-4b41c58349fa None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:15.403757 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60055638-d4df-4c4a-b908-4b41c58349fa None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:15.403975 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60055638-d4df-4c4a-b908-4b41c58349fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:15.425350 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-60055638-d4df-4c4a-b908-4b41c58349fa None None] MFA Rules not processed for user `bca86a340d0547ef8ac6c2a5ec182494`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:15.427292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-60055638-d4df-4c4a-b908-4b41c58349fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:15.436173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1259/2557] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:20:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:15.838421 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99027c-ac89-4fd2-a8bf-6fc5a42d745e service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:15.840508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-af99027c-ac89-4fd2-a8bf-6fc5a42d745e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:15.854701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99027c-ac89-4fd2-a8bf-6fc5a42d745e service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:15.859608 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceee8bf-0fbf-45e0-b056-e4ba07de6014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:15.860340 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceee8bf-0fbf-45e0-b056-e4ba07de6014 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:15.860618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceee8bf-0fbf-45e0-b056-e4ba07de6014 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:15.861112 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceee8bf-0fbf-45e0-b056-e4ba07de6014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:15.863504 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2ceee8bf-0fbf-45e0-b056-e4ba07de6014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:15.875389 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceee8bf-0fbf-45e0-b056-e4ba07de6014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:15.876898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceee8bf-0fbf-45e0-b056-e4ba07de6014 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:15.887152 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1299/2558] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:20:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:20:19.946849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60055638-d4df-4c4a-b908-4b41c58349fa None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:19.965124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60055638-d4df-4c4a-b908-4b41c58349fa None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:19.972257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4844b4a-d624-41df-a823-4ff9b99deabd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:19.973630 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4844b4a-d624-41df-a823-4ff9b99deabd service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:19.974154 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4844b4a-d624-41df-a823-4ff9b99deabd service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:19.974646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4844b4a-d624-41df-a823-4ff9b99deabd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:19.977996 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c4844b4a-d624-41df-a823-4ff9b99deabd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:20.015028 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4844b4a-d624-41df-a823-4ff9b99deabd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:20.018227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4844b4a-d624-41df-a823-4ff9b99deabd service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:20.040452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1260/2559] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:20:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:20:21.308688 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceee8bf-0fbf-45e0-b056-e4ba07de6014 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:21.321357 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceee8bf-0fbf-45e0-b056-e4ba07de6014 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:21.326432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23877072-9ea4-45f1-be6a-331b382e4485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:21.327190 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23877072-9ea4-45f1-be6a-331b382e4485 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:21.327516 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23877072-9ea4-45f1-be6a-331b382e4485 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:21.327824 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23877072-9ea4-45f1-be6a-331b382e4485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:21.330151 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-23877072-9ea4-45f1-be6a-331b382e4485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:21.345821 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23877072-9ea4-45f1-be6a-331b382e4485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:21.347475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23877072-9ea4-45f1-be6a-331b382e4485 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:21.360658 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1300/2560] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:20:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:20:22.181349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4844b4a-d624-41df-a823-4ff9b99deabd service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:22.192321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4844b4a-d624-41df-a823-4ff9b99deabd service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:22.197196 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371df72d-af8b-47d8-9415-915e38e48b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:22.197846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371df72d-af8b-47d8-9415-915e38e48b04 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:22.198125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371df72d-af8b-47d8-9415-915e38e48b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:22.198395 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371df72d-af8b-47d8-9415-915e38e48b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:22.200811 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-371df72d-af8b-47d8-9415-915e38e48b04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:22.214239 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371df72d-af8b-47d8-9415-915e38e48b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:22.216099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371df72d-af8b-47d8-9415-915e38e48b04 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:22.226911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1261/2561] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:20:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:20:31.354485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=18 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:20:32.221954 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=15 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:21:45.709810 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23877072-9ea4-45f1-be6a-331b382e4485 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:45.726196 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23877072-9ea4-45f1-be6a-331b382e4485 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:45.733417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be2275-43a7-422c-b2d1-538a2a0eae66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:45.734523 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be2275-43a7-422c-b2d1-538a2a0eae66 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:45.734951 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be2275-43a7-422c-b2d1-538a2a0eae66 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:45.735314 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be2275-43a7-422c-b2d1-538a2a0eae66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:45.738130 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-88be2275-43a7-422c-b2d1-538a2a0eae66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:45.765919 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be2275-43a7-422c-b2d1-538a2a0eae66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:45.767781 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be2275-43a7-422c-b2d1-538a2a0eae66 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:45.785430 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1301/2562] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:21:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:21:55.776395 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:21:56.114380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371df72d-af8b-47d8-9415-915e38e48b04 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:56.117512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-371df72d-af8b-47d8-9415-915e38e48b04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:56.140271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371df72d-af8b-47d8-9415-915e38e48b04 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:56.148502 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6e351-87fa-4928-94de-4c16c4464c6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:56.150017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6e351-87fa-4928-94de-4c16c4464c6e service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:56.150731 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6e351-87fa-4928-94de-4c16c4464c6e service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:56.151405 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6e351-87fa-4928-94de-4c16c4464c6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:56.155229 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-10e6e351-87fa-4928-94de-4c16c4464c6e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:56.170906 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6e351-87fa-4928-94de-4c16c4464c6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:56.172889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6e351-87fa-4928-94de-4c16c4464c6e service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:56.184653 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1262/2563] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:21:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:22:06.057446 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d146ed6-9444-4abf-966a-2a6027e202c6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:06.058377 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d146ed6-9444-4abf-966a-2a6027e202c6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:06.058377 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d146ed6-9444-4abf-966a-2a6027e202c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:06.083951 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8d146ed6-9444-4abf-966a-2a6027e202c6 None None] MFA Rules not processed for user `bca86a340d0547ef8ac6c2a5ec182494`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:06.085222 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8d146ed6-9444-4abf-966a-2a6027e202c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:06.092569 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1302/2564] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:22:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:06.179744 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:07.004157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c72d16-6cc3-4191-8253-fb2361a017b8 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:07.004500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c72d16-6cc3-4191-8253-fb2361a017b8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:07.004742 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c72d16-6cc3-4191-8253-fb2361a017b8 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:07.006716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1263/2565] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 19 11:22:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 11:22:07.013182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e7c09-9da0-47d3-8f5e-e6a217318b76 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:07.013633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e7c09-9da0-47d3-8f5e-e6a217318b76 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:07.014047 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e7c09-9da0-47d3-8f5e-e6a217318b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:07.084201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ae8e7c09-9da0-47d3-8f5e-e6a217318b76 None None] MFA Rules not processed for user `3c50a821e9ef44cb9fccd49ee4af7dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:07.085468 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ae8e7c09-9da0-47d3-8f5e-e6a217318b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:07.095299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1303/2566] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 11:22:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:07.107194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c72d16-6cc3-4191-8253-fb2361a017b8 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:07.120849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c72d16-6cc3-4191-8253-fb2361a017b8 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:07.125387 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb65b0c-bb2d-4444-846e-41a25057ef44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:07.126190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb65b0c-bb2d-4444-846e-41a25057ef44 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:07.126583 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb65b0c-bb2d-4444-846e-41a25057ef44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:07.126950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb65b0c-bb2d-4444-846e-41a25057ef44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:07.138962 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb65b0c-bb2d-4444-846e-41a25057ef44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:07.140325 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb65b0c-bb2d-4444-846e-41a25057ef44 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:07.152466 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1264/2567] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:22:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:22:17.080685 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=16 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:17.147189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:24.761600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b872410-c836-4171-88b3-17bec0d09482 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:24.762585 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b872410-c836-4171-88b3-17bec0d09482 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:24.762585 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b872410-c836-4171-88b3-17bec0d09482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:24.785305 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1b872410-c836-4171-88b3-17bec0d09482 None None] MFA Rules not processed for user `bca86a340d0547ef8ac6c2a5ec182494`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:24.786455 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1b872410-c836-4171-88b3-17bec0d09482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:24.793894 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1304/2568] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:22:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:25.575278 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52bc21-a92d-407e-b605-c4aa3e9b5aa0 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:25.576834 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52bc21-a92d-407e-b605-c4aa3e9b5aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:25.577378 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52bc21-a92d-407e-b605-c4aa3e9b5aa0 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:25.580055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1265/2569] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 19 11:22:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:22:25.586933 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce0eb0-93b8-4224-b3c2-df59d80d2da3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:25.587278 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce0eb0-93b8-4224-b3c2-df59d80d2da3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:25.587443 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce0eb0-93b8-4224-b3c2-df59d80d2da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:25.608261 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4fce0eb0-93b8-4224-b3c2-df59d80d2da3 None None] MFA Rules not processed for user `3c50a821e9ef44cb9fccd49ee4af7dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:25.609561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4fce0eb0-93b8-4224-b3c2-df59d80d2da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:25.620067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1305/2570] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 11:22:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:25.633546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52bc21-a92d-407e-b605-c4aa3e9b5aa0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:25.658621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52bc21-a92d-407e-b605-c4aa3e9b5aa0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:25.665326 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38701791-614c-4e0b-8e61-95377ce62929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:25.666437 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38701791-614c-4e0b-8e61-95377ce62929 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:25.666940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38701791-614c-4e0b-8e61-95377ce62929 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:25.667400 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38701791-614c-4e0b-8e61-95377ce62929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:25.686844 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38701791-614c-4e0b-8e61-95377ce62929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:25.689708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38701791-614c-4e0b-8e61-95377ce62929 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:25.711274 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1266/2571] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:22:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:22:35.602968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:35.702135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:47.125471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce0eb0-93b8-4224-b3c2-df59d80d2da3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:47.138512 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce0eb0-93b8-4224-b3c2-df59d80d2da3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:47.144880 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb4561-f045-4407-ad06-65fb2cc45221 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:47.146121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb4561-f045-4407-ad06-65fb2cc45221 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:47.146513 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb4561-f045-4407-ad06-65fb2cc45221 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:47.146903 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb4561-f045-4407-ad06-65fb2cc45221 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:47.149396 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-60eb4561-f045-4407-ad06-65fb2cc45221 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:47.164630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb4561-f045-4407-ad06-65fb2cc45221 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:47.166370 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb4561-f045-4407-ad06-65fb2cc45221 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:47.179164 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1306/2572] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:22:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:22:56.086507 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24897620-2fc6-412f-b204-3d4a3a577fec None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:56.087573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24897620-2fc6-412f-b204-3d4a3a577fec None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:56.088117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24897620-2fc6-412f-b204-3d4a3a577fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:56.114063 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-24897620-2fc6-412f-b204-3d4a3a577fec None None] MFA Rules not processed for user `bca86a340d0547ef8ac6c2a5ec182494`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:56.115676 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-24897620-2fc6-412f-b204-3d4a3a577fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:56.124498 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1267/2573] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:22:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:22:57.173063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:06.105795 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:14.276034 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb4561-f045-4407-ad06-65fb2cc45221 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:14.331827 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb4561-f045-4407-ad06-65fb2cc45221 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:14.338836 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af990944-8f7a-417c-909f-0d811cac56c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:14.339838 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af990944-8f7a-417c-909f-0d811cac56c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:14.340285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af990944-8f7a-417c-909f-0d811cac56c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:14.340658 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af990944-8f7a-417c-909f-0d811cac56c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:14.378673 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af990944-8f7a-417c-909f-0d811cac56c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:14.381393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af990944-8f7a-417c-909f-0d811cac56c2 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:14.425563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1307/2574] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:24:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:24:24.421577 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=31 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:24.706176 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24897620-2fc6-412f-b204-3d4a3a577fec None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:24.760509 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24897620-2fc6-412f-b204-3d4a3a577fec None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:24.766627 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585921a1-05d2-4931-9d1b-518c070bac78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:24.767356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585921a1-05d2-4931-9d1b-518c070bac78 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:24.767658 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585921a1-05d2-4931-9d1b-518c070bac78 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:24.767938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585921a1-05d2-4931-9d1b-518c070bac78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:24.778173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585921a1-05d2-4931-9d1b-518c070bac78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:24.779727 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585921a1-05d2-4931-9d1b-518c070bac78 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:24.791755 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1268/2575] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:24:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:24:34.786838 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=21 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:38.690667 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d96599-4210-48a6-9e25-ca14a03ba47e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:38.691363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d96599-4210-48a6-9e25-ca14a03ba47e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:38.691818 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d96599-4210-48a6-9e25-ca14a03ba47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:38.803454 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-87d96599-4210-48a6-9e25-ca14a03ba47e None None] MFA Rules not processed for user `bca86a340d0547ef8ac6c2a5ec182494`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:38.806491 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-87d96599-4210-48a6-9e25-ca14a03ba47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:38.821023 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1308/2576] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:24:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:39.827707 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585921a1-05d2-4931-9d1b-518c070bac78 service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:39.842321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585921a1-05d2-4931-9d1b-518c070bac78 service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:39.849136 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0d6d7-d129-40b3-a1f1-e0b3906b0c01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:39.850251 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0d6d7-d129-40b3-a1f1-e0b3906b0c01 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:39.851177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0d6d7-d129-40b3-a1f1-e0b3906b0c01 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:39.851912 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0d6d7-d129-40b3-a1f1-e0b3906b0c01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:39.875915 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0d6d7-d129-40b3-a1f1-e0b3906b0c01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:39.877792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0d6d7-d129-40b3-a1f1-e0b3906b0c01 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:39.901010 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1269/2577] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:24:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:24:48.795482 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=15 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:49.885272 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:50.612766 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d96599-4210-48a6-9e25-ca14a03ba47e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:50.668898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d96599-4210-48a6-9e25-ca14a03ba47e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:50.675947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ce7b3-ffcc-45e6-826c-63a4147e93d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:50.676849 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ce7b3-ffcc-45e6-826c-63a4147e93d3 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:50.677237 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ce7b3-ffcc-45e6-826c-63a4147e93d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:50.677692 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ce7b3-ffcc-45e6-826c-63a4147e93d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:50.690139 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ce7b3-ffcc-45e6-826c-63a4147e93d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:50.692331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ce7b3-ffcc-45e6-826c-63a4147e93d3 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:50.710004 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1309/2578] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:24:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:25:00.702037 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=13 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:25:30.461091 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0d6d7-d129-40b3-a1f1-e0b3906b0c01 service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:25:30.471784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0d6d7-d129-40b3-a1f1-e0b3906b0c01 service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:25:30.475870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125051da-6b36-41a1-bd41-c763d9a10fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:25:30.476538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125051da-6b36-41a1-bd41-c763d9a10fca service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:30.476837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125051da-6b36-41a1-bd41-c763d9a10fca service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:30.477118 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125051da-6b36-41a1-bd41-c763d9a10fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:30.486101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125051da-6b36-41a1-bd41-c763d9a10fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:25:30.487581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125051da-6b36-41a1-bd41-c763d9a10fca service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:25:30.499614 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1270/2579] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:25:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:25:40.492920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:28:07.345317 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ce7b3-ffcc-45e6-826c-63a4147e93d3 service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:07.368108 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ce7b3-ffcc-45e6-826c-63a4147e93d3 service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:07.376622 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d32133-1383-45b5-a5bf-ed9da7e3391f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:07.377823 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d32133-1383-45b5-a5bf-ed9da7e3391f service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:07.378299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d32133-1383-45b5-a5bf-ed9da7e3391f service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:07.378958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d32133-1383-45b5-a5bf-ed9da7e3391f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:07.391122 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d32133-1383-45b5-a5bf-ed9da7e3391f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:07.393676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d32133-1383-45b5-a5bf-ed9da7e3391f service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:07.410344 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1310/2580] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:28:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:28:07.613475 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125051da-6b36-41a1-bd41-c763d9a10fca service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:07.622950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125051da-6b36-41a1-bd41-c763d9a10fca service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:07.627731 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403fff8-2c9a-4281-b7d9-67b154bcb777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:07.628512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403fff8-2c9a-4281-b7d9-67b154bcb777 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:07.628893 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403fff8-2c9a-4281-b7d9-67b154bcb777 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:07.629271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403fff8-2c9a-4281-b7d9-67b154bcb777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:07.641447 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403fff8-2c9a-4281-b7d9-67b154bcb777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:07.643186 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403fff8-2c9a-4281-b7d9-67b154bcb777 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:07.655879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1271/2581] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:28:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:28:08.894549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d32133-1383-45b5-a5bf-ed9da7e3391f service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:08.906166 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d32133-1383-45b5-a5bf-ed9da7e3391f service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:08.910927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414456d-30f9-44cd-9fef-f35930a1f779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:08.911618 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414456d-30f9-44cd-9fef-f35930a1f779 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:08.911896 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414456d-30f9-44cd-9fef-f35930a1f779 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:08.912165 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414456d-30f9-44cd-9fef-f35930a1f779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:08.925607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414456d-30f9-44cd-9fef-f35930a1f779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:08.927127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414456d-30f9-44cd-9fef-f35930a1f779 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:08.941105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1311/2582] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:28:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:28:10.195212 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403fff8-2c9a-4281-b7d9-67b154bcb777 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:10.212087 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403fff8-2c9a-4281-b7d9-67b154bcb777 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:10.219139 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba79f73-11ad-48c5-aaa5-2386a8b01a67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:10.220680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba79f73-11ad-48c5-aaa5-2386a8b01a67 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:10.221279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba79f73-11ad-48c5-aaa5-2386a8b01a67 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:10.221872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba79f73-11ad-48c5-aaa5-2386a8b01a67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:10.242537 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba79f73-11ad-48c5-aaa5-2386a8b01a67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:10.245704 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba79f73-11ad-48c5-aaa5-2386a8b01a67 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:10.260737 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1272/2583] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:28:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:28:15.130623 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414456d-30f9-44cd-9fef-f35930a1f779 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:15.148708 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414456d-30f9-44cd-9fef-f35930a1f779 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:15.155204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ef83a-d36a-4372-9e5f-97b02364d0bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:15.156030 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ef83a-d36a-4372-9e5f-97b02364d0bf service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:15.156377 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ef83a-d36a-4372-9e5f-97b02364d0bf service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:15.156805 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ef83a-d36a-4372-9e5f-97b02364d0bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:15.167895 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ef83a-d36a-4372-9e5f-97b02364d0bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:15.169606 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ef83a-d36a-4372-9e5f-97b02364d0bf service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:15.181447 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1312/2584] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:28:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:28:17.350433 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba79f73-11ad-48c5-aaa5-2386a8b01a67 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:17.363900 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba79f73-11ad-48c5-aaa5-2386a8b01a67 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:17.368889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383b6f0-a159-42fe-879b-7c3e56af98c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:17.370263 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383b6f0-a159-42fe-879b-7c3e56af98c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:17.370667 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383b6f0-a159-42fe-879b-7c3e56af98c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:17.371086 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383b6f0-a159-42fe-879b-7c3e56af98c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:17.385127 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383b6f0-a159-42fe-879b-7c3e56af98c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:17.388014 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383b6f0-a159-42fe-879b-7c3e56af98c6 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:17.440760 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1273/2585] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:28:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:28:24.010791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd6fd8-d161-4941-a000-a796d8aff390 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:24.011631 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd6fd8-d161-4941-a000-a796d8aff390 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:24.011631 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd6fd8-d161-4941-a000-a796d8aff390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:24.031856 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-affd6fd8-d161-4941-a000-a796d8aff390 None None] MFA Rules not processed for user `bca86a340d0547ef8ac6c2a5ec182494`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:28:24.033343 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-affd6fd8-d161-4941-a000-a796d8aff390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:24.041905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1313/2586] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:28:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:28:24.424454 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383b6f0-a159-42fe-879b-7c3e56af98c6 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:24.434230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383b6f0-a159-42fe-879b-7c3e56af98c6 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:24.438735 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2325338-bf4e-49d9-b883-19df36d4e238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:24.439408 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2325338-bf4e-49d9-b883-19df36d4e238 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:24.439854 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2325338-bf4e-49d9-b883-19df36d4e238 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:24.440326 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2325338-bf4e-49d9-b883-19df36d4e238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:24.449558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2325338-bf4e-49d9-b883-19df36d4e238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:24.451078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2325338-bf4e-49d9-b883-19df36d4e238 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:24.461162 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1274/2587] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:28:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:28:34.025720 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=21 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:28:34.456361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=31 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:28:45.888990 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80295ff9-e6d1-4781-91d6-80635310f2eb None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:45.889505 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80295ff9-e6d1-4781-91d6-80635310f2eb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:45.889803 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80295ff9-e6d1-4781-91d6-80635310f2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:45.909883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-80295ff9-e6d1-4781-91d6-80635310f2eb None None] MFA Rules not processed for user `bca86a340d0547ef8ac6c2a5ec182494`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:28:45.911184 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-80295ff9-e6d1-4781-91d6-80635310f2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:45.918787 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1314/2588] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:28:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:28:55.903682 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:36.094182 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2325338-bf4e-49d9-b883-19df36d4e238 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:36.096751 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c2325338-bf4e-49d9-b883-19df36d4e238 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:36.237556 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2325338-bf4e-49d9-b883-19df36d4e238 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:36.243951 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52f9d0-70c7-4781-ba58-e2794ac3a20b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:36.244634 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52f9d0-70c7-4781-ba58-e2794ac3a20b service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:36.244957 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52f9d0-70c7-4781-ba58-e2794ac3a20b service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:36.245225 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52f9d0-70c7-4781-ba58-e2794ac3a20b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:36.247361 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5a52f9d0-70c7-4781-ba58-e2794ac3a20b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:36.260682 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52f9d0-70c7-4781-ba58-e2794ac3a20b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:36.262374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52f9d0-70c7-4781-ba58-e2794ac3a20b service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:36.273913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1275/2589] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:29:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:29:46.268992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=37 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:07.628596 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80295ff9-e6d1-4781-91d6-80635310f2eb None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:07.631406 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-80295ff9-e6d1-4781-91d6-80635310f2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:07.761787 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80295ff9-e6d1-4781-91d6-80635310f2eb None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:07.766218 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023a100-d469-41bd-9220-7701fd908308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:07.766907 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023a100-d469-41bd-9220-7701fd908308 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:07.767184 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023a100-d469-41bd-9220-7701fd908308 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:07.767455 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023a100-d469-41bd-9220-7701fd908308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:07.769699 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f023a100-d469-41bd-9220-7701fd908308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:07.842186 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023a100-d469-41bd-9220-7701fd908308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:07.843940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023a100-d469-41bd-9220-7701fd908308 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:07.855261 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1315/2590] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:30:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:30:17.850468 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=53 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:38.806909 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af035b-2755-486e-9b49-9de70e0f5769 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:38.807798 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af035b-2755-486e-9b49-9de70e0f5769 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:38.808218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af035b-2755-486e-9b49-9de70e0f5769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:38.844878 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-95af035b-2755-486e-9b49-9de70e0f5769 None None] MFA Rules not processed for user `bca86a340d0547ef8ac6c2a5ec182494`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:38.847036 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-95af035b-2755-486e-9b49-9de70e0f5769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:38.874733 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1276/2591] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:30:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:39.970223 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023a100-d469-41bd-9220-7701fd908308 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:39.998072 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023a100-d469-41bd-9220-7701fd908308 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:40.011631 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8d7a4-5331-4871-8d08-d6c5a2515727 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:40.013249 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8d7a4-5331-4871-8d08-d6c5a2515727 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:40.013973 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8d7a4-5331-4871-8d08-d6c5a2515727 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:40.014673 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8d7a4-5331-4871-8d08-d6c5a2515727 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:40.018543 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-60d8d7a4-5331-4871-8d08-d6c5a2515727 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:40.043461 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8d7a4-5331-4871-8d08-d6c5a2515727 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:40.045719 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8d7a4-5331-4871-8d08-d6c5a2515727 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:40.059879 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1316/2592] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:30:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:30:42.626881 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af035b-2755-486e-9b49-9de70e0f5769 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:42.646205 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af035b-2755-486e-9b49-9de70e0f5769 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:42.652372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a4ae1-9b5d-4128-b9fa-778beabcee80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:42.653514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a4ae1-9b5d-4128-b9fa-778beabcee80 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:42.653981 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a4ae1-9b5d-4128-b9fa-778beabcee80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:42.654449 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a4ae1-9b5d-4128-b9fa-778beabcee80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:42.657613 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-aa9a4ae1-9b5d-4128-b9fa-778beabcee80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:42.675278 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a4ae1-9b5d-4128-b9fa-778beabcee80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:42.678491 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a4ae1-9b5d-4128-b9fa-778beabcee80 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:42.694483 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1277/2593] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:30:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:30:50.054490 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:50.511981 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8d7a4-5331-4871-8d08-d6c5a2515727 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:50.514082 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-60d8d7a4-5331-4871-8d08-d6c5a2515727 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:50.627999 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8d7a4-5331-4871-8d08-d6c5a2515727 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:50.635416 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b37952-9533-4019-803a-076f87254fb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:50.636166 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b37952-9533-4019-803a-076f87254fb5 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:50.636433 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b37952-9533-4019-803a-076f87254fb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:50.636743 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b37952-9533-4019-803a-076f87254fb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:50.639865 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a0b37952-9533-4019-803a-076f87254fb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:50.661505 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b37952-9533-4019-803a-076f87254fb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:50.664554 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b37952-9533-4019-803a-076f87254fb5 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:50.682049 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1317/2594] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:30:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:30:52.686667 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=9 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:00.676604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=39 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:12.971023 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a4ae1-9b5d-4128-b9fa-778beabcee80 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:12.985479 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a4ae1-9b5d-4128-b9fa-778beabcee80 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:12.991941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25833176-9107-47dd-91d0-f8119974251d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:12.993058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25833176-9107-47dd-91d0-f8119974251d service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:12.993421 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25833176-9107-47dd-91d0-f8119974251d service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:12.993756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25833176-9107-47dd-91d0-f8119974251d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:12.996276 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-25833176-9107-47dd-91d0-f8119974251d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:13.011965 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25833176-9107-47dd-91d0-f8119974251d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:13.014030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25833176-9107-47dd-91d0-f8119974251d service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:13.027317 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1278/2595] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:32:13.085884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b37952-9533-4019-803a-076f87254fb5 service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:13.089040 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a0b37952-9533-4019-803a-076f87254fb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:13.278872 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b37952-9533-4019-803a-076f87254fb5 service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:13.283864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6d530-9caa-4e88-b995-4d716c846c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:13.284843 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6d530-9caa-4e88-b995-4d716c846c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:13.285144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6d530-9caa-4e88-b995-4d716c846c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:13.285420 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6d530-9caa-4e88-b995-4d716c846c27 admin admin] PATH_INFO: `/v3/users/bca86a340d0547ef8ac6c2a5ec182494` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:13.288620 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6d530-9caa-4e88-b995-4d716c846c27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bca86a340d0547ef8ac6c2a5ec182494)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:13.290696 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6d530-9caa-4e88-b995-4d716c846c27 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:13.351563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b9e6d530-9caa-4e88-b995-4d716c846c27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bca86a340d0547ef8ac6c2a5ec182494'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:13.361613 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b9e6d530-9caa-4e88-b995-4d716c846c27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bca86a340d0547ef8ac6c2a5ec182494'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:13.372009 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b9e6d530-9caa-4e88-b995-4d716c846c27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bca86a340d0547ef8ac6c2a5ec182494'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:13.373070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b9e6d530-9caa-4e88-b995-4d716c846c27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bca86a340d0547ef8ac6c2a5ec182494'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:13.374263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b9e6d530-9caa-4e88-b995-4d716c846c27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bca86a340d0547ef8ac6c2a5ec182494'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:13.400377 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1318/2596] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:32:13 2022] DELETE /identity/v3/users/bca86a340d0547ef8ac6c2a5ec182494 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:32:13.405607 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3bc73-9c3c-4d89-8c5c-a53bbe29c5b7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:13.406024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3bc73-9c3c-4d89-8c5c-a53bbe29c5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:13.406394 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3bc73-9c3c-4d89-8c5c-a53bbe29c5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:13.437336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5ec3bc73-9c3c-4d89-8c5c-a53bbe29c5b7 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:13.438673 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5ec3bc73-9c3c-4d89-8c5c-a53bbe29c5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:13.510264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1279/2597] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:13.521231 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6d530-9caa-4e88-b995-4d716c846c27 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:13.522761 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b9e6d530-9caa-4e88-b995-4d716c846c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:13.595510 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6d530-9caa-4e88-b995-4d716c846c27 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:13.599631 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b0c71-fdaa-48d6-9f30-90ecac58ad4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:13.600340 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b0c71-fdaa-48d6-9f30-90ecac58ad4e service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:13.600657 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b0c71-fdaa-48d6-9f30-90ecac58ad4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:13.600980 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b0c71-fdaa-48d6-9f30-90ecac58ad4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:13.608047 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:13.613066 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b0c71-fdaa-48d6-9f30-90ecac58ad4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:13.615228 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b0c71-fdaa-48d6-9f30-90ecac58ad4e service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:13.628892 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1319/2598] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:32:13.904991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3bc73-9c3c-4d89-8c5c-a53bbe29c5b7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:13.906501 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5ec3bc73-9c3c-4d89-8c5c-a53bbe29c5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:13.920258 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3bc73-9c3c-4d89-8c5c-a53bbe29c5b7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:13.931194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b782622-8fc8-4253-9500-e1c675995e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:13.932278 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b782622-8fc8-4253-9500-e1c675995e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:13.932648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b782622-8fc8-4253-9500-e1c675995e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:13.933056 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b782622-8fc8-4253-9500-e1c675995e08 admin admin] PATH_INFO: `/v3/projects/23eb8e40b45c450f9b52f737140f8ee8` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:13.935186 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b782622-8fc8-4253-9500-e1c675995e08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23eb8e40b45c450f9b52f737140f8ee8)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:13.937794 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b782622-8fc8-4253-9500-e1c675995e08 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:14.003980 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7b782622-8fc8-4253-9500-e1c675995e08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23eb8e40b45c450f9b52f737140f8ee8', 'request_id': 'req-7b782622-8fc8-4253-9500-e1c675995e08'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:14.015439 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7b782622-8fc8-4253-9500-e1c675995e08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23eb8e40b45c450f9b52f737140f8ee8', 'request_id': 'req-7b782622-8fc8-4253-9500-e1c675995e08'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:14.023153 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7b782622-8fc8-4253-9500-e1c675995e08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23eb8e40b45c450f9b52f737140f8ee8', 'request_id': 'req-7b782622-8fc8-4253-9500-e1c675995e08'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:14.037094 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7b782622-8fc8-4253-9500-e1c675995e08 admin admin] The token cache is being invalidate because project 23eb8e40b45c450f9b52f737140f8ee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:32:14.037741 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7b782622-8fc8-4253-9500-e1c675995e08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:14.038178 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7b782622-8fc8-4253-9500-e1c675995e08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:14.039898 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1280/2599] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:32:13 2022] DELETE /identity/v3/projects/23eb8e40b45c450f9b52f737140f8ee8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:14.044628 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b0c71-fdaa-48d6-9f30-90ecac58ad4e service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:14.056417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b0c71-fdaa-48d6-9f30-90ecac58ad4e service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:14.133167 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54af95-c212-4be9-8c95-2537ec6cb54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:14.134632 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54af95-c212-4be9-8c95-2537ec6cb54a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:14.135096 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54af95-c212-4be9-8c95-2537ec6cb54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:14.135492 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54af95-c212-4be9-8c95-2537ec6cb54a admin admin] PATH_INFO: `/v3/users/213a0881985f4fc1bb474e020929870a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:14.164459 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54af95-c212-4be9-8c95-2537ec6cb54a admin admin] RBAC: Authorizing `identity:delete_user(user_id=213a0881985f4fc1bb474e020929870a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:14.168074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54af95-c212-4be9-8c95-2537ec6cb54a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:14.244385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4c54af95-c212-4be9-8c95-2537ec6cb54a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '213a0881985f4fc1bb474e020929870a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:14.256522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4c54af95-c212-4be9-8c95-2537ec6cb54a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '213a0881985f4fc1bb474e020929870a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:14.267053 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4c54af95-c212-4be9-8c95-2537ec6cb54a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '213a0881985f4fc1bb474e020929870a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:14.267939 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4c54af95-c212-4be9-8c95-2537ec6cb54a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '213a0881985f4fc1bb474e020929870a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:14.268656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4c54af95-c212-4be9-8c95-2537ec6cb54a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '213a0881985f4fc1bb474e020929870a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:14.291986 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1320/2600] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:32:14 2022] DELETE /identity/v3/users/213a0881985f4fc1bb474e020929870a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:14.678121 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b782622-8fc8-4253-9500-e1c675995e08 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:14.679699 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7b782622-8fc8-4253-9500-e1c675995e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:14.698569 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b782622-8fc8-4253-9500-e1c675995e08 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:14.772761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab69b44-f772-4325-8809-1eb7195299fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:14.773756 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab69b44-f772-4325-8809-1eb7195299fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:14.773995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab69b44-f772-4325-8809-1eb7195299fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:14.774240 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab69b44-f772-4325-8809-1eb7195299fc admin admin] PATH_INFO: `/v3/projects/4c5756a9fb974d32934527de149d16de` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:14.775700 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab69b44-f772-4325-8809-1eb7195299fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c5756a9fb974d32934527de149d16de)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:14.777727 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab69b44-f772-4325-8809-1eb7195299fc admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:14.785446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:14.838203 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bab69b44-f772-4325-8809-1eb7195299fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c5756a9fb974d32934527de149d16de', 'request_id': 'req-bab69b44-f772-4325-8809-1eb7195299fc'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:14.847956 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bab69b44-f772-4325-8809-1eb7195299fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c5756a9fb974d32934527de149d16de', 'request_id': 'req-bab69b44-f772-4325-8809-1eb7195299fc'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:14.856129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bab69b44-f772-4325-8809-1eb7195299fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c5756a9fb974d32934527de149d16de', 'request_id': 'req-bab69b44-f772-4325-8809-1eb7195299fc'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:14.870538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bab69b44-f772-4325-8809-1eb7195299fc admin admin] The token cache is being invalidate because project 4c5756a9fb974d32934527de149d16de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:32:14.870902 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bab69b44-f772-4325-8809-1eb7195299fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:14.871689 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bab69b44-f772-4325-8809-1eb7195299fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:14.873438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1281/2601] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:32:14 2022] DELETE /identity/v3/projects/4c5756a9fb974d32934527de149d16de => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:21.788638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995769f-4798-4d57-80ff-ddfd6fb9553e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:21.789575 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995769f-4798-4d57-80ff-ddfd6fb9553e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:21.789575 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995769f-4798-4d57-80ff-ddfd6fb9553e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:21.850393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c995769f-4798-4d57-80ff-ddfd6fb9553e None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:21.851668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c995769f-4798-4d57-80ff-ddfd6fb9553e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:21.893462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:21.935486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1321/2602] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:21.947015 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf07fd-43c3-4a77-bf8a-1810268f0a56 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:21.947815 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf07fd-43c3-4a77-bf8a-1810268f0a56 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:21.947815 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf07fd-43c3-4a77-bf8a-1810268f0a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:21.968974 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-64cf07fd-43c3-4a77-bf8a-1810268f0a56 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:21.970377 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-64cf07fd-43c3-4a77-bf8a-1810268f0a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:21.979826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1282/2603] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:21.985209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995769f-4798-4d57-80ff-ddfd6fb9553e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:21.995833 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995769f-4798-4d57-80ff-ddfd6fb9553e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:22.001351 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c41eb-66e8-4b9c-b228-77ffa2012d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:22.002047 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c41eb-66e8-4b9c-b228-77ffa2012d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:22.002326 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c41eb-66e8-4b9c-b228-77ffa2012d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:22.002598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c41eb-66e8-4b9c-b228-77ffa2012d77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:22.003698 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c41eb-66e8-4b9c-b228-77ffa2012d77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:32:22.004001 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c41eb-66e8-4b9c-b228-77ffa2012d77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:22.005802 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c41eb-66e8-4b9c-b228-77ffa2012d77 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:22.023745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1322/2604] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:32:22.037849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf07fd-43c3-4a77-bf8a-1810268f0a56 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:22.053628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf07fd-43c3-4a77-bf8a-1810268f0a56 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:22.059016 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc6756-5957-41f9-b456-01e0acdafb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:22.059734 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc6756-5957-41f9-b456-01e0acdafb3b admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:22.060017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc6756-5957-41f9-b456-01e0acdafb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:22.060291 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc6756-5957-41f9-b456-01e0acdafb3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:22.061057 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc6756-5957-41f9-b456-01e0acdafb3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:22.063044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc6756-5957-41f9-b456-01e0acdafb3b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:22.110996 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1283/2605] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:32:22 2022] POST /identity/v3/projects => generated 391 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:22.112520 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c41eb-66e8-4b9c-b228-77ffa2012d77 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:22.123881 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c41eb-66e8-4b9c-b228-77ffa2012d77 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:22.217940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2b3b0-903d-477f-a56a-0dd3107dfcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:22.218678 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2b3b0-903d-477f-a56a-0dd3107dfcc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:22.218958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2b3b0-903d-477f-a56a-0dd3107dfcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:22.219239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2b3b0-903d-477f-a56a-0dd3107dfcc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:22.219925 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2b3b0-903d-477f-a56a-0dd3107dfcc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:22.221929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2b3b0-903d-477f-a56a-0dd3107dfcc5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:22.246609 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1323/2606] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:32:22 2022] POST /identity/v3/users => generated 296 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:22.251681 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc6756-5957-41f9-b456-01e0acdafb3b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:22.264788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc6756-5957-41f9-b456-01e0acdafb3b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:22.270896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc91ac0-a86a-46ee-8a5a-ef317f0dd8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:22.271651 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91ac0-a86a-46ee-8a5a-ef317f0dd8af admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:22.272041 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91ac0-a86a-46ee-8a5a-ef317f0dd8af admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:22.272416 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91ac0-a86a-46ee-8a5a-ef317f0dd8af admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:22.273402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc91ac0-a86a-46ee-8a5a-ef317f0dd8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:22.275257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc91ac0-a86a-46ee-8a5a-ef317f0dd8af admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:22.287125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1284/2607] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:22.293907 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2b3b0-903d-477f-a56a-0dd3107dfcc5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:22.305866 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2b3b0-903d-477f-a56a-0dd3107dfcc5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:22.311251 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef157afd-874b-4fa0-af81-9e52d7594455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:22.311960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef157afd-874b-4fa0-af81-9e52d7594455 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:22.312249 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef157afd-874b-4fa0-af81-9e52d7594455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:22.312540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef157afd-874b-4fa0-af81-9e52d7594455 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:22.313343 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef157afd-874b-4fa0-af81-9e52d7594455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:22.315013 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef157afd-874b-4fa0-af81-9e52d7594455 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:22.327632 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1324/2608] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:22.332614 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc91ac0-a86a-46ee-8a5a-ef317f0dd8af admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:22.343636 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc91ac0-a86a-46ee-8a5a-ef317f0dd8af admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:22.348582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b714b38-aa08-4e56-92ca-65a48e481d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:22.349536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b714b38-aa08-4e56-92ca-65a48e481d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:22.349834 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b714b38-aa08-4e56-92ca-65a48e481d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:22.350108 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b714b38-aa08-4e56-92ca-65a48e481d2c admin admin] PATH_INFO: `/v3/projects/680092222251444fa6c5c98a97257d45/users/aa2df02e3ee14d85975f1240302b23c7/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:22.367234 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b714b38-aa08-4e56-92ca-65a48e481d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=680092222251444fa6c5c98a97257d45, user_id=aa2df02e3ee14d85975f1240302b23c7, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:22.369992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b714b38-aa08-4e56-92ca-65a48e481d2c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:22.389058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1285/2609] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:32:22 2022] PUT /identity/v3/projects/680092222251444fa6c5c98a97257d45/users/aa2df02e3ee14d85975f1240302b23c7/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:22.403349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2369fc4-8422-4f99-99f9-0c86407667c7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:22.403674 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2369fc4-8422-4f99-99f9-0c86407667c7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:22.404026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2369fc4-8422-4f99-99f9-0c86407667c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:22.436615 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a2369fc4-8422-4f99-99f9-0c86407667c7 None None] MFA Rules not processed for user `aa2df02e3ee14d85975f1240302b23c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:22.437933 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a2369fc4-8422-4f99-99f9-0c86407667c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:22.512218 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1325/2610] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:32:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:22.517305 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b714b38-aa08-4e56-92ca-65a48e481d2c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:22.588664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b714b38-aa08-4e56-92ca-65a48e481d2c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:22.594052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ed517-4191-499e-8a02-aba7fea0ecbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:22.594915 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ed517-4191-499e-8a02-aba7fea0ecbc admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:22.595198 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ed517-4191-499e-8a02-aba7fea0ecbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:22.595478 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ed517-4191-499e-8a02-aba7fea0ecbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:22.596192 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ed517-4191-499e-8a02-aba7fea0ecbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:22.598198 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ed517-4191-499e-8a02-aba7fea0ecbc admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:22.630681 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1286/2611] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:32:22 2022] POST /identity/v3/projects => generated 393 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:22.635254 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2369fc4-8422-4f99-99f9-0c86407667c7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:22.647087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2369fc4-8422-4f99-99f9-0c86407667c7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:22.683036 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:22.716616 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefc5a4-b5b3-42f6-a7c1-3ec8bf64d3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:22.717353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefc5a4-b5b3-42f6-a7c1-3ec8bf64d3c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:22.717635 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefc5a4-b5b3-42f6-a7c1-3ec8bf64d3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:22.717908 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefc5a4-b5b3-42f6-a7c1-3ec8bf64d3c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:22.718608 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefc5a4-b5b3-42f6-a7c1-3ec8bf64d3c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:22.720753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefc5a4-b5b3-42f6-a7c1-3ec8bf64d3c7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:22.743663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1326/2612] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:32:22 2022] POST /identity/v3/users => generated 303 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:22.748105 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ed517-4191-499e-8a02-aba7fea0ecbc admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:22.760586 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ed517-4191-499e-8a02-aba7fea0ecbc admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:22.765856 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bafc3a-c058-48c9-9783-7419d7e28dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:22.766775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bafc3a-c058-48c9-9783-7419d7e28dbf admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:22.767063 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bafc3a-c058-48c9-9783-7419d7e28dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:22.767336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bafc3a-c058-48c9-9783-7419d7e28dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:22.768085 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bafc3a-c058-48c9-9783-7419d7e28dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:22.769781 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bafc3a-c058-48c9-9783-7419d7e28dbf admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:22.771415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:22.784132 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1287/2613] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:22.788943 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefc5a4-b5b3-42f6-a7c1-3ec8bf64d3c7 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:22.800253 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefc5a4-b5b3-42f6-a7c1-3ec8bf64d3c7 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:22.805261 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e71d6-2e3f-4de8-993c-0aaed1aa6629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:22.806179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e71d6-2e3f-4de8-993c-0aaed1aa6629 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:22.806453 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e71d6-2e3f-4de8-993c-0aaed1aa6629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:22.806782 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e71d6-2e3f-4de8-993c-0aaed1aa6629 admin admin] PATH_INFO: `/v3/projects/8984b5232c454521a100315363aabb82/users/c2b96e9fccc940caaa67d9152b531caa/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:22.824891 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e71d6-2e3f-4de8-993c-0aaed1aa6629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8984b5232c454521a100315363aabb82, user_id=c2b96e9fccc940caaa67d9152b531caa, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:22.827577 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e71d6-2e3f-4de8-993c-0aaed1aa6629 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:22.843316 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1327/2614] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:32:22 2022] PUT /identity/v3/projects/8984b5232c454521a100315363aabb82/users/c2b96e9fccc940caaa67d9152b531caa/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:22.847413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bafc3a-c058-48c9-9783-7419d7e28dbf admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:22.858237 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bafc3a-c058-48c9-9783-7419d7e28dbf admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:22.923785 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e510b3-7dce-4ecb-9e78-29e220dea9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:22.924479 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e510b3-7dce-4ecb-9e78-29e220dea9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:22.924786 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e510b3-7dce-4ecb-9e78-29e220dea9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:22.925072 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e510b3-7dce-4ecb-9e78-29e220dea9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:22.925809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e510b3-7dce-4ecb-9e78-29e220dea9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:22.927462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e510b3-7dce-4ecb-9e78-29e220dea9f7 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:22.938967 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1288/2615] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:32:22.943823 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e71d6-2e3f-4de8-993c-0aaed1aa6629 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:22.955508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e71d6-2e3f-4de8-993c-0aaed1aa6629 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:22.961796 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c6405-0db3-4caf-bedc-3024d13c5b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:22.962839 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c6405-0db3-4caf-bedc-3024d13c5b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:22.963162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c6405-0db3-4caf-bedc-3024d13c5b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:22.963544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c6405-0db3-4caf-bedc-3024d13c5b7e admin admin] PATH_INFO: `/v3/projects/8984b5232c454521a100315363aabb82/users/c2b96e9fccc940caaa67d9152b531caa/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:22.966291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c6405-0db3-4caf-bedc-3024d13c5b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8984b5232c454521a100315363aabb82, user_id=c2b96e9fccc940caaa67d9152b531caa, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:22.969239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c6405-0db3-4caf-bedc-3024d13c5b7e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:22.982009 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1328/2616] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:32:22 2022] PUT /identity/v3/projects/8984b5232c454521a100315363aabb82/users/c2b96e9fccc940caaa67d9152b531caa/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:22.993452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28988293-caf6-4a3b-8032-600a60760b38 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:22.994038 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28988293-caf6-4a3b-8032-600a60760b38 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:22.994331 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28988293-caf6-4a3b-8032-600a60760b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:23.041362 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-28988293-caf6-4a3b-8032-600a60760b38 None None] MFA Rules not processed for user `c2b96e9fccc940caaa67d9152b531caa`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:23.043516 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-28988293-caf6-4a3b-8032-600a60760b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:23.147251 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1289/2617] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:32:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:23.160757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecf1bd-dec6-42d9-99d7-d70dbf28ec60 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:23.161099 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecf1bd-dec6-42d9-99d7-d70dbf28ec60 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:23.161458 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecf1bd-dec6-42d9-99d7-d70dbf28ec60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:23.182009 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a7ecf1bd-dec6-42d9-99d7-d70dbf28ec60 None None] MFA Rules not processed for user `aa2df02e3ee14d85975f1240302b23c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:23.183284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a7ecf1bd-dec6-42d9-99d7-d70dbf28ec60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:23.247577 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1329/2618] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:32:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:23.263075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28988293-caf6-4a3b-8032-600a60760b38 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:23.265003 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-28988293-caf6-4a3b-8032-600a60760b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:23.347648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28988293-caf6-4a3b-8032-600a60760b38 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:23.354257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17092132-8d60-4088-be2a-916f11ad2bde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:23.354988 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17092132-8d60-4088-be2a-916f11ad2bde service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:23.355319 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17092132-8d60-4088-be2a-916f11ad2bde service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:23.355746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17092132-8d60-4088-be2a-916f11ad2bde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:23.365586 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17092132-8d60-4088-be2a-916f11ad2bde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:23.367490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17092132-8d60-4088-be2a-916f11ad2bde service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:23.378888 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1290/2619] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:32:33.239853 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=54,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:33.373442 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:35.163626 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecf1bd-dec6-42d9-99d7-d70dbf28ec60 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:35.165552 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a7ecf1bd-dec6-42d9-99d7-d70dbf28ec60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:35.182955 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecf1bd-dec6-42d9-99d7-d70dbf28ec60 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:35.190029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc317d96-8f24-4952-923e-a655c8932151 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:35.190714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc317d96-8f24-4952-923e-a655c8932151 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:35.190993 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc317d96-8f24-4952-923e-a655c8932151 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:35.191260 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc317d96-8f24-4952-923e-a655c8932151 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:35.201861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc317d96-8f24-4952-923e-a655c8932151 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:35.203699 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc317d96-8f24-4952-923e-a655c8932151 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:35.216877 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1330/2620] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:32:35.241329 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a37a5a-a57e-4625-ad0c-347c3db03b20 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:35.241898 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a37a5a-a57e-4625-ad0c-347c3db03b20 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:35.242135 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a37a5a-a57e-4625-ad0c-347c3db03b20 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:35.243749 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1291/2621] 10.222.0.18 () {54 vars in 912 bytes} [Tue Jul 19 11:32:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:32:35.252458 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc317d96-8f24-4952-923e-a655c8932151 service nova] Authenticating service token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:32:35.265181 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-fc317d96-8f24-4952-923e-a655c8932151 service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jul 19 11:32:35.265581 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc317d96-8f24-4952-923e-a655c8932151 service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:35.275720 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc317d96-8f24-4952-923e-a655c8932151 service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:35.281992 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0515d-5686-4509-8ba3-bef6a7dc4f4b tempest-ServersAdminNegativeTestJSON-1454661089 tempest-ServersAdminNegativeTestJSON-1454661089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b96e9fccc940caaa67d9152b531caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8984b5232c454521a100315363aabb82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:35.283622 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0515d-5686-4509-8ba3-bef6a7dc4f4b tempest-ServersAdminNegativeTestJSON-1454661089 tempest-ServersAdminNegativeTestJSON-1454661089-project-admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:35.283622 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0515d-5686-4509-8ba3-bef6a7dc4f4b tempest-ServersAdminNegativeTestJSON-1454661089 tempest-ServersAdminNegativeTestJSON-1454661089-project-admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:35.283622 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0515d-5686-4509-8ba3-bef6a7dc4f4b tempest-ServersAdminNegativeTestJSON-1454661089 tempest-ServersAdminNegativeTestJSON-1454661089-project-admin] PATH_INFO: `/v3/projects/8984b5232c454521a100315363aabb82` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:35.285091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0515d-5686-4509-8ba3-bef6a7dc4f4b tempest-ServersAdminNegativeTestJSON-1454661089 tempest-ServersAdminNegativeTestJSON-1454661089-project-admin] RBAC: Authorizing `identity:get_project(project_id=8984b5232c454521a100315363aabb82)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:35.287057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0515d-5686-4509-8ba3-bef6a7dc4f4b tempest-ServersAdminNegativeTestJSON-1454661089 tempest-ServersAdminNegativeTestJSON-1454661089-project-admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:35.289413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1331/2622] 10.222.0.18 () {58 vars in 1443 bytes} [Tue Jul 19 11:32:35 2022] GET /identity/v3/projects/8984b5232c454521a100315363aabb82 => generated 393 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:32:35.694435 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38037750-02ec-46e6-95eb-f45a6bdc790d None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:35.694745 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38037750-02ec-46e6-95eb-f45a6bdc790d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:35.695008 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38037750-02ec-46e6-95eb-f45a6bdc790d None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:35.696455 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1292/2623] 10.222.0.18 () {54 vars in 912 bytes} [Tue Jul 19 11:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:32:35.702175 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0515d-5686-4509-8ba3-bef6a7dc4f4b tempest-ServersAdminNegativeTestJSON-1454661089 tempest-ServersAdminNegativeTestJSON-1454661089-project-admin] Authenticating service token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:32:35.716752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0515d-5686-4509-8ba3-bef6a7dc4f4b tempest-ServersAdminNegativeTestJSON-1454661089 tempest-ServersAdminNegativeTestJSON-1454661089-project-admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:35.728213 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0515d-5686-4509-8ba3-bef6a7dc4f4b tempest-ServersAdminNegativeTestJSON-1454661089 tempest-ServersAdminNegativeTestJSON-1454661089-project-admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:35.734768 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d43415-9682-482e-abff-7a869997f286 tempest-ServersAdminNegativeTestJSON-1454661089 tempest-ServersAdminNegativeTestJSON-1454661089-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b96e9fccc940caaa67d9152b531caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8984b5232c454521a100315363aabb82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:35.735774 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d43415-9682-482e-abff-7a869997f286 tempest-ServersAdminNegativeTestJSON-1454661089 tempest-ServersAdminNegativeTestJSON-1454661089-project-admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:35.736058 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d43415-9682-482e-abff-7a869997f286 tempest-ServersAdminNegativeTestJSON-1454661089 tempest-ServersAdminNegativeTestJSON-1454661089-project-admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:35.736320 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d43415-9682-482e-abff-7a869997f286 tempest-ServersAdminNegativeTestJSON-1454661089 tempest-ServersAdminNegativeTestJSON-1454661089-project-admin] PATH_INFO: `/v3/projects/8984b5232c454521a100315363aabb82` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:35.737743 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d43415-9682-482e-abff-7a869997f286 tempest-ServersAdminNegativeTestJSON-1454661089 tempest-ServersAdminNegativeTestJSON-1454661089-project-admin] RBAC: Authorizing `identity:get_project(project_id=8984b5232c454521a100315363aabb82)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:35.739598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d43415-9682-482e-abff-7a869997f286 tempest-ServersAdminNegativeTestJSON-1454661089 tempest-ServersAdminNegativeTestJSON-1454661089-project-admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:35.741513 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1332/2624] 10.222.0.18 () {58 vars in 1443 bytes} [Tue Jul 19 11:32:35 2022] GET /identity/v3/projects/8984b5232c454521a100315363aabb82 => generated 393 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:32:35.914755 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38037750-02ec-46e6-95eb-f45a6bdc790d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:35.916757 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-38037750-02ec-46e6-95eb-f45a6bdc790d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:35.985001 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38037750-02ec-46e6-95eb-f45a6bdc790d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:35.988775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee33d3-5816-481b-b5d9-3cb28fb9e92c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:35.989512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee33d3-5816-481b-b5d9-3cb28fb9e92c service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:35.989853 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee33d3-5816-481b-b5d9-3cb28fb9e92c service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:35.990314 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee33d3-5816-481b-b5d9-3cb28fb9e92c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:35.992687 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-91ee33d3-5816-481b-b5d9-3cb28fb9e92c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:36.004694 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee33d3-5816-481b-b5d9-3cb28fb9e92c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:36.006205 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee33d3-5816-481b-b5d9-3cb28fb9e92c service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:36.016517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1293/2625] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:32:39.927580 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d43415-9682-482e-abff-7a869997f286 tempest-ServersAdminNegativeTestJSON-1454661089 tempest-ServersAdminNegativeTestJSON-1454661089-project-admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:40.001109 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d43415-9682-482e-abff-7a869997f286 tempest-ServersAdminNegativeTestJSON-1454661089 tempest-ServersAdminNegativeTestJSON-1454661089-project-admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:40.006640 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f23072-7028-48ba-a343-6bff9ec4ae25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:40.007557 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f23072-7028-48ba-a343-6bff9ec4ae25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:40.007839 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f23072-7028-48ba-a343-6bff9ec4ae25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:40.008111 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f23072-7028-48ba-a343-6bff9ec4ae25 admin admin] PATH_INFO: `/v3/users/aa2df02e3ee14d85975f1240302b23c7` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:40.009418 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f23072-7028-48ba-a343-6bff9ec4ae25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa2df02e3ee14d85975f1240302b23c7)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:40.011411 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f23072-7028-48ba-a343-6bff9ec4ae25 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:40.070138 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-93f23072-7028-48ba-a343-6bff9ec4ae25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa2df02e3ee14d85975f1240302b23c7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:40.081307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-93f23072-7028-48ba-a343-6bff9ec4ae25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa2df02e3ee14d85975f1240302b23c7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:40.090799 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-93f23072-7028-48ba-a343-6bff9ec4ae25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa2df02e3ee14d85975f1240302b23c7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:40.091674 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-93f23072-7028-48ba-a343-6bff9ec4ae25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa2df02e3ee14d85975f1240302b23c7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:40.092344 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-93f23072-7028-48ba-a343-6bff9ec4ae25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa2df02e3ee14d85975f1240302b23c7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:40.114879 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1333/2626] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:32:39 2022] DELETE /identity/v3/users/aa2df02e3ee14d85975f1240302b23c7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:40.122443 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839044a-e005-41be-9406-6f56a52c21ff None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:40.123077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839044a-e005-41be-9406-6f56a52c21ff None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:40.123225 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839044a-e005-41be-9406-6f56a52c21ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:40.145274 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8839044a-e005-41be-9406-6f56a52c21ff None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:40.146464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8839044a-e005-41be-9406-6f56a52c21ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:40.223696 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1294/2627] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:40.234441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f23072-7028-48ba-a343-6bff9ec4ae25 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:40.236075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-93f23072-7028-48ba-a343-6bff9ec4ae25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:40.301366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:40.307914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f23072-7028-48ba-a343-6bff9ec4ae25 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:40.312896 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afda0d4-6c97-4d08-a965-d4698d2efd4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:40.313964 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afda0d4-6c97-4d08-a965-d4698d2efd4e service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:40.314462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afda0d4-6c97-4d08-a965-d4698d2efd4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:40.314817 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afda0d4-6c97-4d08-a965-d4698d2efd4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:40.326245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afda0d4-6c97-4d08-a965-d4698d2efd4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:40.327736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afda0d4-6c97-4d08-a965-d4698d2efd4e service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:40.342898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1334/2628] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:32:40.571228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839044a-e005-41be-9406-6f56a52c21ff None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:40.573717 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8839044a-e005-41be-9406-6f56a52c21ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:40.596163 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839044a-e005-41be-9406-6f56a52c21ff None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:40.604352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a5af9-9bd1-49b6-aced-880e9c114d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:40.605981 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5af9-9bd1-49b6-aced-880e9c114d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:40.606315 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5af9-9bd1-49b6-aced-880e9c114d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:40.606666 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5af9-9bd1-49b6-aced-880e9c114d73 admin admin] PATH_INFO: `/v3/projects/680092222251444fa6c5c98a97257d45` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:40.608597 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a5af9-9bd1-49b6-aced-880e9c114d73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=680092222251444fa6c5c98a97257d45)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:40.611372 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a5af9-9bd1-49b6-aced-880e9c114d73 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:40.665615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e13a5af9-9bd1-49b6-aced-880e9c114d73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '680092222251444fa6c5c98a97257d45', 'request_id': 'req-e13a5af9-9bd1-49b6-aced-880e9c114d73'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:40.675062 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e13a5af9-9bd1-49b6-aced-880e9c114d73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '680092222251444fa6c5c98a97257d45', 'request_id': 'req-e13a5af9-9bd1-49b6-aced-880e9c114d73'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:40.682862 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e13a5af9-9bd1-49b6-aced-880e9c114d73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '680092222251444fa6c5c98a97257d45', 'request_id': 'req-e13a5af9-9bd1-49b6-aced-880e9c114d73'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:40.696158 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e13a5af9-9bd1-49b6-aced-880e9c114d73 admin admin] The token cache is being invalidate because project 680092222251444fa6c5c98a97257d45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:32:40.696520 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e13a5af9-9bd1-49b6-aced-880e9c114d73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:40.697179 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e13a5af9-9bd1-49b6-aced-880e9c114d73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:40.698795 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1295/2629] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:32:40 2022] DELETE /identity/v3/projects/680092222251444fa6c5c98a97257d45 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:40.703986 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afda0d4-6c97-4d08-a965-d4698d2efd4e service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:40.721783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afda0d4-6c97-4d08-a965-d4698d2efd4e service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:40.803189 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5923040-51ec-4558-be51-7d95d5ae165d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:40.804669 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5923040-51ec-4558-be51-7d95d5ae165d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:40.805182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5923040-51ec-4558-be51-7d95d5ae165d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:40.805642 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5923040-51ec-4558-be51-7d95d5ae165d admin admin] PATH_INFO: `/v3/users/c2b96e9fccc940caaa67d9152b531caa` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:40.807952 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5923040-51ec-4558-be51-7d95d5ae165d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2b96e9fccc940caaa67d9152b531caa)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:40.811767 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5923040-51ec-4558-be51-7d95d5ae165d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:40.886598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f5923040-51ec-4558-be51-7d95d5ae165d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2b96e9fccc940caaa67d9152b531caa'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:40.896794 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f5923040-51ec-4558-be51-7d95d5ae165d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2b96e9fccc940caaa67d9152b531caa'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:40.906664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f5923040-51ec-4558-be51-7d95d5ae165d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2b96e9fccc940caaa67d9152b531caa'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:40.907528 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f5923040-51ec-4558-be51-7d95d5ae165d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2b96e9fccc940caaa67d9152b531caa'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:40.908146 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f5923040-51ec-4558-be51-7d95d5ae165d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2b96e9fccc940caaa67d9152b531caa'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:40.936467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1335/2630] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:32:40 2022] DELETE /identity/v3/users/c2b96e9fccc940caaa67d9152b531caa => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:41.284379 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a5af9-9bd1-49b6-aced-880e9c114d73 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:41.286546 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e13a5af9-9bd1-49b6-aced-880e9c114d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:41.308791 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a5af9-9bd1-49b6-aced-880e9c114d73 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:41.348317 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:41.396345 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456cb8d5-bd46-484b-b14e-eee35253b45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:41.397377 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cb8d5-bd46-484b-b14e-eee35253b45d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:41.397812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cb8d5-bd46-484b-b14e-eee35253b45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:41.398217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cb8d5-bd46-484b-b14e-eee35253b45d admin admin] PATH_INFO: `/v3/projects/8984b5232c454521a100315363aabb82` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:41.399735 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456cb8d5-bd46-484b-b14e-eee35253b45d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8984b5232c454521a100315363aabb82)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:41.401786 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456cb8d5-bd46-484b-b14e-eee35253b45d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:41.463341 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-456cb8d5-bd46-484b-b14e-eee35253b45d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8984b5232c454521a100315363aabb82', 'request_id': 'req-456cb8d5-bd46-484b-b14e-eee35253b45d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:41.473054 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-456cb8d5-bd46-484b-b14e-eee35253b45d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8984b5232c454521a100315363aabb82', 'request_id': 'req-456cb8d5-bd46-484b-b14e-eee35253b45d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:41.480025 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-456cb8d5-bd46-484b-b14e-eee35253b45d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8984b5232c454521a100315363aabb82', 'request_id': 'req-456cb8d5-bd46-484b-b14e-eee35253b45d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:41.492920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-456cb8d5-bd46-484b-b14e-eee35253b45d admin admin] The token cache is being invalidate because project 8984b5232c454521a100315363aabb82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:32:41.493213 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-456cb8d5-bd46-484b-b14e-eee35253b45d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:41.493986 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-456cb8d5-bd46-484b-b14e-eee35253b45d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:41.496194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1296/2631] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:32:41 2022] DELETE /identity/v3/projects/8984b5232c454521a100315363aabb82 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:32:41.503923 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7038fb-98f7-46d2-bc02-0d686a6468e8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:41.504551 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7038fb-98f7-46d2-bc02-0d686a6468e8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:41.504929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7038fb-98f7-46d2-bc02-0d686a6468e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:41.525477 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bf7038fb-98f7-46d2-bc02-0d686a6468e8 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:41.526727 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bf7038fb-98f7-46d2-bc02-0d686a6468e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:41.598156 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1336/2632] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:32:41.612156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a2396-7afa-4049-9c06-f2c2917e9664 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:41.612475 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a2396-7afa-4049-9c06-f2c2917e9664 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:41.612780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a2396-7afa-4049-9c06-f2c2917e9664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:41.634732 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b55a2396-7afa-4049-9c06-f2c2917e9664 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:41.636008 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b55a2396-7afa-4049-9c06-f2c2917e9664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:41.645666 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1297/2633] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:41.651017 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7038fb-98f7-46d2-bc02-0d686a6468e8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:41.662208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7038fb-98f7-46d2-bc02-0d686a6468e8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:41.667214 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbee35-c61d-4c39-89e9-51e6bcb13278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:41.667915 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbee35-c61d-4c39-89e9-51e6bcb13278 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:41.668199 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbee35-c61d-4c39-89e9-51e6bcb13278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:41.668474 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbee35-c61d-4c39-89e9-51e6bcb13278 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:41.669299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbee35-c61d-4c39-89e9-51e6bcb13278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:32:41.669651 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbee35-c61d-4c39-89e9-51e6bcb13278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:41.671353 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbee35-c61d-4c39-89e9-51e6bcb13278 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:41.679651 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:41.687159 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1337/2634] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:32:41.692729 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a2396-7afa-4049-9c06-f2c2917e9664 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:41.709668 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a2396-7afa-4049-9c06-f2c2917e9664 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:41.717760 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee51fd6-aed2-4897-9e52-303bb7af6159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:41.718898 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee51fd6-aed2-4897-9e52-303bb7af6159 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:41.719358 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee51fd6-aed2-4897-9e52-303bb7af6159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:41.719834 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee51fd6-aed2-4897-9e52-303bb7af6159 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:41.721160 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee51fd6-aed2-4897-9e52-303bb7af6159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:41.724922 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee51fd6-aed2-4897-9e52-303bb7af6159 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:41.770711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1298/2635] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:32:41 2022] POST /identity/v3/projects => generated 377 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:41.775670 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbee35-c61d-4c39-89e9-51e6bcb13278 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:41.787435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbee35-c61d-4c39-89e9-51e6bcb13278 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:41.858999 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad738d-d81a-4b6a-8a20-ff692837048a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:41.859707 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad738d-d81a-4b6a-8a20-ff692837048a admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:41.859988 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad738d-d81a-4b6a-8a20-ff692837048a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:41.860261 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad738d-d81a-4b6a-8a20-ff692837048a admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:41.861052 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad738d-d81a-4b6a-8a20-ff692837048a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:41.863073 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad738d-d81a-4b6a-8a20-ff692837048a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:41.887743 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1338/2636] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:32:41 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:41.894091 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee51fd6-aed2-4897-9e52-303bb7af6159 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:41.905776 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee51fd6-aed2-4897-9e52-303bb7af6159 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:41.910994 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9612b7-eaaf-40eb-a8d0-b867c612798f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:41.911702 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9612b7-eaaf-40eb-a8d0-b867c612798f admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:41.911985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9612b7-eaaf-40eb-a8d0-b867c612798f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:41.912261 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9612b7-eaaf-40eb-a8d0-b867c612798f admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:41.913040 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9612b7-eaaf-40eb-a8d0-b867c612798f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:41.914753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9612b7-eaaf-40eb-a8d0-b867c612798f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:41.928258 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1299/2637] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:32:41.933624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad738d-d81a-4b6a-8a20-ff692837048a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:41.950814 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad738d-d81a-4b6a-8a20-ff692837048a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:41.958711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d8e4e-015a-4cfc-9d34-82e1fbf56eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:41.959792 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d8e4e-015a-4cfc-9d34-82e1fbf56eff admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:41.960251 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d8e4e-015a-4cfc-9d34-82e1fbf56eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:41.960818 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d8e4e-015a-4cfc-9d34-82e1fbf56eff admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:41.962179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d8e4e-015a-4cfc-9d34-82e1fbf56eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:41.965447 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d8e4e-015a-4cfc-9d34-82e1fbf56eff admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:41.988301 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1339/2638] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:41.993352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9612b7-eaaf-40eb-a8d0-b867c612798f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:42.006563 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9612b7-eaaf-40eb-a8d0-b867c612798f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:42.013132 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7ec81-52be-4596-9a46-ca3fa0cf24f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:42.014076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7ec81-52be-4596-9a46-ca3fa0cf24f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:42.014368 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7ec81-52be-4596-9a46-ca3fa0cf24f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:42.014647 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7ec81-52be-4596-9a46-ca3fa0cf24f5 admin admin] PATH_INFO: `/v3/projects/687af59f5bcd488a9150d9021fd4fe69/users/da408bb92f86476ab1567b5335dfe912/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:42.037071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7ec81-52be-4596-9a46-ca3fa0cf24f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=687af59f5bcd488a9150d9021fd4fe69, user_id=da408bb92f86476ab1567b5335dfe912, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:42.039861 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7ec81-52be-4596-9a46-ca3fa0cf24f5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:42.057616 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1300/2639] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:32:41 2022] PUT /identity/v3/projects/687af59f5bcd488a9150d9021fd4fe69/users/da408bb92f86476ab1567b5335dfe912/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:42.066570 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e6e33-84ca-4adf-b7a5-c1aced6ea70b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:42.067058 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e6e33-84ca-4adf-b7a5-c1aced6ea70b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:42.069233 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e6e33-84ca-4adf-b7a5-c1aced6ea70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:42.091199 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b07e6e33-84ca-4adf-b7a5-c1aced6ea70b None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:42.092646 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b07e6e33-84ca-4adf-b7a5-c1aced6ea70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:42.165587 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1340/2640] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:42.177178 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7ec81-52be-4596-9a46-ca3fa0cf24f5 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:42.179067 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-30a7ec81-52be-4596-9a46-ca3fa0cf24f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:42.249786 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7ec81-52be-4596-9a46-ca3fa0cf24f5 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:42.254699 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e616309-3e57-4b0f-ba97-e1af9c66af75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:42.255441 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e616309-3e57-4b0f-ba97-e1af9c66af75 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:42.255722 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e616309-3e57-4b0f-ba97-e1af9c66af75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:42.255998 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e616309-3e57-4b0f-ba97-e1af9c66af75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:42.264388 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:42.268078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e616309-3e57-4b0f-ba97-e1af9c66af75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:42.270200 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e616309-3e57-4b0f-ba97-e1af9c66af75 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:42.283451 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1301/2641] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:32:47.986512 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e572514-da5b-4a1f-ba81-2bc764915bad None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:47.990140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e572514-da5b-4a1f-ba81-2bc764915bad None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:47.991014 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e572514-da5b-4a1f-ba81-2bc764915bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:48.043638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0e572514-da5b-4a1f-ba81-2bc764915bad None None] MFA Rules not processed for user `da408bb92f86476ab1567b5335dfe912`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:48.046001 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0e572514-da5b-4a1f-ba81-2bc764915bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:48.148568 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1341/2642] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:32:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:48.165503 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4afbca-4dd4-4155-85f1-dea14cfc80d5 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:48.166030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4afbca-4dd4-4155-85f1-dea14cfc80d5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:48.166030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4afbca-4dd4-4155-85f1-dea14cfc80d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:48.188537 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5d4afbca-4dd4-4155-85f1-dea14cfc80d5 None None] MFA Rules not processed for user `da408bb92f86476ab1567b5335dfe912`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:48.190796 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5d4afbca-4dd4-4155-85f1-dea14cfc80d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:48.202538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1302/2643] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:32:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:48.223265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e572514-da5b-4a1f-ba81-2bc764915bad None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:48.225467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0e572514-da5b-4a1f-ba81-2bc764915bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:48.237563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:48.350386 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e572514-da5b-4a1f-ba81-2bc764915bad None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:48.356491 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478debde-b481-4617-a0a2-8f60e62a2d66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:48.357215 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478debde-b481-4617-a0a2-8f60e62a2d66 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:48.357499 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478debde-b481-4617-a0a2-8f60e62a2d66 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:48.357775 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478debde-b481-4617-a0a2-8f60e62a2d66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:48.367432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478debde-b481-4617-a0a2-8f60e62a2d66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:48.369123 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478debde-b481-4617-a0a2-8f60e62a2d66 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:48.382103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1342/2644] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:32:58.181320 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:58.374936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=31 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:02.270328 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14943ac-51a7-40d1-8d0d-2a6dc6b7c1e5 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:02.271129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14943ac-51a7-40d1-8d0d-2a6dc6b7c1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:02.271129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14943ac-51a7-40d1-8d0d-2a6dc6b7c1e5 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:02.274020 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1303/2645] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 19 11:33:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 11:33:02.283944 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935534d-cc52-4ab4-a8a2-c3acbd83f0f6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:02.284555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935534d-cc52-4ab4-a8a2-c3acbd83f0f6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:02.284684 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935534d-cc52-4ab4-a8a2-c3acbd83f0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:02.345341 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e935534d-cc52-4ab4-a8a2-c3acbd83f0f6 None None] MFA Rules not processed for user `07eaacc831ae481d99e8ab03ee295e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:02.347122 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e935534d-cc52-4ab4-a8a2-c3acbd83f0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:02.354543 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1343/2646] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 11:33:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:02.368959 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14943ac-51a7-40d1-8d0d-2a6dc6b7c1e5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:02.371228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a14943ac-51a7-40d1-8d0d-2a6dc6b7c1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:02.387155 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14943ac-51a7-40d1-8d0d-2a6dc6b7c1e5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:02.392553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7dd19-442d-4ef3-b0b3-ff959b45f798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:02.393429 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7dd19-442d-4ef3-b0b3-ff959b45f798 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:02.393716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7dd19-442d-4ef3-b0b3-ff959b45f798 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:02.393993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7dd19-442d-4ef3-b0b3-ff959b45f798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:02.402950 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7dd19-442d-4ef3-b0b3-ff959b45f798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:02.404708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7dd19-442d-4ef3-b0b3-ff959b45f798 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:02.415612 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1304/2647] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:02.536277 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75103976-3be9-4442-a08d-6b477ce31d48 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:02.536704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75103976-3be9-4442-a08d-6b477ce31d48 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:02.537121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75103976-3be9-4442-a08d-6b477ce31d48 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:02.538683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1344/2648] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 19 11:33:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:33:02.544650 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853b3b8-541f-4f6b-ba4e-2fa006bde030 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:02.545036 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853b3b8-541f-4f6b-ba4e-2fa006bde030 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:02.545351 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853b3b8-541f-4f6b-ba4e-2fa006bde030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:02.591049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4853b3b8-541f-4f6b-ba4e-2fa006bde030 None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:02.592209 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4853b3b8-541f-4f6b-ba4e-2fa006bde030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:02.671540 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1305/2649] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 11:33:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:33:02.694665 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75103976-3be9-4442-a08d-6b477ce31d48 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:02.696747 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-75103976-3be9-4442-a08d-6b477ce31d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:02.716392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75103976-3be9-4442-a08d-6b477ce31d48 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:02.721968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdeb494-70e7-4d86-822d-6fc663cbd053 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:02.722790 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeb494-70e7-4d86-822d-6fc663cbd053 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:02.723079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeb494-70e7-4d86-822d-6fc663cbd053 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:02.723349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeb494-70e7-4d86-822d-6fc663cbd053 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:02.733435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdeb494-70e7-4d86-822d-6fc663cbd053 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:02.735211 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdeb494-70e7-4d86-822d-6fc663cbd053 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:02.747169 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1345/2650] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:02.950632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853b3b8-541f-4f6b-ba4e-2fa006bde030 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:02.966662 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853b3b8-541f-4f6b-ba4e-2fa006bde030 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:02.972165 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bbea3-a370-4cef-b1d0-c1cecb7702cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:02.973172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bbea3-a370-4cef-b1d0-c1cecb7702cf service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:02.973508 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bbea3-a370-4cef-b1d0-c1cecb7702cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:02.973838 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bbea3-a370-4cef-b1d0-c1cecb7702cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:02.976479 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-072bbea3-a370-4cef-b1d0-c1cecb7702cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:03.003115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072bbea3-a370-4cef-b1d0-c1cecb7702cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:03.004635 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072bbea3-a370-4cef-b1d0-c1cecb7702cf service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:03.019333 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1306/2651] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:09.571480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdeb494-70e7-4d86-822d-6fc663cbd053 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:09.582855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdeb494-70e7-4d86-822d-6fc663cbd053 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:09.587969 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d0456-3667-45d9-820a-a8174128a7b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:09.588709 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d0456-3667-45d9-820a-a8174128a7b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:09.589117 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d0456-3667-45d9-820a-a8174128a7b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:09.589443 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d0456-3667-45d9-820a-a8174128a7b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:09.592020 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7a8d0456-3667-45d9-820a-a8174128a7b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:09.608577 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d0456-3667-45d9-820a-a8174128a7b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:09.610339 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d0456-3667-45d9-820a-a8174128a7b8 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:09.624433 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1346/2652] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:10.847747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bbea3-a370-4cef-b1d0-c1cecb7702cf service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:10.860138 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bbea3-a370-4cef-b1d0-c1cecb7702cf service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:10.864484 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84e02f-7d27-4eaf-a5bc-4d54977709ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:10.865215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84e02f-7d27-4eaf-a5bc-4d54977709ed service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:10.865497 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84e02f-7d27-4eaf-a5bc-4d54977709ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:10.865758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84e02f-7d27-4eaf-a5bc-4d54977709ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:10.867836 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dc84e02f-7d27-4eaf-a5bc-4d54977709ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:10.884205 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84e02f-7d27-4eaf-a5bc-4d54977709ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:10.885742 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84e02f-7d27-4eaf-a5bc-4d54977709ed service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:10.899977 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1307/2653] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:19.618244 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=25 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:20.892828 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=53 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:41.204490 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d0456-3667-45d9-820a-a8174128a7b8 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:41.206522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7a8d0456-3667-45d9-820a-a8174128a7b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:41.235326 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d0456-3667-45d9-820a-a8174128a7b8 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:41.248459 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef36aa0-f71c-4a3c-a467-00bf4ba9f59e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:41.250817 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef36aa0-f71c-4a3c-a467-00bf4ba9f59e service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:41.251719 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef36aa0-f71c-4a3c-a467-00bf4ba9f59e service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:41.252208 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef36aa0-f71c-4a3c-a467-00bf4ba9f59e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:41.259639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-aef36aa0-f71c-4a3c-a467-00bf4ba9f59e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:41.285378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef36aa0-f71c-4a3c-a467-00bf4ba9f59e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:41.288657 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef36aa0-f71c-4a3c-a467-00bf4ba9f59e service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:41.310245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1347/2654] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:47.102846 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84e02f-7d27-4eaf-a5bc-4d54977709ed service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:47.126254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84e02f-7d27-4eaf-a5bc-4d54977709ed service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:47.134662 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f750ce9-b4b0-4d6f-88a6-03056df07bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:47.136187 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f750ce9-b4b0-4d6f-88a6-03056df07bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:47.136678 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f750ce9-b4b0-4d6f-88a6-03056df07bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:47.137222 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f750ce9-b4b0-4d6f-88a6-03056df07bd0 admin admin] PATH_INFO: `/v3/users/da408bb92f86476ab1567b5335dfe912` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:47.139627 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f750ce9-b4b0-4d6f-88a6-03056df07bd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da408bb92f86476ab1567b5335dfe912)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:47.143600 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f750ce9-b4b0-4d6f-88a6-03056df07bd0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:47.224396 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7f750ce9-b4b0-4d6f-88a6-03056df07bd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da408bb92f86476ab1567b5335dfe912'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:47.235017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7f750ce9-b4b0-4d6f-88a6-03056df07bd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da408bb92f86476ab1567b5335dfe912'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:47.249768 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7f750ce9-b4b0-4d6f-88a6-03056df07bd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da408bb92f86476ab1567b5335dfe912'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:47.250729 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7f750ce9-b4b0-4d6f-88a6-03056df07bd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da408bb92f86476ab1567b5335dfe912'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:47.260680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7f750ce9-b4b0-4d6f-88a6-03056df07bd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da408bb92f86476ab1567b5335dfe912'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:47.267787 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1308/2655] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:33:47 2022] DELETE /identity/v3/users/da408bb92f86476ab1567b5335dfe912 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:47.515366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef36aa0-f71c-4a3c-a467-00bf4ba9f59e service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:47.529255 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef36aa0-f71c-4a3c-a467-00bf4ba9f59e service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:47.610160 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf324a-493b-4c35-835b-653bf26fc5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:47.610954 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf324a-493b-4c35-835b-653bf26fc5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:47.611236 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf324a-493b-4c35-835b-653bf26fc5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:47.611567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf324a-493b-4c35-835b-653bf26fc5c4 admin admin] PATH_INFO: `/v3/projects/687af59f5bcd488a9150d9021fd4fe69` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:47.613011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf324a-493b-4c35-835b-653bf26fc5c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=687af59f5bcd488a9150d9021fd4fe69)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:47.614971 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf324a-493b-4c35-835b-653bf26fc5c4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:47.672760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1bcf324a-493b-4c35-835b-653bf26fc5c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '687af59f5bcd488a9150d9021fd4fe69', 'request_id': 'req-1bcf324a-493b-4c35-835b-653bf26fc5c4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:47.680977 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1bcf324a-493b-4c35-835b-653bf26fc5c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '687af59f5bcd488a9150d9021fd4fe69', 'request_id': 'req-1bcf324a-493b-4c35-835b-653bf26fc5c4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:47.689942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1bcf324a-493b-4c35-835b-653bf26fc5c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '687af59f5bcd488a9150d9021fd4fe69', 'request_id': 'req-1bcf324a-493b-4c35-835b-653bf26fc5c4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:47.705389 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1bcf324a-493b-4c35-835b-653bf26fc5c4 admin admin] The token cache is being invalidate because project 687af59f5bcd488a9150d9021fd4fe69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:33:47.705675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1bcf324a-493b-4c35-835b-653bf26fc5c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:47.706715 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1bcf324a-493b-4c35-835b-653bf26fc5c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:47.708675 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1348/2656] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:47 2022] DELETE /identity/v3/projects/687af59f5bcd488a9150d9021fd4fe69 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:47.717212 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24199b9-6901-4f13-ad32-af552c37b943 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:47.717579 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24199b9-6901-4f13-ad32-af552c37b943 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:47.717938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24199b9-6901-4f13-ad32-af552c37b943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:47.738864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f24199b9-6901-4f13-ad32-af552c37b943 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:47.740157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f24199b9-6901-4f13-ad32-af552c37b943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:47.812626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1309/2657] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:47.822147 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70fa1b-b1a9-4bdd-bcc3-e370b60eba5e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:47.822420 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70fa1b-b1a9-4bdd-bcc3-e370b60eba5e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:47.822701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70fa1b-b1a9-4bdd-bcc3-e370b60eba5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:47.847487 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5a70fa1b-b1a9-4bdd-bcc3-e370b60eba5e None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:47.848931 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5a70fa1b-b1a9-4bdd-bcc3-e370b60eba5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:47.858047 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1349/2658] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:33:47.863220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24199b9-6901-4f13-ad32-af552c37b943 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:47.874230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24199b9-6901-4f13-ad32-af552c37b943 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:47.879262 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa7abe-96b6-49b8-b42d-7325b5ce6513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:47.879943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa7abe-96b6-49b8-b42d-7325b5ce6513 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:47.880228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa7abe-96b6-49b8-b42d-7325b5ce6513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:47.880506 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa7abe-96b6-49b8-b42d-7325b5ce6513 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:47.881315 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa7abe-96b6-49b8-b42d-7325b5ce6513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:33:47.881628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa7abe-96b6-49b8-b42d-7325b5ce6513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:47.883659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa7abe-96b6-49b8-b42d-7325b5ce6513 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:47.897987 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1310/2659] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:33:47.902718 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70fa1b-b1a9-4bdd-bcc3-e370b60eba5e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:47.913267 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70fa1b-b1a9-4bdd-bcc3-e370b60eba5e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:47.918324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c8dba-6ebf-4512-808b-df1720724504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:47.919022 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c8dba-6ebf-4512-808b-df1720724504 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:47.919304 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c8dba-6ebf-4512-808b-df1720724504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:47.919581 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c8dba-6ebf-4512-808b-df1720724504 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:47.920306 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c8dba-6ebf-4512-808b-df1720724504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:47.922326 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c8dba-6ebf-4512-808b-df1720724504 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:47.952435 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1350/2660] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:47 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:33:47.957520 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa7abe-96b6-49b8-b42d-7325b5ce6513 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:47.968444 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa7abe-96b6-49b8-b42d-7325b5ce6513 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:48.040795 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1a2cb-c2a4-49f3-809e-2fdb1db8fd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:48.041592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1a2cb-c2a4-49f3-809e-2fdb1db8fd3f admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:48.041919 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1a2cb-c2a4-49f3-809e-2fdb1db8fd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:48.042337 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1a2cb-c2a4-49f3-809e-2fdb1db8fd3f admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:48.043117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1a2cb-c2a4-49f3-809e-2fdb1db8fd3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:48.045330 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1a2cb-c2a4-49f3-809e-2fdb1db8fd3f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:48.053510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:48.073327 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1311/2661] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:33:47 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:48.077830 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c8dba-6ebf-4512-808b-df1720724504 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:48.090031 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c8dba-6ebf-4512-808b-df1720724504 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:48.096044 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552e29b-078f-4bb2-96b6-8e62c9ce1137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:48.096917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552e29b-078f-4bb2-96b6-8e62c9ce1137 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:48.097349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552e29b-078f-4bb2-96b6-8e62c9ce1137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:48.097662 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552e29b-078f-4bb2-96b6-8e62c9ce1137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:48.098498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552e29b-078f-4bb2-96b6-8e62c9ce1137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:48.100527 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552e29b-078f-4bb2-96b6-8e62c9ce1137 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:48.114263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1351/2662] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:48.119562 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1a2cb-c2a4-49f3-809e-2fdb1db8fd3f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:48.131650 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1a2cb-c2a4-49f3-809e-2fdb1db8fd3f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:48.138267 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d2120-992e-45a4-a715-96b6f59eaf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:48.139093 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d2120-992e-45a4-a715-96b6f59eaf46 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:48.139459 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d2120-992e-45a4-a715-96b6f59eaf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:48.139819 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d2120-992e-45a4-a715-96b6f59eaf46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:48.140872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d2120-992e-45a4-a715-96b6f59eaf46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:48.142669 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d2120-992e-45a4-a715-96b6f59eaf46 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:48.155209 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1312/2663] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:48.160693 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552e29b-078f-4bb2-96b6-8e62c9ce1137 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:48.172106 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552e29b-078f-4bb2-96b6-8e62c9ce1137 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:48.177884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080fb39-058e-4908-b7a2-94d5999c568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:48.179063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080fb39-058e-4908-b7a2-94d5999c568a admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:48.179439 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080fb39-058e-4908-b7a2-94d5999c568a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:48.179798 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080fb39-058e-4908-b7a2-94d5999c568a admin admin] PATH_INFO: `/v3/projects/5497451f869047dfaf2ca03cebcf1de8/users/9da8e90b061a4f40a2d846a1ec3cfd5b/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:48.200102 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080fb39-058e-4908-b7a2-94d5999c568a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5497451f869047dfaf2ca03cebcf1de8, user_id=9da8e90b061a4f40a2d846a1ec3cfd5b, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:48.203110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080fb39-058e-4908-b7a2-94d5999c568a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:48.223340 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1352/2664] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:48 2022] PUT /identity/v3/projects/5497451f869047dfaf2ca03cebcf1de8/users/9da8e90b061a4f40a2d846a1ec3cfd5b/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:48.229268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3881dd-ff68-4bc9-8690-43d400f6e296 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:48.229545 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3881dd-ff68-4bc9-8690-43d400f6e296 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:48.229825 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3881dd-ff68-4bc9-8690-43d400f6e296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:48.250016 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2f3881dd-ff68-4bc9-8690-43d400f6e296 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:48.251298 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2f3881dd-ff68-4bc9-8690-43d400f6e296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:48.341769 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1313/2665] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:48.353180 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080fb39-058e-4908-b7a2-94d5999c568a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:48.355245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2080fb39-058e-4908-b7a2-94d5999c568a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:48.373163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:48.445195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080fb39-058e-4908-b7a2-94d5999c568a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:48.450730 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cf88b-7c03-400a-9557-127536ee782c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:48.451523 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cf88b-7c03-400a-9557-127536ee782c service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:48.451870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cf88b-7c03-400a-9557-127536ee782c service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:48.452214 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cf88b-7c03-400a-9557-127536ee782c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:48.466623 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508cf88b-7c03-400a-9557-127536ee782c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:48.468950 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508cf88b-7c03-400a-9557-127536ee782c service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:48.483992 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1353/2666] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:54.194006 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ef1f5-f4c7-4869-b327-9ce29aff2d7f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:54.194644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ef1f5-f4c7-4869-b327-9ce29aff2d7f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:54.194644 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ef1f5-f4c7-4869-b327-9ce29aff2d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:54.228813 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-101ef1f5-f4c7-4869-b327-9ce29aff2d7f None None] MFA Rules not processed for user `9da8e90b061a4f40a2d846a1ec3cfd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:54.230109 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-101ef1f5-f4c7-4869-b327-9ce29aff2d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:54.338127 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1314/2667] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:33:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:54.349346 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a456596-9f4c-482a-9905-2841efcdcf32 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:54.349910 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a456596-9f4c-482a-9905-2841efcdcf32 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:54.349910 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a456596-9f4c-482a-9905-2841efcdcf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:54.369390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6a456596-9f4c-482a-9905-2841efcdcf32 None None] MFA Rules not processed for user `9da8e90b061a4f40a2d846a1ec3cfd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:54.370699 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6a456596-9f4c-482a-9905-2841efcdcf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:54.378856 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1354/2668] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:33:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:54.396458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ef1f5-f4c7-4869-b327-9ce29aff2d7f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:54.400945 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-101ef1f5-f4c7-4869-b327-9ce29aff2d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:54.488183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ef1f5-f4c7-4869-b327-9ce29aff2d7f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:54.496152 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b368c7e-1112-4702-a4b5-f9a9336dcafd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:54.496917 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b368c7e-1112-4702-a4b5-f9a9336dcafd service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:54.497205 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b368c7e-1112-4702-a4b5-f9a9336dcafd service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:54.497483 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b368c7e-1112-4702-a4b5-f9a9336dcafd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:54.502811 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:54.509294 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b368c7e-1112-4702-a4b5-f9a9336dcafd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:54.511101 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b368c7e-1112-4702-a4b5-f9a9336dcafd service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:54.522552 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1315/2669] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:54.813632 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a456596-9f4c-482a-9905-2841efcdcf32 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:54.815413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6a456596-9f4c-482a-9905-2841efcdcf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:54.830349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a456596-9f4c-482a-9905-2841efcdcf32 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:54.834957 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14126c90-9d0a-4778-acbf-dc91ca820731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:54.835632 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14126c90-9d0a-4778-acbf-dc91ca820731 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:54.835916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14126c90-9d0a-4778-acbf-dc91ca820731 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:54.836195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14126c90-9d0a-4778-acbf-dc91ca820731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:54.838483 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-14126c90-9d0a-4778-acbf-dc91ca820731 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:54.851870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14126c90-9d0a-4778-acbf-dc91ca820731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:54.854798 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14126c90-9d0a-4778-acbf-dc91ca820731 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:54.866320 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1355/2670] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:04.518112 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:04.861745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=29 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:09.297760 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b92276-6d78-4d87-b0be-b68a9c823c3d None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:09.298677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b92276-6d78-4d87-b0be-b68a9c823c3d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:09.299290 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b92276-6d78-4d87-b0be-b68a9c823c3d None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:09.303304 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1316/2671] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 19 11:34:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:34:09.312498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223d6f-bd0f-4d15-9bc7-3a9cb3b4678d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:09.313566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223d6f-bd0f-4d15-9bc7-3a9cb3b4678d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:09.313987 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223d6f-bd0f-4d15-9bc7-3a9cb3b4678d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:09.339971 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c1223d6f-bd0f-4d15-9bc7-3a9cb3b4678d None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:09.342161 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c1223d6f-bd0f-4d15-9bc7-3a9cb3b4678d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:09.431076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1356/2672] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 11:34:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:09.459907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b92276-6d78-4d87-b0be-b68a9c823c3d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:09.461824 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a6b92276-6d78-4d87-b0be-b68a9c823c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:09.480349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b92276-6d78-4d87-b0be-b68a9c823c3d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:09.487235 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06cbb3-52a2-40b2-b4a3-24852fbdc6a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:09.488265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06cbb3-52a2-40b2-b4a3-24852fbdc6a4 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:09.488553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06cbb3-52a2-40b2-b4a3-24852fbdc6a4 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:09.488858 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06cbb3-52a2-40b2-b4a3-24852fbdc6a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:09.499237 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06cbb3-52a2-40b2-b4a3-24852fbdc6a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:09.501343 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06cbb3-52a2-40b2-b4a3-24852fbdc6a4 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:09.514371 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1317/2673] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:19.421702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=29 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:19.508479 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:39.499587 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1223d6f-bd0f-4d15-9bc7-3a9cb3b4678d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:39.608314 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1223d6f-bd0f-4d15-9bc7-3a9cb3b4678d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:39.617315 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a670da-77d1-4070-94d8-7ed236d433e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:39.618733 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a670da-77d1-4070-94d8-7ed236d433e3 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:39.619245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a670da-77d1-4070-94d8-7ed236d433e3 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:39.619710 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a670da-77d1-4070-94d8-7ed236d433e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:39.623088 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-02a670da-77d1-4070-94d8-7ed236d433e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:39.663679 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a670da-77d1-4070-94d8-7ed236d433e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:39.666815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a670da-77d1-4070-94d8-7ed236d433e3 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:39.687054 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1357/2674] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:48.675591 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cdbf5-1d68-4f2b-9de6-57f69a5e4054 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:48.676496 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cdbf5-1d68-4f2b-9de6-57f69a5e4054 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:48.676496 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cdbf5-1d68-4f2b-9de6-57f69a5e4054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:48.699573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c13cdbf5-1d68-4f2b-9de6-57f69a5e4054 None None] MFA Rules not processed for user `9da8e90b061a4f40a2d846a1ec3cfd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:48.701490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c13cdbf5-1d68-4f2b-9de6-57f69a5e4054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:48.709969 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1318/2675] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:34:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:49.678370 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=31 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:58.692544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:04.707134 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc2aa5-5282-4fb9-9cce-b49be05cba7a None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:04.708003 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc2aa5-5282-4fb9-9cce-b49be05cba7a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:04.708003 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc2aa5-5282-4fb9-9cce-b49be05cba7a None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:04.709064 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1358/2676] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 19 11:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 11:35:04.714832 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd021380-c222-4c48-b710-051a51737f97 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:04.715687 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd021380-c222-4c48-b710-051a51737f97 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:04.715687 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd021380-c222-4c48-b710-051a51737f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:04.744411 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-bd021380-c222-4c48-b710-051a51737f97 None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:04.746495 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bd021380-c222-4c48-b710-051a51737f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:04.761587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1319/2677] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 11:35:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:04.784699 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc2aa5-5282-4fb9-9cce-b49be05cba7a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:04.799817 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc2aa5-5282-4fb9-9cce-b49be05cba7a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:04.805297 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e673fe5-f186-4330-9ca6-5465c5e9e336 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:04.805985 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e673fe5-f186-4330-9ca6-5465c5e9e336 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:04.806259 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e673fe5-f186-4330-9ca6-5465c5e9e336 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:04.806518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e673fe5-f186-4330-9ca6-5465c5e9e336 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:04.816850 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e673fe5-f186-4330-9ca6-5465c5e9e336 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:04.818753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e673fe5-f186-4330-9ca6-5465c5e9e336 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:04.830525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1359/2678] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:35:14.735879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:14.825530 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:49.654125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd021380-c222-4c48-b710-051a51737f97 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:49.668121 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd021380-c222-4c48-b710-051a51737f97 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:49.676169 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03f476-a5bd-4caf-8c6c-ba736c826313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:49.677737 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03f476-a5bd-4caf-8c6c-ba736c826313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:49.678025 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03f476-a5bd-4caf-8c6c-ba736c826313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:49.678333 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03f476-a5bd-4caf-8c6c-ba736c826313 admin admin] PATH_INFO: `/v3/users/9da8e90b061a4f40a2d846a1ec3cfd5b` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:49.680836 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03f476-a5bd-4caf-8c6c-ba736c826313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9da8e90b061a4f40a2d846a1ec3cfd5b)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:49.685331 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03f476-a5bd-4caf-8c6c-ba736c826313 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:49.760252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cd03f476-a5bd-4caf-8c6c-ba736c826313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9da8e90b061a4f40a2d846a1ec3cfd5b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:49.770459 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cd03f476-a5bd-4caf-8c6c-ba736c826313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9da8e90b061a4f40a2d846a1ec3cfd5b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:49.787758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cd03f476-a5bd-4caf-8c6c-ba736c826313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9da8e90b061a4f40a2d846a1ec3cfd5b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:49.788888 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cd03f476-a5bd-4caf-8c6c-ba736c826313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9da8e90b061a4f40a2d846a1ec3cfd5b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:49.798609 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cd03f476-a5bd-4caf-8c6c-ba736c826313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9da8e90b061a4f40a2d846a1ec3cfd5b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:49.806719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1320/2679] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:35:49 2022] DELETE /identity/v3/users/9da8e90b061a4f40a2d846a1ec3cfd5b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:50.033183 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e673fe5-f186-4330-9ca6-5465c5e9e336 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:50.052446 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e673fe5-f186-4330-9ca6-5465c5e9e336 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:50.142104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a1db2-87de-46b3-8990-f45cdc5807c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:50.143008 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a1db2-87de-46b3-8990-f45cdc5807c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:50.143287 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a1db2-87de-46b3-8990-f45cdc5807c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:50.143556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a1db2-87de-46b3-8990-f45cdc5807c2 admin admin] PATH_INFO: `/v3/projects/5497451f869047dfaf2ca03cebcf1de8` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:50.145124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a1db2-87de-46b3-8990-f45cdc5807c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5497451f869047dfaf2ca03cebcf1de8)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:50.147218 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a1db2-87de-46b3-8990-f45cdc5807c2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:50.207940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7e9a1db2-87de-46b3-8990-f45cdc5807c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5497451f869047dfaf2ca03cebcf1de8', 'request_id': 'req-7e9a1db2-87de-46b3-8990-f45cdc5807c2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:50.218075 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7e9a1db2-87de-46b3-8990-f45cdc5807c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5497451f869047dfaf2ca03cebcf1de8', 'request_id': 'req-7e9a1db2-87de-46b3-8990-f45cdc5807c2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:50.225482 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7e9a1db2-87de-46b3-8990-f45cdc5807c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5497451f869047dfaf2ca03cebcf1de8', 'request_id': 'req-7e9a1db2-87de-46b3-8990-f45cdc5807c2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:50.241864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7e9a1db2-87de-46b3-8990-f45cdc5807c2 admin admin] The token cache is being invalidate because project 5497451f869047dfaf2ca03cebcf1de8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:35:50.242146 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7e9a1db2-87de-46b3-8990-f45cdc5807c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:50.242790 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7e9a1db2-87de-46b3-8990-f45cdc5807c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:50.244500 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1360/2680] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:35:50 2022] DELETE /identity/v3/projects/5497451f869047dfaf2ca03cebcf1de8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:50.250044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059c1ca-58bf-4214-bdb6-5bbca6d63010 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:50.250320 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059c1ca-58bf-4214-bdb6-5bbca6d63010 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:50.250636 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059c1ca-58bf-4214-bdb6-5bbca6d63010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:50.277432 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5059c1ca-58bf-4214-bdb6-5bbca6d63010 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:50.278612 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5059c1ca-58bf-4214-bdb6-5bbca6d63010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:50.350971 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1321/2681] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:50.359332 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36832b5f-fe58-4b91-9125-984b51df8bdf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:50.359672 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36832b5f-fe58-4b91-9125-984b51df8bdf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:50.359983 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36832b5f-fe58-4b91-9125-984b51df8bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:50.380837 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-36832b5f-fe58-4b91-9125-984b51df8bdf None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:50.382431 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-36832b5f-fe58-4b91-9125-984b51df8bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:50.392472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1361/2682] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:50.397487 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059c1ca-58bf-4214-bdb6-5bbca6d63010 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:50.409014 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059c1ca-58bf-4214-bdb6-5bbca6d63010 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:50.414707 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f90360-088e-48ca-a103-a8d1c4b150a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:50.415516 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f90360-088e-48ca-a103-a8d1c4b150a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:50.415908 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f90360-088e-48ca-a103-a8d1c4b150a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:50.416278 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f90360-088e-48ca-a103-a8d1c4b150a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:50.417181 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f90360-088e-48ca-a103-a8d1c4b150a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:35:50.417583 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f90360-088e-48ca-a103-a8d1c4b150a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:50.419443 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f90360-088e-48ca-a103-a8d1c4b150a0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:50.434783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1322/2683] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:35:50.440647 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36832b5f-fe58-4b91-9125-984b51df8bdf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:50.457959 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36832b5f-fe58-4b91-9125-984b51df8bdf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:50.466321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dbd3f-af77-44df-9762-a5e3f0ad0721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:50.467502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dbd3f-af77-44df-9762-a5e3f0ad0721 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:50.467984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dbd3f-af77-44df-9762-a5e3f0ad0721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:50.468469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dbd3f-af77-44df-9762-a5e3f0ad0721 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:50.469854 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dbd3f-af77-44df-9762-a5e3f0ad0721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:50.473610 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dbd3f-af77-44df-9762-a5e3f0ad0721 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:50.522447 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1362/2684] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:35:50 2022] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:35:50.527563 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f90360-088e-48ca-a103-a8d1c4b150a0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:50.540086 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f90360-088e-48ca-a103-a8d1c4b150a0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:50.613958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832ac25-f531-403c-8867-a5d3ae14801f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:50.614670 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832ac25-f531-403c-8867-a5d3ae14801f admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:50.614957 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832ac25-f531-403c-8867-a5d3ae14801f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:50.615225 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832ac25-f531-403c-8867-a5d3ae14801f admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:50.615948 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832ac25-f531-403c-8867-a5d3ae14801f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:50.618081 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832ac25-f531-403c-8867-a5d3ae14801f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:50.625795 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:50.645525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1323/2685] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:35:50 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:35:50.650306 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dbd3f-af77-44df-9762-a5e3f0ad0721 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:50.662484 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dbd3f-af77-44df-9762-a5e3f0ad0721 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:50.668646 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbef3c1-fcf4-463e-aec0-f2656370d077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:50.669512 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbef3c1-fcf4-463e-aec0-f2656370d077 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:50.669832 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbef3c1-fcf4-463e-aec0-f2656370d077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:50.670172 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbef3c1-fcf4-463e-aec0-f2656370d077 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:50.671016 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbef3c1-fcf4-463e-aec0-f2656370d077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:50.672788 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbef3c1-fcf4-463e-aec0-f2656370d077 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:50.687348 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1363/2686] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:35:50.692812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832ac25-f531-403c-8867-a5d3ae14801f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:50.705054 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832ac25-f531-403c-8867-a5d3ae14801f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:50.710356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1720733-98bd-40ea-963d-271c43c0761f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:50.711127 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1720733-98bd-40ea-963d-271c43c0761f admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:50.711410 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1720733-98bd-40ea-963d-271c43c0761f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:50.711685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1720733-98bd-40ea-963d-271c43c0761f admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:50.712433 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1720733-98bd-40ea-963d-271c43c0761f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:50.714214 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1720733-98bd-40ea-963d-271c43c0761f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:50.726712 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1324/2687] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:35:50.732306 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbef3c1-fcf4-463e-aec0-f2656370d077 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:50.749514 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbef3c1-fcf4-463e-aec0-f2656370d077 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:50.757103 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad746a-1339-424b-bba0-9b3bf5a7125f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:50.758592 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad746a-1339-424b-bba0-9b3bf5a7125f admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:50.759038 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad746a-1339-424b-bba0-9b3bf5a7125f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:50.759480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad746a-1339-424b-bba0-9b3bf5a7125f admin admin] PATH_INFO: `/v3/projects/52f85c530edf4e9690c9f08c69b34568/users/45a5025bb4664c3b9a3b420529ffaa5c/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:50.795363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad746a-1339-424b-bba0-9b3bf5a7125f admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f85c530edf4e9690c9f08c69b34568, user_id=45a5025bb4664c3b9a3b420529ffaa5c, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:50.800109 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad746a-1339-424b-bba0-9b3bf5a7125f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:50.819634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1364/2688] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:35:50 2022] PUT /identity/v3/projects/52f85c530edf4e9690c9f08c69b34568/users/45a5025bb4664c3b9a3b420529ffaa5c/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:50.825720 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383817b-4f1c-49b6-aebc-9d3828a57091 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:50.826086 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383817b-4f1c-49b6-aebc-9d3828a57091 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:50.826406 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383817b-4f1c-49b6-aebc-9d3828a57091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:50.847060 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6383817b-4f1c-49b6-aebc-9d3828a57091 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:50.848332 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6383817b-4f1c-49b6-aebc-9d3828a57091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:50.920842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1325/2689] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:50.934874 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad746a-1339-424b-bba0-9b3bf5a7125f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:50.937291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-78ad746a-1339-424b-bba0-9b3bf5a7125f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:50.986156 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:51.034710 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad746a-1339-424b-bba0-9b3bf5a7125f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:51.039622 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdc434-d10b-48b3-b585-108b853af77d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:51.040330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdc434-d10b-48b3-b585-108b853af77d service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:51.040604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdc434-d10b-48b3-b585-108b853af77d service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:51.040915 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdc434-d10b-48b3-b585-108b853af77d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:51.051793 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdc434-d10b-48b3-b585-108b853af77d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:51.053226 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdc434-d10b-48b3-b585-108b853af77d service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:51.065629 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1365/2690] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:35:56.554032 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4871e-6a9e-4301-a1ce-e79ab1043ed2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:56.554907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4871e-6a9e-4301-a1ce-e79ab1043ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:56.554907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4871e-6a9e-4301-a1ce-e79ab1043ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:56.598449 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-56c4871e-6a9e-4301-a1ce-e79ab1043ed2 None None] MFA Rules not processed for user `45a5025bb4664c3b9a3b420529ffaa5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:56.600817 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-56c4871e-6a9e-4301-a1ce-e79ab1043ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:56.706031 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1326/2691] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:35:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:56.730127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdc434-d10b-48b3-b585-108b853af77d service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:56.732557 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-91fdc434-d10b-48b3-b585-108b853af77d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:56.888121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdc434-d10b-48b3-b585-108b853af77d service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:56.895674 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993b1a4-16cc-4040-a55c-54de44b485e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:56.896877 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993b1a4-16cc-4040-a55c-54de44b485e4 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:56.897361 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993b1a4-16cc-4040-a55c-54de44b485e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:56.897907 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993b1a4-16cc-4040-a55c-54de44b485e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:56.912954 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993b1a4-16cc-4040-a55c-54de44b485e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:56.914805 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993b1a4-16cc-4040-a55c-54de44b485e4 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:56.943803 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1366/2692] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:35:58.885617 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509223d2-0e11-4078-9d71-f89b4899a2cd None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:58.886185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509223d2-0e11-4078-9d71-f89b4899a2cd None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:58.886650 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509223d2-0e11-4078-9d71-f89b4899a2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:58.920359 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-509223d2-0e11-4078-9d71-f89b4899a2cd None None] MFA Rules not processed for user `45a5025bb4664c3b9a3b420529ffaa5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:58.922633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-509223d2-0e11-4078-9d71-f89b4899a2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:58.936248 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1327/2693] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:35:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:59.927937 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993b1a4-16cc-4040-a55c-54de44b485e4 service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:59.930921 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b993b1a4-16cc-4040-a55c-54de44b485e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:00.094595 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993b1a4-16cc-4040-a55c-54de44b485e4 service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:00.103551 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af6e96-ca06-417b-852c-3a5dbdff765b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:00.104596 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af6e96-ca06-417b-852c-3a5dbdff765b service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:00.105055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af6e96-ca06-417b-852c-3a5dbdff765b service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:00.105502 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af6e96-ca06-417b-852c-3a5dbdff765b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:00.108009 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c3af6e96-ca06-417b-852c-3a5dbdff765b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:00.130195 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af6e96-ca06-417b-852c-3a5dbdff765b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:00.132147 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af6e96-ca06-417b-852c-3a5dbdff765b service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:00.145274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1367/2694] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:36:02.618091 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509223d2-0e11-4078-9d71-f89b4899a2cd None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:02.632076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509223d2-0e11-4078-9d71-f89b4899a2cd None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:02.636830 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c4c35-971c-46c7-aa43-07469315ed42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:02.637877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c4c35-971c-46c7-aa43-07469315ed42 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:02.638377 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c4c35-971c-46c7-aa43-07469315ed42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:02.638831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c4c35-971c-46c7-aa43-07469315ed42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:02.642125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ab1c4c35-971c-46c7-aa43-07469315ed42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:02.660554 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c4c35-971c-46c7-aa43-07469315ed42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:02.663384 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c4c35-971c-46c7-aa43-07469315ed42 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:02.677464 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1328/2695] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:36:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:36:10.119379 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af6e96-ca06-417b-852c-3a5dbdff765b service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:10.121256 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c3af6e96-ca06-417b-852c-3a5dbdff765b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:10.143226 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af6e96-ca06-417b-852c-3a5dbdff765b service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:10.149723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcbf5c-e4d8-496b-9bc4-9b9d97f25a60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:10.150415 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcbf5c-e4d8-496b-9bc4-9b9d97f25a60 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:10.150695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcbf5c-e4d8-496b-9bc4-9b9d97f25a60 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:10.150967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcbf5c-e4d8-496b-9bc4-9b9d97f25a60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:10.152997 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-36bcbf5c-e4d8-496b-9bc4-9b9d97f25a60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:10.166625 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcbf5c-e4d8-496b-9bc4-9b9d97f25a60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:10.168282 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcbf5c-e4d8-496b-9bc4-9b9d97f25a60 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:10.181713 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1368/2696] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:36:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:36:12.671652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:INSERT=3,keystone:SELECT=75 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:20.175708 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:19.684146 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590eb397-63d4-40fc-b337-ed83904fff20 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:19.685110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590eb397-63d4-40fc-b337-ed83904fff20 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:19.685110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590eb397-63d4-40fc-b337-ed83904fff20 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:19.687714 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1329/2697] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 19 11:37:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:37:19.695666 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ceccf-f79c-4297-9e18-7aa35b4c3ddc None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:19.697374 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ceccf-f79c-4297-9e18-7aa35b4c3ddc None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:19.697834 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ceccf-f79c-4297-9e18-7aa35b4c3ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:19.720938 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b66ceccf-f79c-4297-9e18-7aa35b4c3ddc None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:19.722635 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b66ceccf-f79c-4297-9e18-7aa35b4c3ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:19.734384 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1369/2698] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 11:37:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:19.764345 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590eb397-63d4-40fc-b337-ed83904fff20 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:19.779813 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590eb397-63d4-40fc-b337-ed83904fff20 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:19.786157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8e93b-0092-40a1-8b64-47ccd6fd592e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:19.786975 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8e93b-0092-40a1-8b64-47ccd6fd592e service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:19.787343 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8e93b-0092-40a1-8b64-47ccd6fd592e service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:19.787789 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8e93b-0092-40a1-8b64-47ccd6fd592e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:19.798112 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8e93b-0092-40a1-8b64-47ccd6fd592e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:19.799748 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8e93b-0092-40a1-8b64-47ccd6fd592e service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:19.811368 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1330/2699] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:37:29.713124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:29.806573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:46.446391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad7c48-5249-4e9c-a65c-ada9e64d7673 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:46.446960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad7c48-5249-4e9c-a65c-ada9e64d7673 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:46.447755 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad7c48-5249-4e9c-a65c-ada9e64d7673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:46.470387 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7cad7c48-5249-4e9c-a65c-ada9e64d7673 None None] MFA Rules not processed for user `45a5025bb4664c3b9a3b420529ffaa5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:46.471791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7cad7c48-5249-4e9c-a65c-ada9e64d7673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:46.480442 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1370/2700] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:37:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:56.464944 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:05.335986 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8e93b-0092-40a1-8b64-47ccd6fd592e service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:05.346706 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8e93b-0092-40a1-8b64-47ccd6fd592e service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:05.350684 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11fffe-c64c-4a9f-992b-958534425cbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:05.351425 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11fffe-c64c-4a9f-992b-958534425cbf service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:05.351763 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11fffe-c64c-4a9f-992b-958534425cbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:05.352086 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11fffe-c64c-4a9f-992b-958534425cbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:05.354277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1a11fffe-c64c-4a9f-992b-958534425cbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:05.370413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11fffe-c64c-4a9f-992b-958534425cbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:05.371762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11fffe-c64c-4a9f-992b-958534425cbf service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:05.384455 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1331/2701] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:39:06.626430 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad7c48-5249-4e9c-a65c-ada9e64d7673 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:06.628124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7cad7c48-5249-4e9c-a65c-ada9e64d7673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:06.642436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad7c48-5249-4e9c-a65c-ada9e64d7673 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:06.646343 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d2c49-4677-4512-b3ec-c66b39b3348e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:06.647047 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d2c49-4677-4512-b3ec-c66b39b3348e service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:06.647330 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d2c49-4677-4512-b3ec-c66b39b3348e service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:06.647609 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d2c49-4677-4512-b3ec-c66b39b3348e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:06.650030 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8a8d2c49-4677-4512-b3ec-c66b39b3348e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:06.668119 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d2c49-4677-4512-b3ec-c66b39b3348e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:06.669638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d2c49-4677-4512-b3ec-c66b39b3348e service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:06.682454 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1371/2702] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:39:15.378908 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:16.676915 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:22.533640 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11fffe-c64c-4a9f-992b-958534425cbf service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:22.543863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11fffe-c64c-4a9f-992b-958534425cbf service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:22.549350 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647daf3d-a5d1-4576-926b-10ef2a2fdc10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:22.550549 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647daf3d-a5d1-4576-926b-10ef2a2fdc10 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:22.551059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647daf3d-a5d1-4576-926b-10ef2a2fdc10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:22.551532 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647daf3d-a5d1-4576-926b-10ef2a2fdc10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:22.554792 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-647daf3d-a5d1-4576-926b-10ef2a2fdc10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:22.572834 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647daf3d-a5d1-4576-926b-10ef2a2fdc10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:22.575874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647daf3d-a5d1-4576-926b-10ef2a2fdc10 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:22.590387 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1332/2703] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:39:22.726626 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cb735-125a-4ba4-a18a-1f4272fa362a None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:22.727347 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cb735-125a-4ba4-a18a-1f4272fa362a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:22.727347 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cb735-125a-4ba4-a18a-1f4272fa362a None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:22.728775 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1372/2704] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 19 11:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:39:22.734876 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff86c8-16f6-49b0-9625-8c5facd0f9e2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:22.735202 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff86c8-16f6-49b0-9625-8c5facd0f9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:22.735477 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff86c8-16f6-49b0-9625-8c5facd0f9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:22.766455 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e5ff86c8-16f6-49b0-9625-8c5facd0f9e2 None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:22.768204 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e5ff86c8-16f6-49b0-9625-8c5facd0f9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:22.779462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1333/2705] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 11:39:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:22.805218 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cb735-125a-4ba4-a18a-1f4272fa362a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:22.807215 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-be2cb735-125a-4ba4-a18a-1f4272fa362a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:22.827798 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cb735-125a-4ba4-a18a-1f4272fa362a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:22.835251 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52fb96-96e5-4730-a7e3-ee042306e271 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:22.836127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52fb96-96e5-4730-a7e3-ee042306e271 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:22.836574 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52fb96-96e5-4730-a7e3-ee042306e271 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:22.836925 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52fb96-96e5-4730-a7e3-ee042306e271 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:22.853199 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52fb96-96e5-4730-a7e3-ee042306e271 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:22.855091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52fb96-96e5-4730-a7e3-ee042306e271 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:22.868180 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1373/2706] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:39:23.064966 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff86c8-16f6-49b0-9625-8c5facd0f9e2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:23.076831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff86c8-16f6-49b0-9625-8c5facd0f9e2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:23.081446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c9e81-c583-4af6-b753-5efc91368a1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:23.082171 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c9e81-c583-4af6-b753-5efc91368a1a service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:23.082462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c9e81-c583-4af6-b753-5efc91368a1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:23.082763 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c9e81-c583-4af6-b753-5efc91368a1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:23.084902 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2b0c9e81-c583-4af6-b753-5efc91368a1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:23.102210 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c9e81-c583-4af6-b753-5efc91368a1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:23.103857 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c9e81-c583-4af6-b753-5efc91368a1a service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:23.116602 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1334/2707] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:39:32.862439 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:33.110921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=15 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:38.968696 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52fb96-96e5-4730-a7e3-ee042306e271 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:38.990132 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52fb96-96e5-4730-a7e3-ee042306e271 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:39.011528 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261a98e-e101-48cf-bca5-22ab2d590486 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:39.013031 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261a98e-e101-48cf-bca5-22ab2d590486 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:39.013553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261a98e-e101-48cf-bca5-22ab2d590486 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:39.014056 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261a98e-e101-48cf-bca5-22ab2d590486 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:39.018053 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0261a98e-e101-48cf-bca5-22ab2d590486 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:39.041587 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261a98e-e101-48cf-bca5-22ab2d590486 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:39.044884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261a98e-e101-48cf-bca5-22ab2d590486 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:39.069184 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1374/2708] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:39:39.410293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c9e81-c583-4af6-b753-5efc91368a1a service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:39.432544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c9e81-c583-4af6-b753-5efc91368a1a service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:39.443296 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae737062-043b-480b-9b36-1ff6a0a47684 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:39.444943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae737062-043b-480b-9b36-1ff6a0a47684 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:39.445432 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae737062-043b-480b-9b36-1ff6a0a47684 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:39.445876 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae737062-043b-480b-9b36-1ff6a0a47684 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:39.448939 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ae737062-043b-480b-9b36-1ff6a0a47684 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:39.497583 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae737062-043b-480b-9b36-1ff6a0a47684 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:39.499202 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae737062-043b-480b-9b36-1ff6a0a47684 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:39.512270 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1335/2709] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:39:40.874387 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95888b86-1c20-4498-bab6-2f508da17294 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:40.875018 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95888b86-1c20-4498-bab6-2f508da17294 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:40.875018 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95888b86-1c20-4498-bab6-2f508da17294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:40.895451 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-95888b86-1c20-4498-bab6-2f508da17294 None None] MFA Rules not processed for user `45a5025bb4664c3b9a3b420529ffaa5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:40.896868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-95888b86-1c20-4498-bab6-2f508da17294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:40.905654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1375/2710] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:39:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:41.339663 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae737062-043b-480b-9b36-1ff6a0a47684 service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:41.354995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae737062-043b-480b-9b36-1ff6a0a47684 service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:41.359164 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ee57a-0d69-4742-8e44-16adcf6f75c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:41.359841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ee57a-0d69-4742-8e44-16adcf6f75c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:41.360132 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ee57a-0d69-4742-8e44-16adcf6f75c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:41.360420 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ee57a-0d69-4742-8e44-16adcf6f75c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:41.362481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-152ee57a-0d69-4742-8e44-16adcf6f75c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:41.374716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ee57a-0d69-4742-8e44-16adcf6f75c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:41.376304 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ee57a-0d69-4742-8e44-16adcf6f75c6 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:41.387979 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1336/2711] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:39:50.889046 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=9 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:51.382980 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=17 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:54.544748 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95888b86-1c20-4498-bab6-2f508da17294 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:54.558417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95888b86-1c20-4498-bab6-2f508da17294 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:54.565022 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43266b7-9d11-446e-88b0-95c587d4c61c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:54.566027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43266b7-9d11-446e-88b0-95c587d4c61c service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:54.566306 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43266b7-9d11-446e-88b0-95c587d4c61c service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:54.566750 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43266b7-9d11-446e-88b0-95c587d4c61c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:54.569096 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e43266b7-9d11-446e-88b0-95c587d4c61c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:54.582963 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43266b7-9d11-446e-88b0-95c587d4c61c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:54.584626 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43266b7-9d11-446e-88b0-95c587d4c61c service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:54.597905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1376/2712] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:40:04.591737 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:08.908273 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ee57a-0d69-4742-8e44-16adcf6f75c6 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:08.929081 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ee57a-0d69-4742-8e44-16adcf6f75c6 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:08.936475 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae214b6c-30f8-40da-bf62-4a906ed5dab5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:08.937197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae214b6c-30f8-40da-bf62-4a906ed5dab5 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:08.937477 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae214b6c-30f8-40da-bf62-4a906ed5dab5 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:08.937749 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae214b6c-30f8-40da-bf62-4a906ed5dab5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:08.951274 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae214b6c-30f8-40da-bf62-4a906ed5dab5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:08.953136 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae214b6c-30f8-40da-bf62-4a906ed5dab5 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:08.964466 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1337/2713] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:41:09.251707 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff0248-1112-4513-8003-6c12f9feb8cd None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:09.252424 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff0248-1112-4513-8003-6c12f9feb8cd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:09.252424 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff0248-1112-4513-8003-6c12f9feb8cd None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:09.255123 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1377/2714] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 19 11:41:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:41:09.261919 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049eb19a-8d6c-40c6-9c3d-b6c1d2ddf021 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:09.262393 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049eb19a-8d6c-40c6-9c3d-b6c1d2ddf021 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:09.262920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049eb19a-8d6c-40c6-9c3d-b6c1d2ddf021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:09.289760 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-049eb19a-8d6c-40c6-9c3d-b6c1d2ddf021 None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:09.291894 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-049eb19a-8d6c-40c6-9c3d-b6c1d2ddf021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:09.303812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1338/2715] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 11:41:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:09.333144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff0248-1112-4513-8003-6c12f9feb8cd None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:09.356821 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff0248-1112-4513-8003-6c12f9feb8cd None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:09.365538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148df11-116d-444f-86d8-5c3acab83a2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:09.366113 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148df11-116d-444f-86d8-5c3acab83a2f service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:09.366482 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148df11-116d-444f-86d8-5c3acab83a2f service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:09.366663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148df11-116d-444f-86d8-5c3acab83a2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:09.376960 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148df11-116d-444f-86d8-5c3acab83a2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:09.378627 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148df11-116d-444f-86d8-5c3acab83a2f service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:09.391786 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1378/2716] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:41:09.689075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049eb19a-8d6c-40c6-9c3d-b6c1d2ddf021 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:09.700895 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049eb19a-8d6c-40c6-9c3d-b6c1d2ddf021 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:09.707573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025a7b8-a1f9-4bc2-99be-09a643077de9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:09.708171 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025a7b8-a1f9-4bc2-99be-09a643077de9 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:09.708452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025a7b8-a1f9-4bc2-99be-09a643077de9 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:09.708748 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025a7b8-a1f9-4bc2-99be-09a643077de9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:09.719995 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025a7b8-a1f9-4bc2-99be-09a643077de9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:09.721679 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025a7b8-a1f9-4bc2-99be-09a643077de9 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:09.734202 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1339/2717] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:41:10.643966 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148df11-116d-444f-86d8-5c3acab83a2f service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:10.655924 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148df11-116d-444f-86d8-5c3acab83a2f service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:10.659699 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c75b8-9d20-4bfa-b42d-603bf6c11247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:10.660347 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c75b8-9d20-4bfa-b42d-603bf6c11247 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:10.660677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c75b8-9d20-4bfa-b42d-603bf6c11247 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:10.661098 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c75b8-9d20-4bfa-b42d-603bf6c11247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:10.671027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c75b8-9d20-4bfa-b42d-603bf6c11247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:10.672860 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c75b8-9d20-4bfa-b42d-603bf6c11247 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:10.683211 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1379/2718] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:41:19.730250 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=15 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:20.678586 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=12 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:25.913376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025a7b8-a1f9-4bc2-99be-09a643077de9 service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:25.941748 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025a7b8-a1f9-4bc2-99be-09a643077de9 service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:25.951527 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1bb4a-04a3-40e7-841d-b4eb717978ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:25.952608 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1bb4a-04a3-40e7-841d-b4eb717978ff service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:25.953124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1bb4a-04a3-40e7-841d-b4eb717978ff service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:25.953597 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1bb4a-04a3-40e7-841d-b4eb717978ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:25.971955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1bb4a-04a3-40e7-841d-b4eb717978ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:25.975003 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1bb4a-04a3-40e7-841d-b4eb717978ff service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:25.995465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1340/2719] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:41:35.986205 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:41.180206 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35e8ed-c776-4c99-9972-b9feebdd0cb2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:41.181021 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35e8ed-c776-4c99-9972-b9feebdd0cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:41.181021 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35e8ed-c776-4c99-9972-b9feebdd0cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:41.206438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-cd35e8ed-c776-4c99-9972-b9feebdd0cb2 None None] MFA Rules not processed for user `45a5025bb4664c3b9a3b420529ffaa5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:41.208088 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cd35e8ed-c776-4c99-9972-b9feebdd0cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:41.216567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1380/2720] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:41:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:51.199479 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:24.044984 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1bb4a-04a3-40e7-841d-b4eb717978ff service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:24.055799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1bb4a-04a3-40e7-841d-b4eb717978ff service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:24.061783 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89857b5-e0fa-4394-9d82-0dc4cec0b95c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:24.062544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89857b5-e0fa-4394-9d82-0dc4cec0b95c service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:24.062834 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89857b5-e0fa-4394-9d82-0dc4cec0b95c service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:24.063111 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89857b5-e0fa-4394-9d82-0dc4cec0b95c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:24.065283 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b89857b5-e0fa-4394-9d82-0dc4cec0b95c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:24.099318 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89857b5-e0fa-4394-9d82-0dc4cec0b95c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:24.101839 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89857b5-e0fa-4394-9d82-0dc4cec0b95c service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:24.115509 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1341/2721] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:43:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:43:25.774199 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe44b61-2e60-410a-8b03-36216c7a867e None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:25.774990 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe44b61-2e60-410a-8b03-36216c7a867e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:25.775196 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe44b61-2e60-410a-8b03-36216c7a867e None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:25.778001 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1381/2722] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 19 11:43:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:43:25.784497 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a4566-c575-435d-a7ac-f097398c88b3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:25.785184 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a4566-c575-435d-a7ac-f097398c88b3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:25.785784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a4566-c575-435d-a7ac-f097398c88b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:25.861555 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-509a4566-c575-435d-a7ac-f097398c88b3 None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:25.862799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-509a4566-c575-435d-a7ac-f097398c88b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:25.873595 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1342/2723] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 11:43:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:25.899872 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe44b61-2e60-410a-8b03-36216c7a867e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:25.916614 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe44b61-2e60-410a-8b03-36216c7a867e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:25.922301 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436598d3-afe6-4719-abcb-1be8efbb3987 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:25.922979 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436598d3-afe6-4719-abcb-1be8efbb3987 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:25.923260 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436598d3-afe6-4719-abcb-1be8efbb3987 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:25.923533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436598d3-afe6-4719-abcb-1be8efbb3987 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:25.933560 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436598d3-afe6-4719-abcb-1be8efbb3987 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:25.935393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436598d3-afe6-4719-abcb-1be8efbb3987 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:25.946663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1382/2724] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:43:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:43:35.858063 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=28 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:35.942068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:06.528628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a4566-c575-435d-a7ac-f097398c88b3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:06.545841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a4566-c575-435d-a7ac-f097398c88b3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:06.550969 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ad331-69f6-4f07-a18e-25526b805bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:06.552248 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ad331-69f6-4f07-a18e-25526b805bbf service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:06.552872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ad331-69f6-4f07-a18e-25526b805bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:06.553292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ad331-69f6-4f07-a18e-25526b805bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:06.568383 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ad331-69f6-4f07-a18e-25526b805bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:06.570130 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ad331-69f6-4f07-a18e-25526b805bbf service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:06.585727 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1343/2725] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:07.842131 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436598d3-afe6-4719-abcb-1be8efbb3987 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:07.859701 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436598d3-afe6-4719-abcb-1be8efbb3987 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:07.866569 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309b720-4205-4e92-a930-53e718a444c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:07.867731 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309b720-4205-4e92-a930-53e718a444c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:07.868244 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309b720-4205-4e92-a930-53e718a444c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:07.868760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309b720-4205-4e92-a930-53e718a444c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:07.889545 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309b720-4205-4e92-a930-53e718a444c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:07.891815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309b720-4205-4e92-a930-53e718a444c4 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:07.907325 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1383/2726] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:16.578389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:17.900229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:40.147210 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ad331-69f6-4f07-a18e-25526b805bbf service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:40.170401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ad331-69f6-4f07-a18e-25526b805bbf service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:40.175185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8433ed-0de7-4246-a3d2-dd44601e0fc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:40.175941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8433ed-0de7-4246-a3d2-dd44601e0fc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:40.176224 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8433ed-0de7-4246-a3d2-dd44601e0fc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:40.176532 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8433ed-0de7-4246-a3d2-dd44601e0fc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:40.216702 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8433ed-0de7-4246-a3d2-dd44601e0fc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:40.218211 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8433ed-0de7-4246-a3d2-dd44601e0fc2 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:40.268909 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1344/2727] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:43.959280 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309b720-4205-4e92-a930-53e718a444c4 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:44.054276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309b720-4205-4e92-a930-53e718a444c4 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:44.061870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559ca17-fc0f-45a1-b058-395a40910fb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:44.062615 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559ca17-fc0f-45a1-b058-395a40910fb3 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:44.062844 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559ca17-fc0f-45a1-b058-395a40910fb3 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:44.063113 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559ca17-fc0f-45a1-b058-395a40910fb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:44.065512 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4559ca17-fc0f-45a1-b058-395a40910fb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:44.080150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8433ed-0de7-4246-a3d2-dd44601e0fc2 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:44.092609 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559ca17-fc0f-45a1-b058-395a40910fb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:44.094757 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559ca17-fc0f-45a1-b058-395a40910fb3 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:44.096247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8433ed-0de7-4246-a3d2-dd44601e0fc2 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:44.103086 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f601f0e-5afc-4d66-bc15-3342b716eafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:44.104393 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f601f0e-5afc-4d66-bc15-3342b716eafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:44.104852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f601f0e-5afc-4d66-bc15-3342b716eafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:44.105233 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f601f0e-5afc-4d66-bc15-3342b716eafc admin admin] PATH_INFO: `/v3/users/45a5025bb4664c3b9a3b420529ffaa5c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:44.106967 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f601f0e-5afc-4d66-bc15-3342b716eafc admin admin] RBAC: Authorizing `identity:delete_user(user_id=45a5025bb4664c3b9a3b420529ffaa5c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:44.108278 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1384/2728] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:44.110306 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f601f0e-5afc-4d66-bc15-3342b716eafc admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:44.176454 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7f601f0e-5afc-4d66-bc15-3342b716eafc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45a5025bb4664c3b9a3b420529ffaa5c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:44.186064 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7f601f0e-5afc-4d66-bc15-3342b716eafc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45a5025bb4664c3b9a3b420529ffaa5c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:44.201363 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7f601f0e-5afc-4d66-bc15-3342b716eafc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45a5025bb4664c3b9a3b420529ffaa5c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:44.202138 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7f601f0e-5afc-4d66-bc15-3342b716eafc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45a5025bb4664c3b9a3b420529ffaa5c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:44.219272 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7f601f0e-5afc-4d66-bc15-3342b716eafc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45a5025bb4664c3b9a3b420529ffaa5c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:44.227057 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1345/2729] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:44:44 2022] DELETE /identity/v3/users/45a5025bb4664c3b9a3b420529ffaa5c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:44:44.460129 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559ca17-fc0f-45a1-b058-395a40910fb3 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:44.480774 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559ca17-fc0f-45a1-b058-395a40910fb3 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:44.562033 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d56093-abd8-4533-8ce8-21bb48a06eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:44.563174 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d56093-abd8-4533-8ce8-21bb48a06eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:44.563556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d56093-abd8-4533-8ce8-21bb48a06eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:44.563925 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d56093-abd8-4533-8ce8-21bb48a06eb7 admin admin] PATH_INFO: `/v3/projects/52f85c530edf4e9690c9f08c69b34568` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:44.565533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d56093-abd8-4533-8ce8-21bb48a06eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52f85c530edf4e9690c9f08c69b34568)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:44.567658 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d56093-abd8-4533-8ce8-21bb48a06eb7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:44.624240 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e2d56093-abd8-4533-8ce8-21bb48a06eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52f85c530edf4e9690c9f08c69b34568', 'request_id': 'req-e2d56093-abd8-4533-8ce8-21bb48a06eb7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:44.633042 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e2d56093-abd8-4533-8ce8-21bb48a06eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52f85c530edf4e9690c9f08c69b34568', 'request_id': 'req-e2d56093-abd8-4533-8ce8-21bb48a06eb7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:44.640916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e2d56093-abd8-4533-8ce8-21bb48a06eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52f85c530edf4e9690c9f08c69b34568', 'request_id': 'req-e2d56093-abd8-4533-8ce8-21bb48a06eb7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:44.677825 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e2d56093-abd8-4533-8ce8-21bb48a06eb7 admin admin] The token cache is being invalidate because project 52f85c530edf4e9690c9f08c69b34568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:44:44.678314 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e2d56093-abd8-4533-8ce8-21bb48a06eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:44.679429 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e2d56093-abd8-4533-8ce8-21bb48a06eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:44.682166 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1385/2730] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:44:44 2022] DELETE /identity/v3/projects/52f85c530edf4e9690c9f08c69b34568 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:44.689009 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c98f3-3765-41d9-95bd-ea9289356d4c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:44.689352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c98f3-3765-41d9-95bd-ea9289356d4c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:44.689673 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c98f3-3765-41d9-95bd-ea9289356d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:44.745260 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1a2c98f3-3765-41d9-95bd-ea9289356d4c None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:44.746453 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1a2c98f3-3765-41d9-95bd-ea9289356d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:44.800234 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:44.820149 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1346/2731] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:44.828982 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355780c1-75d5-44c1-abf1-2b18dbb39c9e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:44.829414 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355780c1-75d5-44c1-abf1-2b18dbb39c9e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:44.829795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355780c1-75d5-44c1-abf1-2b18dbb39c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:44.850518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-355780c1-75d5-44c1-abf1-2b18dbb39c9e None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:44.851793 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-355780c1-75d5-44c1-abf1-2b18dbb39c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:44.860622 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1386/2732] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:44.865493 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c98f3-3765-41d9-95bd-ea9289356d4c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:44.876884 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c98f3-3765-41d9-95bd-ea9289356d4c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:44.882278 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b351d-0459-427f-840c-a46ad2176e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:44.883086 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b351d-0459-427f-840c-a46ad2176e32 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:44.883468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b351d-0459-427f-840c-a46ad2176e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:44.883832 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b351d-0459-427f-840c-a46ad2176e32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:44.884834 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b351d-0459-427f-840c-a46ad2176e32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:44:44.885229 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b351d-0459-427f-840c-a46ad2176e32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:44.886993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b351d-0459-427f-840c-a46ad2176e32 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:44.903885 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1347/2733] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:44:44.908982 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355780c1-75d5-44c1-abf1-2b18dbb39c9e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:44.915722 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:44.920326 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355780c1-75d5-44c1-abf1-2b18dbb39c9e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:44.927966 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a37fd7-341d-441a-b258-6ed7fbf23a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:44.928890 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a37fd7-341d-441a-b258-6ed7fbf23a73 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:44.929598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a37fd7-341d-441a-b258-6ed7fbf23a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:44.930121 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a37fd7-341d-441a-b258-6ed7fbf23a73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:44.931096 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a37fd7-341d-441a-b258-6ed7fbf23a73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:44.933351 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a37fd7-341d-441a-b258-6ed7fbf23a73 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:44.985061 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1387/2734] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:44:44 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:44.989986 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b351d-0459-427f-840c-a46ad2176e32 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:45.003469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b351d-0459-427f-840c-a46ad2176e32 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:45.074624 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c6dde-750b-4c41-80ea-8583fe66bd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:45.075369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c6dde-750b-4c41-80ea-8583fe66bd31 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:45.075691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c6dde-750b-4c41-80ea-8583fe66bd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:45.076007 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c6dde-750b-4c41-80ea-8583fe66bd31 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:45.076831 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c6dde-750b-4c41-80ea-8583fe66bd31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:45.078833 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c6dde-750b-4c41-80ea-8583fe66bd31 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:45.103550 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1348/2735] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:44:44 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:45.108528 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a37fd7-341d-441a-b258-6ed7fbf23a73 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:45.122036 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a37fd7-341d-441a-b258-6ed7fbf23a73 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:45.127809 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bb652-4b20-4982-8aa0-c5781f201d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:45.128668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bb652-4b20-4982-8aa0-c5781f201d2c admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:45.129077 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bb652-4b20-4982-8aa0-c5781f201d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:45.129463 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bb652-4b20-4982-8aa0-c5781f201d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:45.130450 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bb652-4b20-4982-8aa0-c5781f201d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:45.132572 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bb652-4b20-4982-8aa0-c5781f201d2c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:45.144295 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1388/2736] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:45.149597 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c6dde-750b-4c41-80ea-8583fe66bd31 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:45.167370 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c6dde-750b-4c41-80ea-8583fe66bd31 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:45.174968 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a82ef-c339-472b-ad91-24b54ecef973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:45.176192 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a82ef-c339-472b-ad91-24b54ecef973 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:45.176578 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a82ef-c339-472b-ad91-24b54ecef973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:45.177043 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a82ef-c339-472b-ad91-24b54ecef973 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:45.178236 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a82ef-c339-472b-ad91-24b54ecef973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:45.181042 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a82ef-c339-472b-ad91-24b54ecef973 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:45.199342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1349/2737] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:45.204204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bb652-4b20-4982-8aa0-c5781f201d2c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:45.216083 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bb652-4b20-4982-8aa0-c5781f201d2c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:45.222307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc1ff1-38a7-4f42-846b-71c9cbd7e53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:45.223385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc1ff1-38a7-4f42-846b-71c9cbd7e53c admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:45.223772 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc1ff1-38a7-4f42-846b-71c9cbd7e53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:45.224137 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc1ff1-38a7-4f42-846b-71c9cbd7e53c admin admin] PATH_INFO: `/v3/projects/e60a62b85f814be1b1716338226d00f5/users/c2767fd13fe34a749ec34c220c1f12ca/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:45.243284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc1ff1-38a7-4f42-846b-71c9cbd7e53c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e60a62b85f814be1b1716338226d00f5, user_id=c2767fd13fe34a749ec34c220c1f12ca, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:45.246074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc1ff1-38a7-4f42-846b-71c9cbd7e53c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:45.263161 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1389/2738] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:44:45 2022] PUT /identity/v3/projects/e60a62b85f814be1b1716338226d00f5/users/c2767fd13fe34a749ec34c220c1f12ca/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:45.269418 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e8069-6059-4ba6-adda-ccf5e9562e9a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:45.269925 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e8069-6059-4ba6-adda-ccf5e9562e9a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:45.270400 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e8069-6059-4ba6-adda-ccf5e9562e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:45.298660 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9a8e8069-6059-4ba6-adda-ccf5e9562e9a None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:45.300391 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9a8e8069-6059-4ba6-adda-ccf5e9562e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:45.384146 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1350/2739] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:45.395911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc1ff1-38a7-4f42-846b-71c9cbd7e53c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:45.397976 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b5cc1ff1-38a7-4f42-846b-71c9cbd7e53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:45.477854 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc1ff1-38a7-4f42-846b-71c9cbd7e53c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:45.482175 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b238e0-c860-4316-aba4-27f9043b0c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:45.482887 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b238e0-c860-4316-aba4-27f9043b0c52 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:45.483168 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b238e0-c860-4316-aba4-27f9043b0c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:45.483441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b238e0-c860-4316-aba4-27f9043b0c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:45.494449 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b238e0-c860-4316-aba4-27f9043b0c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:45.495936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b238e0-c860-4316-aba4-27f9043b0c52 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:45.507461 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1390/2740] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:51.133711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e8069-6059-4ba6-adda-ccf5e9562e9a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:51.137729 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9a8e8069-6059-4ba6-adda-ccf5e9562e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:51.218064 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e91b6-85bd-4a82-bac4-d1795c11405c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:51.218697 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e91b6-85bd-4a82-bac4-d1795c11405c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:51.218697 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e91b6-85bd-4a82-bac4-d1795c11405c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:51.236346 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:51.258193 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e8069-6059-4ba6-adda-ccf5e9562e9a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:51.265248 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d9d87-1800-4e0d-98be-bcf25b6086c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:51.266385 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d9d87-1800-4e0d-98be-bcf25b6086c5 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:51.266758 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d9d87-1800-4e0d-98be-bcf25b6086c5 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:51.267248 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d9d87-1800-4e0d-98be-bcf25b6086c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:51.270231 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e68d9d87-1800-4e0d-98be-bcf25b6086c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:51.273736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-163e91b6-85bd-4a82-bac4-d1795c11405c None None] MFA Rules not processed for user `c2767fd13fe34a749ec34c220c1f12ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:51.278403 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-163e91b6-85bd-4a82-bac4-d1795c11405c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:51.285776 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d9d87-1800-4e0d-98be-bcf25b6086c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:51.288006 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d9d87-1800-4e0d-98be-bcf25b6086c5 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:51.302935 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1351/2741] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:51.444269 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc70cd7-856e-420b-9ee5-9f2e1fc25911 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:51.444676 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc70cd7-856e-420b-9ee5-9f2e1fc25911 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:51.445086 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc70cd7-856e-420b-9ee5-9f2e1fc25911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:51.448283 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1391/2742] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:44:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:51.467325 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7bc70cd7-856e-420b-9ee5-9f2e1fc25911 None None] MFA Rules not processed for user `c2767fd13fe34a749ec34c220c1f12ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:51.468921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7bc70cd7-856e-420b-9ee5-9f2e1fc25911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:51.481275 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1352/2743] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:44:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:51.499281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e91b6-85bd-4a82-bac4-d1795c11405c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:51.506955 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-163e91b6-85bd-4a82-bac4-d1795c11405c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:51.583245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:51.665389 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e91b6-85bd-4a82-bac4-d1795c11405c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:51.671054 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e4d1c-a276-418d-9c56-80c82cc90f17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:51.671743 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e4d1c-a276-418d-9c56-80c82cc90f17 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:51.672020 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e4d1c-a276-418d-9c56-80c82cc90f17 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:51.672295 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e4d1c-a276-418d-9c56-80c82cc90f17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:51.682821 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e4d1c-a276-418d-9c56-80c82cc90f17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:51.684473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e4d1c-a276-418d-9c56-80c82cc90f17 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:51.694974 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1392/2744] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:55.674479 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc70cd7-856e-420b-9ee5-9f2e1fc25911 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:55.711990 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc70cd7-856e-420b-9ee5-9f2e1fc25911 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:55.720590 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c64dac-badb-4f7d-b9ac-12026f3c13f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:55.721819 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c64dac-badb-4f7d-b9ac-12026f3c13f6 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:55.722395 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c64dac-badb-4f7d-b9ac-12026f3c13f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:55.724145 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c64dac-badb-4f7d-b9ac-12026f3c13f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:55.727373 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-33c64dac-badb-4f7d-b9ac-12026f3c13f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:55.744499 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c64dac-badb-4f7d-b9ac-12026f3c13f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:55.746420 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c64dac-badb-4f7d-b9ac-12026f3c13f6 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:55.759335 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1353/2745] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:01.690062 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=25 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:03.623660 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246936d-75c1-4914-bf70-e319fcb90ddf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:03.624372 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246936d-75c1-4914-bf70-e319fcb90ddf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:03.624372 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246936d-75c1-4914-bf70-e319fcb90ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:03.643903 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4246936d-75c1-4914-bf70-e319fcb90ddf None None] MFA Rules not processed for user `c2767fd13fe34a749ec34c220c1f12ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:03.645201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4246936d-75c1-4914-bf70-e319fcb90ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:03.652457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1393/2746] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:45:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:03.942308 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c64dac-badb-4f7d-b9ac-12026f3c13f6 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:03.958230 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c64dac-badb-4f7d-b9ac-12026f3c13f6 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:03.964799 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cbe49-3544-4d0a-85cf-d404ba5c5624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:03.965912 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cbe49-3544-4d0a-85cf-d404ba5c5624 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:03.966400 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cbe49-3544-4d0a-85cf-d404ba5c5624 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:03.966823 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cbe49-3544-4d0a-85cf-d404ba5c5624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:03.969796 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c04cbe49-3544-4d0a-85cf-d404ba5c5624 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:03.987286 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04cbe49-3544-4d0a-85cf-d404ba5c5624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:03.990276 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04cbe49-3544-4d0a-85cf-d404ba5c5624 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:04.005555 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1354/2747] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:13.638244 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:13.998548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=21 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:28.916590 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246936d-75c1-4914-bf70-e319fcb90ddf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:28.929590 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246936d-75c1-4914-bf70-e319fcb90ddf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:28.937300 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153669c-3b1d-4dad-87b6-9d768c1742d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:28.938844 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153669c-3b1d-4dad-87b6-9d768c1742d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:28.939243 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153669c-3b1d-4dad-87b6-9d768c1742d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:28.939717 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153669c-3b1d-4dad-87b6-9d768c1742d8 admin admin] PATH_INFO: `/v3/users/c2767fd13fe34a749ec34c220c1f12ca` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:28.942024 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153669c-3b1d-4dad-87b6-9d768c1742d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2767fd13fe34a749ec34c220c1f12ca)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:28.945875 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153669c-3b1d-4dad-87b6-9d768c1742d8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:29.021723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7153669c-3b1d-4dad-87b6-9d768c1742d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2767fd13fe34a749ec34c220c1f12ca'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:29.033627 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7153669c-3b1d-4dad-87b6-9d768c1742d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2767fd13fe34a749ec34c220c1f12ca'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:29.044491 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7153669c-3b1d-4dad-87b6-9d768c1742d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2767fd13fe34a749ec34c220c1f12ca'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:29.045488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7153669c-3b1d-4dad-87b6-9d768c1742d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2767fd13fe34a749ec34c220c1f12ca'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:29.046204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7153669c-3b1d-4dad-87b6-9d768c1742d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2767fd13fe34a749ec34c220c1f12ca'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:29.069091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1394/2748] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:45:28 2022] DELETE /identity/v3/users/c2767fd13fe34a749ec34c220c1f12ca => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:29.311577 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cbe49-3544-4d0a-85cf-d404ba5c5624 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:29.329344 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cbe49-3544-4d0a-85cf-d404ba5c5624 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:29.409917 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07264f-dffd-4bf9-817e-3dec19f52d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:29.411478 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07264f-dffd-4bf9-817e-3dec19f52d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:29.412040 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07264f-dffd-4bf9-817e-3dec19f52d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:29.412540 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07264f-dffd-4bf9-817e-3dec19f52d55 admin admin] PATH_INFO: `/v3/projects/e60a62b85f814be1b1716338226d00f5` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:29.414927 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07264f-dffd-4bf9-817e-3dec19f52d55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e60a62b85f814be1b1716338226d00f5)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:29.419254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07264f-dffd-4bf9-817e-3dec19f52d55 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:29.498851 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-dd07264f-dffd-4bf9-817e-3dec19f52d55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e60a62b85f814be1b1716338226d00f5', 'request_id': 'req-dd07264f-dffd-4bf9-817e-3dec19f52d55'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:29.509434 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-dd07264f-dffd-4bf9-817e-3dec19f52d55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e60a62b85f814be1b1716338226d00f5', 'request_id': 'req-dd07264f-dffd-4bf9-817e-3dec19f52d55'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:29.516465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-dd07264f-dffd-4bf9-817e-3dec19f52d55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e60a62b85f814be1b1716338226d00f5', 'request_id': 'req-dd07264f-dffd-4bf9-817e-3dec19f52d55'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:29.538381 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-dd07264f-dffd-4bf9-817e-3dec19f52d55 admin admin] The token cache is being invalidate because project e60a62b85f814be1b1716338226d00f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:45:29.538841 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-dd07264f-dffd-4bf9-817e-3dec19f52d55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:29.539673 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-dd07264f-dffd-4bf9-817e-3dec19f52d55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:29.541898 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1355/2749] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:45:29 2022] DELETE /identity/v3/projects/e60a62b85f814be1b1716338226d00f5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:29.547655 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47b88b-ceb0-4c2e-84cc-4a83ed45e7ff None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:29.547989 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47b88b-ceb0-4c2e-84cc-4a83ed45e7ff None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:29.548207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47b88b-ceb0-4c2e-84cc-4a83ed45e7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:29.569555 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ed47b88b-ceb0-4c2e-84cc-4a83ed45e7ff None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:29.570849 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ed47b88b-ceb0-4c2e-84cc-4a83ed45e7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:29.649158 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1395/2750] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:45:29.657638 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a99839-85e5-4619-bf2a-d4556caa5422 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:29.658064 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a99839-85e5-4619-bf2a-d4556caa5422 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:29.658450 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a99839-85e5-4619-bf2a-d4556caa5422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:29.679426 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-99a99839-85e5-4619-bf2a-d4556caa5422 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:29.680659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-99a99839-85e5-4619-bf2a-d4556caa5422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:29.689409 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1356/2751] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:45:29.694993 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47b88b-ceb0-4c2e-84cc-4a83ed45e7ff None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:29.706290 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47b88b-ceb0-4c2e-84cc-4a83ed45e7ff None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:29.711400 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c9ce0-7cdb-4081-8e12-e29306591ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:29.712128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c9ce0-7cdb-4081-8e12-e29306591ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:29.712503 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c9ce0-7cdb-4081-8e12-e29306591ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:29.712996 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c9ce0-7cdb-4081-8e12-e29306591ed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:29.713815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c9ce0-7cdb-4081-8e12-e29306591ed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:45:29.714255 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c9ce0-7cdb-4081-8e12-e29306591ed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:29.716197 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c9ce0-7cdb-4081-8e12-e29306591ed6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:29.730063 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1396/2752] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:45:29.734697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a99839-85e5-4619-bf2a-d4556caa5422 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:29.745563 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a99839-85e5-4619-bf2a-d4556caa5422 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:29.751431 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd892b45-c0db-4b33-bff2-e205962db716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:29.752229 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd892b45-c0db-4b33-bff2-e205962db716 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:29.752621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd892b45-c0db-4b33-bff2-e205962db716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:29.752981 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd892b45-c0db-4b33-bff2-e205962db716 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:29.753941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd892b45-c0db-4b33-bff2-e205962db716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:29.756105 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd892b45-c0db-4b33-bff2-e205962db716 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:29.791763 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1357/2753] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:45:29 2022] POST /identity/v3/projects => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:29.796600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c9ce0-7cdb-4081-8e12-e29306591ed6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:29.809799 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c9ce0-7cdb-4081-8e12-e29306591ed6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:29.886264 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d3566-480d-4e52-8ca3-d53187b0fdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:29.887005 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d3566-480d-4e52-8ca3-d53187b0fdfe admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:29.887318 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d3566-480d-4e52-8ca3-d53187b0fdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:29.887643 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d3566-480d-4e52-8ca3-d53187b0fdfe admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:29.888393 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d3566-480d-4e52-8ca3-d53187b0fdfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:29.890455 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d3566-480d-4e52-8ca3-d53187b0fdfe admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:29.897977 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:29.916938 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1397/2754] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:45:29 2022] POST /identity/v3/users => generated 284 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:45:29.921535 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd892b45-c0db-4b33-bff2-e205962db716 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:29.932824 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd892b45-c0db-4b33-bff2-e205962db716 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:29.938005 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ece29-9861-4e78-b744-5610ba39c91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:29.938752 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ece29-9861-4e78-b744-5610ba39c91f admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:29.939082 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ece29-9861-4e78-b744-5610ba39c91f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:29.939430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ece29-9861-4e78-b744-5610ba39c91f admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:29.940219 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ece29-9861-4e78-b744-5610ba39c91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:29.941997 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ece29-9861-4e78-b744-5610ba39c91f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:29.955169 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1358/2755] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:29.962010 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d3566-480d-4e52-8ca3-d53187b0fdfe admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:29.977805 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d3566-480d-4e52-8ca3-d53187b0fdfe admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:29.984886 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4251e-ee86-4336-a373-8318248f6877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:29.986383 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4251e-ee86-4336-a373-8318248f6877 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:29.986878 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4251e-ee86-4336-a373-8318248f6877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:29.987369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4251e-ee86-4336-a373-8318248f6877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:29.988826 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4251e-ee86-4336-a373-8318248f6877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:29.991956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4251e-ee86-4336-a373-8318248f6877 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:30.012884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1398/2756] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:30.017685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ece29-9861-4e78-b744-5610ba39c91f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:30.029716 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ece29-9861-4e78-b744-5610ba39c91f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:30.035500 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da521d2-b993-449f-9c2e-930f44564200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:30.036572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da521d2-b993-449f-9c2e-930f44564200 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:30.036942 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da521d2-b993-449f-9c2e-930f44564200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:30.037270 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da521d2-b993-449f-9c2e-930f44564200 admin admin] PATH_INFO: `/v3/projects/92b57785beea438c8160a2f3f32a3eb5/users/9a62d765ff94471785428082fc9cdd92/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:30.056691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da521d2-b993-449f-9c2e-930f44564200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92b57785beea438c8160a2f3f32a3eb5, user_id=9a62d765ff94471785428082fc9cdd92, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:30.059714 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da521d2-b993-449f-9c2e-930f44564200 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:30.077826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1359/2757] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:45:30 2022] PUT /identity/v3/projects/92b57785beea438c8160a2f3f32a3eb5/users/9a62d765ff94471785428082fc9cdd92/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:30.089056 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f2d33-99d1-4f35-a3fd-d0d9e35164ee None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:30.089341 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f2d33-99d1-4f35-a3fd-d0d9e35164ee None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:30.089603 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f2d33-99d1-4f35-a3fd-d0d9e35164ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:30.120156 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-546f2d33-99d1-4f35-a3fd-d0d9e35164ee None None] MFA Rules not processed for user `9a62d765ff94471785428082fc9cdd92`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:30.121587 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-546f2d33-99d1-4f35-a3fd-d0d9e35164ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:30.203098 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1399/2758] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:45:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:45:30.214695 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da521d2-b993-449f-9c2e-930f44564200 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:30.216685 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6da521d2-b993-449f-9c2e-930f44564200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:30.254308 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:30.292476 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da521d2-b993-449f-9c2e-930f44564200 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:30.296761 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8499698-fb0d-4f48-99dc-8087bdc249fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:30.297819 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8499698-fb0d-4f48-99dc-8087bdc249fd service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:30.298194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8499698-fb0d-4f48-99dc-8087bdc249fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:30.298514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8499698-fb0d-4f48-99dc-8087bdc249fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:30.309723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8499698-fb0d-4f48-99dc-8087bdc249fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:30.311967 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8499698-fb0d-4f48-99dc-8087bdc249fd service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:30.326465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1360/2759] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:40.198813 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:40.320317 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=14 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:41.771481 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f2d33-99d1-4f35-a3fd-d0d9e35164ee None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:41.786852 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-546f2d33-99d1-4f35-a3fd-d0d9e35164ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:41.923415 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f2d33-99d1-4f35-a3fd-d0d9e35164ee None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:41.930463 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c293df-9038-4c6e-99c6-78566756fe77 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:41.931162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c293df-9038-4c6e-99c6-78566756fe77 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:41.931441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c293df-9038-4c6e-99c6-78566756fe77 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:41.931713 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c293df-9038-4c6e-99c6-78566756fe77 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:41.933783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a4c293df-9038-4c6e-99c6-78566756fe77 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:41.947793 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c293df-9038-4c6e-99c6-78566756fe77 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:41.949518 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c293df-9038-4c6e-99c6-78566756fe77 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:41.961267 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1400/2760] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:43.192266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8499698-fb0d-4f48-99dc-8087bdc249fd service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:43.266641 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8499698-fb0d-4f48-99dc-8087bdc249fd service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:43.271566 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c02e50-cf7a-4266-a00e-6af201a0c931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:43.272469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c02e50-cf7a-4266-a00e-6af201a0c931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:43.272784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c02e50-cf7a-4266-a00e-6af201a0c931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:43.273108 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c02e50-cf7a-4266-a00e-6af201a0c931 admin admin] PATH_INFO: `/v3/users/9a62d765ff94471785428082fc9cdd92` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:43.274329 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c02e50-cf7a-4266-a00e-6af201a0c931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a62d765ff94471785428082fc9cdd92)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:43.276288 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c02e50-cf7a-4266-a00e-6af201a0c931 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:43.336028 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-30c02e50-cf7a-4266-a00e-6af201a0c931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a62d765ff94471785428082fc9cdd92'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:43.346545 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-30c02e50-cf7a-4266-a00e-6af201a0c931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a62d765ff94471785428082fc9cdd92'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:43.362684 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-30c02e50-cf7a-4266-a00e-6af201a0c931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a62d765ff94471785428082fc9cdd92'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:43.363958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-30c02e50-cf7a-4266-a00e-6af201a0c931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a62d765ff94471785428082fc9cdd92'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:43.372958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-30c02e50-cf7a-4266-a00e-6af201a0c931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a62d765ff94471785428082fc9cdd92'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:43.380784 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1361/2761] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:45:43 2022] DELETE /identity/v3/users/9a62d765ff94471785428082fc9cdd92 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:43.386284 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b2ccc-bd06-471d-b961-d80b8e273596 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:43.386961 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b2ccc-bd06-471d-b961-d80b8e273596 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:43.386961 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b2ccc-bd06-471d-b961-d80b8e273596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:43.407705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c77b2ccc-bd06-471d-b961-d80b8e273596 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:43.409021 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c77b2ccc-bd06-471d-b961-d80b8e273596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:43.510833 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1401/2762] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:43.524970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c02e50-cf7a-4266-a00e-6af201a0c931 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:43.526611 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-30c02e50-cf7a-4266-a00e-6af201a0c931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:43.596248 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c02e50-cf7a-4266-a00e-6af201a0c931 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:43.600475 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab168b6-25be-4669-b409-52f924afa990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:43.601267 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab168b6-25be-4669-b409-52f924afa990 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:43.601489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab168b6-25be-4669-b409-52f924afa990 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:43.601766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab168b6-25be-4669-b409-52f924afa990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:43.613124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab168b6-25be-4669-b409-52f924afa990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:43.614737 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab168b6-25be-4669-b409-52f924afa990 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:43.626673 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1362/2763] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:45:43.846489 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b2ccc-bd06-471d-b961-d80b8e273596 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:43.848484 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c77b2ccc-bd06-471d-b961-d80b8e273596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:43.868794 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b2ccc-bd06-471d-b961-d80b8e273596 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:43.875092 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ecbe1-2eb9-4d7c-a50f-a56ff2a8f316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:43.876412 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ecbe1-2eb9-4d7c-a50f-a56ff2a8f316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:43.876857 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ecbe1-2eb9-4d7c-a50f-a56ff2a8f316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:43.877870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ecbe1-2eb9-4d7c-a50f-a56ff2a8f316 admin admin] PATH_INFO: `/v3/projects/92b57785beea438c8160a2f3f32a3eb5` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:43.879782 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ecbe1-2eb9-4d7c-a50f-a56ff2a8f316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92b57785beea438c8160a2f3f32a3eb5)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:43.882434 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ecbe1-2eb9-4d7c-a50f-a56ff2a8f316 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:43.952373 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b08ecbe1-2eb9-4d7c-a50f-a56ff2a8f316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92b57785beea438c8160a2f3f32a3eb5', 'request_id': 'req-b08ecbe1-2eb9-4d7c-a50f-a56ff2a8f316'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:43.960397 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b08ecbe1-2eb9-4d7c-a50f-a56ff2a8f316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92b57785beea438c8160a2f3f32a3eb5', 'request_id': 'req-b08ecbe1-2eb9-4d7c-a50f-a56ff2a8f316'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:43.967578 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b08ecbe1-2eb9-4d7c-a50f-a56ff2a8f316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92b57785beea438c8160a2f3f32a3eb5', 'request_id': 'req-b08ecbe1-2eb9-4d7c-a50f-a56ff2a8f316'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:43.983909 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b08ecbe1-2eb9-4d7c-a50f-a56ff2a8f316 admin admin] The token cache is being invalidate because project 92b57785beea438c8160a2f3f32a3eb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:45:43.984351 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b08ecbe1-2eb9-4d7c-a50f-a56ff2a8f316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:43.985176 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b08ecbe1-2eb9-4d7c-a50f-a56ff2a8f316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:43.987110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1402/2764] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:45:43 2022] DELETE /identity/v3/projects/92b57785beea438c8160a2f3f32a3eb5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:45:43.993618 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d781d47-99dc-445c-8a54-e7ba15fa9bde None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:43.994061 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d781d47-99dc-445c-8a54-e7ba15fa9bde None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:43.994436 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d781d47-99dc-445c-8a54-e7ba15fa9bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:44.018748 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3d781d47-99dc-445c-8a54-e7ba15fa9bde None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:44.020165 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3d781d47-99dc-445c-8a54-e7ba15fa9bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:44.043749 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:44.111207 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1363/2765] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:44.119611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd91cb-0148-4473-aacc-f81f6bcab202 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:44.120004 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd91cb-0148-4473-aacc-f81f6bcab202 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:44.120389 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd91cb-0148-4473-aacc-f81f6bcab202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:44.142089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4acd91cb-0148-4473-aacc-f81f6bcab202 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:44.143543 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4acd91cb-0148-4473-aacc-f81f6bcab202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:44.152432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1403/2766] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:44.157525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d781d47-99dc-445c-8a54-e7ba15fa9bde None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:44.169299 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d781d47-99dc-445c-8a54-e7ba15fa9bde None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:44.175350 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354a9a5-83c5-49ce-99f8-b29e4ba7ade3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:44.176100 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354a9a5-83c5-49ce-99f8-b29e4ba7ade3 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:44.176471 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354a9a5-83c5-49ce-99f8-b29e4ba7ade3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:44.176840 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354a9a5-83c5-49ce-99f8-b29e4ba7ade3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:44.177663 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354a9a5-83c5-49ce-99f8-b29e4ba7ade3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:45:44.178014 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354a9a5-83c5-49ce-99f8-b29e4ba7ade3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:44.179719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354a9a5-83c5-49ce-99f8-b29e4ba7ade3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:44.193979 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1364/2767] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:45:44.200940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd91cb-0148-4473-aacc-f81f6bcab202 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:44.215879 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd91cb-0148-4473-aacc-f81f6bcab202 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:44.228112 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce711c80-9b2d-4e4e-8098-f03491efbe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:44.229394 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce711c80-9b2d-4e4e-8098-f03491efbe72 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:44.229824 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce711c80-9b2d-4e4e-8098-f03491efbe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:44.230312 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce711c80-9b2d-4e4e-8098-f03491efbe72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:44.231554 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce711c80-9b2d-4e4e-8098-f03491efbe72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:44.233661 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce711c80-9b2d-4e4e-8098-f03491efbe72 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:44.239900 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:44.268897 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1404/2768] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:45:44 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:44.276118 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354a9a5-83c5-49ce-99f8-b29e4ba7ade3 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:44.295514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354a9a5-83c5-49ce-99f8-b29e4ba7ade3 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:44.384235 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ef9d2-8075-46dc-b8a3-cf1bbbe259af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:44.385224 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ef9d2-8075-46dc-b8a3-cf1bbbe259af admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:44.385600 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ef9d2-8075-46dc-b8a3-cf1bbbe259af admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:44.386008 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ef9d2-8075-46dc-b8a3-cf1bbbe259af admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:44.386807 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ef9d2-8075-46dc-b8a3-cf1bbbe259af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:44.388966 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ef9d2-8075-46dc-b8a3-cf1bbbe259af admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:44.412398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1365/2769] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:45:44 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:44.417423 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce711c80-9b2d-4e4e-8098-f03491efbe72 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:44.429651 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce711c80-9b2d-4e4e-8098-f03491efbe72 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:44.435179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101e3fb-f13f-400a-ac1e-0402d44529fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:44.435858 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101e3fb-f13f-400a-ac1e-0402d44529fe admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:44.436142 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101e3fb-f13f-400a-ac1e-0402d44529fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:44.436416 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101e3fb-f13f-400a-ac1e-0402d44529fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:44.437189 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101e3fb-f13f-400a-ac1e-0402d44529fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:44.438874 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101e3fb-f13f-400a-ac1e-0402d44529fe admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:44.451245 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1405/2770] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:44.455507 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ef9d2-8075-46dc-b8a3-cf1bbbe259af admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:44.467056 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ef9d2-8075-46dc-b8a3-cf1bbbe259af admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:44.474352 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177218a4-2a8f-4663-892e-d83f37437423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:44.475512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177218a4-2a8f-4663-892e-d83f37437423 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:44.476016 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177218a4-2a8f-4663-892e-d83f37437423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:44.476489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177218a4-2a8f-4663-892e-d83f37437423 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:44.477918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177218a4-2a8f-4663-892e-d83f37437423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:44.481007 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177218a4-2a8f-4663-892e-d83f37437423 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:44.500377 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1366/2771] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:45:44.505235 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101e3fb-f13f-400a-ac1e-0402d44529fe admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:44.516578 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101e3fb-f13f-400a-ac1e-0402d44529fe admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:44.522086 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9679b3-bd5f-4b71-a3eb-d54cd4a80bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:44.522993 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9679b3-bd5f-4b71-a3eb-d54cd4a80bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:44.523275 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9679b3-bd5f-4b71-a3eb-d54cd4a80bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:44.523563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9679b3-bd5f-4b71-a3eb-d54cd4a80bb9 admin admin] PATH_INFO: `/v3/projects/9eedc1de10f44554a08d61d7835bc210/users/f651724244974ea6ad66d9831ef50b3f/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:44.542941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9679b3-bd5f-4b71-a3eb-d54cd4a80bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eedc1de10f44554a08d61d7835bc210, user_id=f651724244974ea6ad66d9831ef50b3f, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:44.545672 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9679b3-bd5f-4b71-a3eb-d54cd4a80bb9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:44.562080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1406/2772] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:45:44 2022] PUT /identity/v3/projects/9eedc1de10f44554a08d61d7835bc210/users/f651724244974ea6ad66d9831ef50b3f/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:44.573416 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994131-061c-4830-8dc8-d51e94d19d3b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:44.573838 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994131-061c-4830-8dc8-d51e94d19d3b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:44.574208 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994131-061c-4830-8dc8-d51e94d19d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:44.607000 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-28994131-061c-4830-8dc8-d51e94d19d3b None None] MFA Rules not processed for user `f651724244974ea6ad66d9831ef50b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:44.608277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-28994131-061c-4830-8dc8-d51e94d19d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:44.688327 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1367/2773] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:45:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:45:44.701055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9679b3-bd5f-4b71-a3eb-d54cd4a80bb9 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:44.703039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-da9679b3-bd5f-4b71-a3eb-d54cd4a80bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:44.771433 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9679b3-bd5f-4b71-a3eb-d54cd4a80bb9 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:44.775739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1c1f6-1444-4496-854e-65e83f9f3876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:44.776420 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1c1f6-1444-4496-854e-65e83f9f3876 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:44.776702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1c1f6-1444-4496-854e-65e83f9f3876 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:44.777005 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1c1f6-1444-4496-854e-65e83f9f3876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:44.787338 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1c1f6-1444-4496-854e-65e83f9f3876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:44.788870 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1c1f6-1444-4496-854e-65e83f9f3876 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:44.800179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1407/2774] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:50.365538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28994131-061c-4830-8dc8-d51e94d19d3b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:50.388390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:50.451459 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28994131-061c-4830-8dc8-d51e94d19d3b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:50.456803 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8282aa4-fbf2-4bce-9b6a-663403076c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:50.457632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8282aa4-fbf2-4bce-9b6a-663403076c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:50.457881 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8282aa4-fbf2-4bce-9b6a-663403076c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:50.458157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8282aa4-fbf2-4bce-9b6a-663403076c6c admin admin] PATH_INFO: `/v3/users/f651724244974ea6ad66d9831ef50b3f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:50.459540 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8282aa4-fbf2-4bce-9b6a-663403076c6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f651724244974ea6ad66d9831ef50b3f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:50.461528 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8282aa4-fbf2-4bce-9b6a-663403076c6c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:50.518941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a8282aa4-fbf2-4bce-9b6a-663403076c6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f651724244974ea6ad66d9831ef50b3f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:50.529796 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a8282aa4-fbf2-4bce-9b6a-663403076c6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f651724244974ea6ad66d9831ef50b3f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:50.550018 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a8282aa4-fbf2-4bce-9b6a-663403076c6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f651724244974ea6ad66d9831ef50b3f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:50.550928 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a8282aa4-fbf2-4bce-9b6a-663403076c6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f651724244974ea6ad66d9831ef50b3f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:50.559321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a8282aa4-fbf2-4bce-9b6a-663403076c6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f651724244974ea6ad66d9831ef50b3f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:50.567694 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1368/2775] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:45:50 2022] DELETE /identity/v3/users/f651724244974ea6ad66d9831ef50b3f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:50.572789 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee52f26-f673-4aa2-9b61-effd14af6e3b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:50.573552 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee52f26-f673-4aa2-9b61-effd14af6e3b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:50.573552 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee52f26-f673-4aa2-9b61-effd14af6e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:50.592391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fee52f26-f673-4aa2-9b61-effd14af6e3b None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:50.593691 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fee52f26-f673-4aa2-9b61-effd14af6e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:50.675173 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1408/2776] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:50.687551 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8282aa4-fbf2-4bce-9b6a-663403076c6c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:50.689178 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a8282aa4-fbf2-4bce-9b6a-663403076c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:50.767913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8282aa4-fbf2-4bce-9b6a-663403076c6c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:50.772772 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc4a72-5b57-4b8d-9e76-054addb83649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:50.773328 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc4a72-5b57-4b8d-9e76-054addb83649 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:50.773655 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc4a72-5b57-4b8d-9e76-054addb83649 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:50.773891 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc4a72-5b57-4b8d-9e76-054addb83649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:50.784504 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc4a72-5b57-4b8d-9e76-054addb83649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:50.786027 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc4a72-5b57-4b8d-9e76-054addb83649 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:50.797653 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1369/2777] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:51.044826 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee52f26-f673-4aa2-9b61-effd14af6e3b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:51.047359 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fee52f26-f673-4aa2-9b61-effd14af6e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:51.083325 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee52f26-f673-4aa2-9b61-effd14af6e3b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:51.092586 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3c4aa-2fe7-450f-93ed-eaed55a6940a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:51.093722 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3c4aa-2fe7-450f-93ed-eaed55a6940a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:51.094233 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3c4aa-2fe7-450f-93ed-eaed55a6940a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:51.094800 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3c4aa-2fe7-450f-93ed-eaed55a6940a admin admin] PATH_INFO: `/v3/projects/9eedc1de10f44554a08d61d7835bc210` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:51.096219 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3c4aa-2fe7-450f-93ed-eaed55a6940a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eedc1de10f44554a08d61d7835bc210)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:51.098490 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3c4aa-2fe7-450f-93ed-eaed55a6940a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:51.163968 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:51.165914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-83e3c4aa-2fe7-450f-93ed-eaed55a6940a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eedc1de10f44554a08d61d7835bc210', 'request_id': 'req-83e3c4aa-2fe7-450f-93ed-eaed55a6940a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:51.179847 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-83e3c4aa-2fe7-450f-93ed-eaed55a6940a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eedc1de10f44554a08d61d7835bc210', 'request_id': 'req-83e3c4aa-2fe7-450f-93ed-eaed55a6940a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:51.189039 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-83e3c4aa-2fe7-450f-93ed-eaed55a6940a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eedc1de10f44554a08d61d7835bc210', 'request_id': 'req-83e3c4aa-2fe7-450f-93ed-eaed55a6940a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:51.204752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-83e3c4aa-2fe7-450f-93ed-eaed55a6940a admin admin] The token cache is being invalidate because project 9eedc1de10f44554a08d61d7835bc210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:45:51.205077 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-83e3c4aa-2fe7-450f-93ed-eaed55a6940a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:51.205731 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-83e3c4aa-2fe7-450f-93ed-eaed55a6940a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:51.207354 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1409/2778] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:45:51 2022] DELETE /identity/v3/projects/9eedc1de10f44554a08d61d7835bc210 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:51.213226 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368de46-642a-4048-821a-3aca083b5c5c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:51.213492 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368de46-642a-4048-821a-3aca083b5c5c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:51.213796 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368de46-642a-4048-821a-3aca083b5c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:51.235005 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9368de46-642a-4048-821a-3aca083b5c5c None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:51.236262 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9368de46-642a-4048-821a-3aca083b5c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:51.279683 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:51.314460 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1370/2779] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:51.322911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd32016-fc17-42ca-8ad3-b30e32adadf8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:51.323191 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd32016-fc17-42ca-8ad3-b30e32adadf8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:51.323461 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd32016-fc17-42ca-8ad3-b30e32adadf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:51.350348 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7bd32016-fc17-42ca-8ad3-b30e32adadf8 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:51.352625 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7bd32016-fc17-42ca-8ad3-b30e32adadf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:51.366203 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1410/2780] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:51.371407 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368de46-642a-4048-821a-3aca083b5c5c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:51.383123 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368de46-642a-4048-821a-3aca083b5c5c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:51.388797 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2afdc-fcb9-476d-a9f3-3cb9d856d4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:51.389510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2afdc-fcb9-476d-a9f3-3cb9d856d4fc admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:51.389788 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2afdc-fcb9-476d-a9f3-3cb9d856d4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:51.390070 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2afdc-fcb9-476d-a9f3-3cb9d856d4fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:51.390834 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2afdc-fcb9-476d-a9f3-3cb9d856d4fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:45:51.391150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2afdc-fcb9-476d-a9f3-3cb9d856d4fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:51.392900 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2afdc-fcb9-476d-a9f3-3cb9d856d4fc admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:51.408086 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1371/2781] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:45:51.414501 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd32016-fc17-42ca-8ad3-b30e32adadf8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:51.426364 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd32016-fc17-42ca-8ad3-b30e32adadf8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:51.432873 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb9828-ce58-4bec-bdf2-ae08615f595f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:51.433516 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb9828-ce58-4bec-bdf2-ae08615f595f admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:51.433889 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb9828-ce58-4bec-bdf2-ae08615f595f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:51.434178 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb9828-ce58-4bec-bdf2-ae08615f595f admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:51.434896 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb9828-ce58-4bec-bdf2-ae08615f595f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:51.436971 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb9828-ce58-4bec-bdf2-ae08615f595f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:51.479847 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1411/2782] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:45:51 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:51.484937 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2afdc-fcb9-476d-a9f3-3cb9d856d4fc admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:51.496911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2afdc-fcb9-476d-a9f3-3cb9d856d4fc admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:51.586024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbed561-de9c-4d93-bcb1-8eae6369587d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:51.587007 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbed561-de9c-4d93-bcb1-8eae6369587d admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:51.587444 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbed561-de9c-4d93-bcb1-8eae6369587d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:51.587879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbed561-de9c-4d93-bcb1-8eae6369587d admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:51.589055 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbed561-de9c-4d93-bcb1-8eae6369587d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:51.592529 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbed561-de9c-4d93-bcb1-8eae6369587d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:51.621702 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1372/2783] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:45:51 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:45:51.627688 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb9828-ce58-4bec-bdf2-ae08615f595f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:51.639895 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb9828-ce58-4bec-bdf2-ae08615f595f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:51.645812 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702efd7-a41c-4c73-bcfc-99bfc9aed03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:51.646528 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702efd7-a41c-4c73-bcfc-99bfc9aed03f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:51.646825 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702efd7-a41c-4c73-bcfc-99bfc9aed03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:51.647115 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702efd7-a41c-4c73-bcfc-99bfc9aed03f admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:51.647871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702efd7-a41c-4c73-bcfc-99bfc9aed03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:51.649607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702efd7-a41c-4c73-bcfc-99bfc9aed03f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:51.662086 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1412/2784] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:45:51.666858 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbed561-de9c-4d93-bcb1-8eae6369587d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:51.679022 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbed561-de9c-4d93-bcb1-8eae6369587d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:51.684370 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cc119-f101-4af7-b1dd-bd25dc07221c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:51.685110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cc119-f101-4af7-b1dd-bd25dc07221c admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:51.685385 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cc119-f101-4af7-b1dd-bd25dc07221c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:51.685664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cc119-f101-4af7-b1dd-bd25dc07221c admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:51.686429 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cc119-f101-4af7-b1dd-bd25dc07221c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:51.688086 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cc119-f101-4af7-b1dd-bd25dc07221c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:51.700451 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1373/2785] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:51.705859 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702efd7-a41c-4c73-bcfc-99bfc9aed03f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:51.723262 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702efd7-a41c-4c73-bcfc-99bfc9aed03f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:51.730947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389f4a9-2739-48d7-8d78-3c01c13169c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:51.732258 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389f4a9-2739-48d7-8d78-3c01c13169c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:51.732744 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389f4a9-2739-48d7-8d78-3c01c13169c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:51.733190 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389f4a9-2739-48d7-8d78-3c01c13169c9 admin admin] PATH_INFO: `/v3/projects/a2f6ab71de0b477aaa7d98750ab64552/users/67dab03cd7924f7e9b2bec0ccb8bb383/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:51.758536 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389f4a9-2739-48d7-8d78-3c01c13169c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f6ab71de0b477aaa7d98750ab64552, user_id=67dab03cd7924f7e9b2bec0ccb8bb383, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:51.761305 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389f4a9-2739-48d7-8d78-3c01c13169c9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:51.780248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1413/2786] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:45:51 2022] PUT /identity/v3/projects/a2f6ab71de0b477aaa7d98750ab64552/users/67dab03cd7924f7e9b2bec0ccb8bb383/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:45:51.788107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002b36e-409b-4f77-a148-6c37f97345b8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:51.788572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002b36e-409b-4f77-a148-6c37f97345b8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:51.789023 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002b36e-409b-4f77-a148-6c37f97345b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:51.819221 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1002b36e-409b-4f77-a148-6c37f97345b8 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:51.821304 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1002b36e-409b-4f77-a148-6c37f97345b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:51.899161 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1374/2787] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:51.910133 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389f4a9-2739-48d7-8d78-3c01c13169c9 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:51.912484 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1389f4a9-2739-48d7-8d78-3c01c13169c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:51.991895 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389f4a9-2739-48d7-8d78-3c01c13169c9 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:51.998030 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1dc30-4274-4c9c-9eb3-19cbeb761a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:51.999092 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1dc30-4274-4c9c-9eb3-19cbeb761a89 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:51.999544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1dc30-4274-4c9c-9eb3-19cbeb761a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:52.000044 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1dc30-4274-4c9c-9eb3-19cbeb761a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:52.017116 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1dc30-4274-4c9c-9eb3-19cbeb761a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:52.019823 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1dc30-4274-4c9c-9eb3-19cbeb761a89 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:52.038317 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1414/2788] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:57.318472 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b1870-ea03-49f5-9e15-09e8c8a4c5ea None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:57.319037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b1870-ea03-49f5-9e15-09e8c8a4c5ea None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:57.319390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b1870-ea03-49f5-9e15-09e8c8a4c5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:57.360399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5b4b1870-ea03-49f5-9e15-09e8c8a4c5ea None None] MFA Rules not processed for user `67dab03cd7924f7e9b2bec0ccb8bb383`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:57.362606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5b4b1870-ea03-49f5-9e15-09e8c8a4c5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:57.410863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:57.491676 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1375/2789] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:45:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:57.496654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1dc30-4274-4c9c-9eb3-19cbeb761a89 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:57.516275 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1dc30-4274-4c9c-9eb3-19cbeb761a89 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:57.522348 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945d8f0-bd20-4330-945f-113c9819a97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:57.523050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945d8f0-bd20-4330-945f-113c9819a97e admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:57.523335 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945d8f0-bd20-4330-945f-113c9819a97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:57.523612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945d8f0-bd20-4330-945f-113c9819a97e admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:57.524321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945d8f0-bd20-4330-945f-113c9819a97e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:57.526371 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945d8f0-bd20-4330-945f-113c9819a97e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:57.568972 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1415/2790] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:45:57 2022] POST /identity/v3/projects => generated 387 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:57.574204 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b1870-ea03-49f5-9e15-09e8c8a4c5ea None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:57.593667 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b1870-ea03-49f5-9e15-09e8c8a4c5ea None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:57.696053 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fec74f-f925-4df4-95f2-acf4556d1f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:57.697019 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fec74f-f925-4df4-95f2-acf4556d1f45 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:57.697403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fec74f-f925-4df4-95f2-acf4556d1f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:57.697834 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fec74f-f925-4df4-95f2-acf4556d1f45 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:57.698809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fec74f-f925-4df4-95f2-acf4556d1f45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:57.701780 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fec74f-f925-4df4-95f2-acf4556d1f45 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:57.730638 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1376/2791] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:45:57 2022] POST /identity/v3/users => generated 300 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:57.736115 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945d8f0-bd20-4330-945f-113c9819a97e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:57.751994 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945d8f0-bd20-4330-945f-113c9819a97e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:57.758105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d074fd-1f66-49a0-9332-75ffe3a1b388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:57.758816 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d074fd-1f66-49a0-9332-75ffe3a1b388 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:57.759099 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d074fd-1f66-49a0-9332-75ffe3a1b388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:57.759369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d074fd-1f66-49a0-9332-75ffe3a1b388 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:57.760110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d074fd-1f66-49a0-9332-75ffe3a1b388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:57.761976 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d074fd-1f66-49a0-9332-75ffe3a1b388 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:57.776343 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1416/2792] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:45:57.781394 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fec74f-f925-4df4-95f2-acf4556d1f45 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:57.793796 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fec74f-f925-4df4-95f2-acf4556d1f45 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:57.799296 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154760f-95b0-45a2-87b6-bd2353665882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:57.800380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154760f-95b0-45a2-87b6-bd2353665882 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:57.800864 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154760f-95b0-45a2-87b6-bd2353665882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:57.801261 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154760f-95b0-45a2-87b6-bd2353665882 admin admin] PATH_INFO: `/v3/projects/7cdb67485a784528ae46addff2cc0892/users/b387b31669c54b569323cfe5bbf4ead7/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:57.823167 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154760f-95b0-45a2-87b6-bd2353665882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cdb67485a784528ae46addff2cc0892, user_id=b387b31669c54b569323cfe5bbf4ead7, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:57.826469 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154760f-95b0-45a2-87b6-bd2353665882 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:57.850080 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1377/2793] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:45:57 2022] PUT /identity/v3/projects/7cdb67485a784528ae46addff2cc0892/users/b387b31669c54b569323cfe5bbf4ead7/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:57.855766 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d074fd-1f66-49a0-9332-75ffe3a1b388 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:57.871286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d074fd-1f66-49a0-9332-75ffe3a1b388 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:57.910432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:57.948663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11819a10-d5db-4d37-94bb-9a021c27f9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:57.950566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11819a10-d5db-4d37-94bb-9a021c27f9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:57.950566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11819a10-d5db-4d37-94bb-9a021c27f9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:57.950566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11819a10-d5db-4d37-94bb-9a021c27f9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:57.951132 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11819a10-d5db-4d37-94bb-9a021c27f9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:57.952824 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11819a10-d5db-4d37-94bb-9a021c27f9d1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:57.972230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1417/2794] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:57.973770 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154760f-95b0-45a2-87b6-bd2353665882 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:57.987734 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154760f-95b0-45a2-87b6-bd2353665882 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:57.993371 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1713d5-52cc-4612-8382-eeb2a62b2acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:57.994331 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1713d5-52cc-4612-8382-eeb2a62b2acd admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:57.994620 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1713d5-52cc-4612-8382-eeb2a62b2acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:57.994898 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1713d5-52cc-4612-8382-eeb2a62b2acd admin admin] PATH_INFO: `/v3/projects/7cdb67485a784528ae46addff2cc0892/users/b387b31669c54b569323cfe5bbf4ead7/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:57.997427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1713d5-52cc-4612-8382-eeb2a62b2acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cdb67485a784528ae46addff2cc0892, user_id=b387b31669c54b569323cfe5bbf4ead7, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:58.000297 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1713d5-52cc-4612-8382-eeb2a62b2acd admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:58.014182 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1378/2795] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:45:57 2022] PUT /identity/v3/projects/7cdb67485a784528ae46addff2cc0892/users/b387b31669c54b569323cfe5bbf4ead7/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:46:04.258046 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6662f90-99ae-4634-aa82-06716ec71b69 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:04.258725 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6662f90-99ae-4634-aa82-06716ec71b69 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:04.259006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6662f90-99ae-4634-aa82-06716ec71b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:04.306563 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a6662f90-99ae-4634-aa82-06716ec71b69 None None] MFA Rules not processed for user `b387b31669c54b569323cfe5bbf4ead7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:04.308745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a6662f90-99ae-4634-aa82-06716ec71b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:04.445585 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1418/2796] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:46:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:46:04.468095 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1713d5-52cc-4612-8382-eeb2a62b2acd admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:04.470613 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7d1713d5-52cc-4612-8382-eeb2a62b2acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:04.645565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1713d5-52cc-4612-8382-eeb2a62b2acd admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:04.652867 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a07c78-804e-4001-ac39-d059710e35da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:04.653967 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a07c78-804e-4001-ac39-d059710e35da service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:04.654471 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a07c78-804e-4001-ac39-d059710e35da service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:04.654966 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a07c78-804e-4001-ac39-d059710e35da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:04.667508 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:04.740491 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a07c78-804e-4001-ac39-d059710e35da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:04.743921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a07c78-804e-4001-ac39-d059710e35da service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:04.756034 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1379/2797] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:46:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:46:04.850514 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943a959-c355-4d99-ba4c-da57511ca338 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:04.851116 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943a959-c355-4d99-ba4c-da57511ca338 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:04.851604 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943a959-c355-4d99-ba4c-da57511ca338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:04.877939 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5943a959-c355-4d99-ba4c-da57511ca338 None None] MFA Rules not processed for user `67dab03cd7924f7e9b2bec0ccb8bb383`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:04.879905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5943a959-c355-4d99-ba4c-da57511ca338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:04.895310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1419/2798] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:46:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:46:09.505718 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a07c78-804e-4001-ac39-d059710e35da service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:09.619594 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a07c78-804e-4001-ac39-d059710e35da service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:09.630462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186b7c6-0706-4f86-997f-8191ee2a0e6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:09.632271 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186b7c6-0706-4f86-997f-8191ee2a0e6c service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:09.632913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186b7c6-0706-4f86-997f-8191ee2a0e6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:09.633509 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186b7c6-0706-4f86-997f-8191ee2a0e6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:09.637536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1186b7c6-0706-4f86-997f-8191ee2a0e6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:09.657844 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186b7c6-0706-4f86-997f-8191ee2a0e6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:09.661533 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186b7c6-0706-4f86-997f-8191ee2a0e6c service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:09.681125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1380/2799] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:46:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:46:14.869554 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=51 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:18.396804 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943a959-c355-4d99-ba4c-da57511ca338 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:18.398893 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5943a959-c355-4d99-ba4c-da57511ca338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:18.498953 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943a959-c355-4d99-ba4c-da57511ca338 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:18.503916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c6ac1-03d6-4b50-84f7-499602446b55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8112def59003484483552fc76f14e281', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:18.504832 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c6ac1-03d6-4b50-84f7-499602446b55 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:18.505110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c6ac1-03d6-4b50-84f7-499602446b55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:18.505380 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c6ac1-03d6-4b50-84f7-499602446b55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:18.518233 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c6ac1-03d6-4b50-84f7-499602446b55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:18.520069 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c6ac1-03d6-4b50-84f7-499602446b55 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:18.531847 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1420/2800] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:46:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:46:19.672510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=49 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:28.526869 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=35 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:47.020849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27147dab-2c33-4a2e-aac4-5ad1fbd48c12 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:47.022140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27147dab-2c33-4a2e-aac4-5ad1fbd48c12 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:47.022502 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27147dab-2c33-4a2e-aac4-5ad1fbd48c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:47.042776 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-27147dab-2c33-4a2e-aac4-5ad1fbd48c12 None None] MFA Rules not processed for user `67dab03cd7924f7e9b2bec0ccb8bb383`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:47.044040 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-27147dab-2c33-4a2e-aac4-5ad1fbd48c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:47.052891 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1381/2801] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:46:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:46:47.741726 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c6ac1-03d6-4b50-84f7-499602446b55 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:47.743529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b73c6ac1-03d6-4b50-84f7-499602446b55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:47.829164 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c6ac1-03d6-4b50-84f7-499602446b55 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:47.834600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5882b94-e3f1-4317-9d65-db1a916e01df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:47.835344 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5882b94-e3f1-4317-9d65-db1a916e01df service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:47.835656 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5882b94-e3f1-4317-9d65-db1a916e01df service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:47.835963 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5882b94-e3f1-4317-9d65-db1a916e01df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:47.838421 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a5882b94-e3f1-4317-9d65-db1a916e01df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:47.854054 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5882b94-e3f1-4317-9d65-db1a916e01df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:47.855847 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5882b94-e3f1-4317-9d65-db1a916e01df service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:47.867946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1421/2802] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:46:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:46:55.657585 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27147dab-2c33-4a2e-aac4-5ad1fbd48c12 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:55.676471 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27147dab-2c33-4a2e-aac4-5ad1fbd48c12 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:55.683077 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74be2a0-49ac-4a65-bb54-bd0554fe6b21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:55.683913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74be2a0-49ac-4a65-bb54-bd0554fe6b21 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:55.684252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74be2a0-49ac-4a65-bb54-bd0554fe6b21 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:55.684595 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74be2a0-49ac-4a65-bb54-bd0554fe6b21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:55.686843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a74be2a0-49ac-4a65-bb54-bd0554fe6b21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:55.702427 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74be2a0-49ac-4a65-bb54-bd0554fe6b21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:55.703999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74be2a0-49ac-4a65-bb54-bd0554fe6b21 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:55.717343 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1382/2803] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:46:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:46:57.862294 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=32 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:47:05.711303 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=9 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:47:34.208708 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5882b94-e3f1-4317-9d65-db1a916e01df service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:34.289903 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5882b94-e3f1-4317-9d65-db1a916e01df service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:34.296404 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e27e2-1384-44c5-9b50-2eb87ebd48a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:34.297868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e27e2-1384-44c5-9b50-2eb87ebd48a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:34.298387 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e27e2-1384-44c5-9b50-2eb87ebd48a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:34.298556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e27e2-1384-44c5-9b50-2eb87ebd48a0 admin admin] PATH_INFO: `/v3/users/67dab03cd7924f7e9b2bec0ccb8bb383` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:34.299984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e27e2-1384-44c5-9b50-2eb87ebd48a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67dab03cd7924f7e9b2bec0ccb8bb383)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:34.302124 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e27e2-1384-44c5-9b50-2eb87ebd48a0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:34.371440 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-980e27e2-1384-44c5-9b50-2eb87ebd48a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67dab03cd7924f7e9b2bec0ccb8bb383'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:47:34.381216 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-980e27e2-1384-44c5-9b50-2eb87ebd48a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67dab03cd7924f7e9b2bec0ccb8bb383'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:47:34.393809 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-980e27e2-1384-44c5-9b50-2eb87ebd48a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67dab03cd7924f7e9b2bec0ccb8bb383'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:47:34.394916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-980e27e2-1384-44c5-9b50-2eb87ebd48a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67dab03cd7924f7e9b2bec0ccb8bb383'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:47:34.395654 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-980e27e2-1384-44c5-9b50-2eb87ebd48a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67dab03cd7924f7e9b2bec0ccb8bb383'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:47:34.420986 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1422/2804] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:47:34 2022] DELETE /identity/v3/users/67dab03cd7924f7e9b2bec0ccb8bb383 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:47:34.667793 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74be2a0-49ac-4a65-bb54-bd0554fe6b21 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:34.683381 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74be2a0-49ac-4a65-bb54-bd0554fe6b21 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:34.759892 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3902d-c6b6-4267-a8d4-cd18cccc149d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:34.760809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3902d-c6b6-4267-a8d4-cd18cccc149d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:34.761093 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3902d-c6b6-4267-a8d4-cd18cccc149d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:34.761373 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3902d-c6b6-4267-a8d4-cd18cccc149d admin admin] PATH_INFO: `/v3/projects/a2f6ab71de0b477aaa7d98750ab64552` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:34.762653 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3902d-c6b6-4267-a8d4-cd18cccc149d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f6ab71de0b477aaa7d98750ab64552)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:34.764609 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3902d-c6b6-4267-a8d4-cd18cccc149d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:34.817076 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a9d3902d-c6b6-4267-a8d4-cd18cccc149d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f6ab71de0b477aaa7d98750ab64552', 'request_id': 'req-a9d3902d-c6b6-4267-a8d4-cd18cccc149d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:47:34.826442 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a9d3902d-c6b6-4267-a8d4-cd18cccc149d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f6ab71de0b477aaa7d98750ab64552', 'request_id': 'req-a9d3902d-c6b6-4267-a8d4-cd18cccc149d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:47:34.833657 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a9d3902d-c6b6-4267-a8d4-cd18cccc149d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f6ab71de0b477aaa7d98750ab64552', 'request_id': 'req-a9d3902d-c6b6-4267-a8d4-cd18cccc149d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:47:34.847064 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a9d3902d-c6b6-4267-a8d4-cd18cccc149d admin admin] The token cache is being invalidate because project a2f6ab71de0b477aaa7d98750ab64552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:47:34.847394 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a9d3902d-c6b6-4267-a8d4-cd18cccc149d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:47:34.848124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a9d3902d-c6b6-4267-a8d4-cd18cccc149d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:47:34.849858 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1383/2805] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:47:34 2022] DELETE /identity/v3/projects/a2f6ab71de0b477aaa7d98750ab64552 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:47:34.854457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e27e2-1384-44c5-9b50-2eb87ebd48a0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:34.855987 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-980e27e2-1384-44c5-9b50-2eb87ebd48a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:47:34.870287 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e27e2-1384-44c5-9b50-2eb87ebd48a0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:34.936541 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecc5a3-eddc-48d4-b18c-08a3b6c463e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:34.937472 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecc5a3-eddc-48d4-b18c-08a3b6c463e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:34.937755 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecc5a3-eddc-48d4-b18c-08a3b6c463e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:34.938029 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecc5a3-eddc-48d4-b18c-08a3b6c463e9 admin admin] PATH_INFO: `/v3/users/b387b31669c54b569323cfe5bbf4ead7` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:34.939306 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecc5a3-eddc-48d4-b18c-08a3b6c463e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b387b31669c54b569323cfe5bbf4ead7)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:34.941329 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecc5a3-eddc-48d4-b18c-08a3b6c463e9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:34.966821 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:47:35.000226 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c2ecc5a3-eddc-48d4-b18c-08a3b6c463e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b387b31669c54b569323cfe5bbf4ead7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:47:35.010087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c2ecc5a3-eddc-48d4-b18c-08a3b6c463e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b387b31669c54b569323cfe5bbf4ead7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:47:35.021234 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c2ecc5a3-eddc-48d4-b18c-08a3b6c463e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b387b31669c54b569323cfe5bbf4ead7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:47:35.022368 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c2ecc5a3-eddc-48d4-b18c-08a3b6c463e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b387b31669c54b569323cfe5bbf4ead7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:47:35.023560 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c2ecc5a3-eddc-48d4-b18c-08a3b6c463e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b387b31669c54b569323cfe5bbf4ead7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:47:35.049340 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1423/2806] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:47:34 2022] DELETE /identity/v3/users/b387b31669c54b569323cfe5bbf4ead7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:47:35.272661 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3902d-c6b6-4267-a8d4-cd18cccc149d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:35.276256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a9d3902d-c6b6-4267-a8d4-cd18cccc149d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:47:35.295257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3902d-c6b6-4267-a8d4-cd18cccc149d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:35.374377 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446f652-a8f6-4141-8024-b3ebf8a502a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:35.375173 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446f652-a8f6-4141-8024-b3ebf8a502a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:35.375473 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446f652-a8f6-4141-8024-b3ebf8a502a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:35.375752 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446f652-a8f6-4141-8024-b3ebf8a502a4 admin admin] PATH_INFO: `/v3/projects/7cdb67485a784528ae46addff2cc0892` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:35.377099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446f652-a8f6-4141-8024-b3ebf8a502a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cdb67485a784528ae46addff2cc0892)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:35.379084 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446f652-a8f6-4141-8024-b3ebf8a502a4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:35.422557 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:47:35.449637 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f446f652-a8f6-4141-8024-b3ebf8a502a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cdb67485a784528ae46addff2cc0892', 'request_id': 'req-f446f652-a8f6-4141-8024-b3ebf8a502a4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:47:35.460705 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f446f652-a8f6-4141-8024-b3ebf8a502a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cdb67485a784528ae46addff2cc0892', 'request_id': 'req-f446f652-a8f6-4141-8024-b3ebf8a502a4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:47:35.468640 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f446f652-a8f6-4141-8024-b3ebf8a502a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cdb67485a784528ae46addff2cc0892', 'request_id': 'req-f446f652-a8f6-4141-8024-b3ebf8a502a4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:47:35.484354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f446f652-a8f6-4141-8024-b3ebf8a502a4 admin admin] The token cache is being invalidate because project 7cdb67485a784528ae46addff2cc0892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:47:35.484962 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f446f652-a8f6-4141-8024-b3ebf8a502a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:47:35.485750 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f446f652-a8f6-4141-8024-b3ebf8a502a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:47:35.487793 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1384/2807] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:47:35 2022] DELETE /identity/v3/projects/7cdb67485a784528ae46addff2cc0892 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:47:35.493349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48cc24-b076-464a-ae0a-f1be6bc9d9c5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:35.494156 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48cc24-b076-464a-ae0a-f1be6bc9d9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:35.494314 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48cc24-b076-464a-ae0a-f1be6bc9d9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:35.521504 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7e48cc24-b076-464a-ae0a-f1be6bc9d9c5 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:47:35.522759 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7e48cc24-b076-464a-ae0a-f1be6bc9d9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:47:35.604170 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1424/2808] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:47:35.613288 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14cdaf-b11a-4e2f-ad3d-ef2d2f514f1a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:35.613627 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14cdaf-b11a-4e2f-ad3d-ef2d2f514f1a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:35.613952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14cdaf-b11a-4e2f-ad3d-ef2d2f514f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:35.634129 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ff14cdaf-b11a-4e2f-ad3d-ef2d2f514f1a None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:47:35.635286 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ff14cdaf-b11a-4e2f-ad3d-ef2d2f514f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:47:35.643700 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1385/2809] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:47:35.648560 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48cc24-b076-464a-ae0a-f1be6bc9d9c5 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:35.659397 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48cc24-b076-464a-ae0a-f1be6bc9d9c5 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:35.664900 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086948a-2f1a-434d-9bbd-0136d819418f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:35.665561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086948a-2f1a-434d-9bbd-0136d819418f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:35.665837 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086948a-2f1a-434d-9bbd-0136d819418f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:35.666104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086948a-2f1a-434d-9bbd-0136d819418f admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:35.666861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086948a-2f1a-434d-9bbd-0136d819418f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:47:35.667152 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086948a-2f1a-434d-9bbd-0136d819418f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:35.668844 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086948a-2f1a-434d-9bbd-0136d819418f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:35.683519 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1425/2810] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:47:35.688478 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14cdaf-b11a-4e2f-ad3d-ef2d2f514f1a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:35.699166 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14cdaf-b11a-4e2f-ad3d-ef2d2f514f1a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:35.704610 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e0fd2-4b88-4e0b-9a44-2e46e6efe6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:35.705628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e0fd2-4b88-4e0b-9a44-2e46e6efe6de admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:35.705947 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e0fd2-4b88-4e0b-9a44-2e46e6efe6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:35.706281 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e0fd2-4b88-4e0b-9a44-2e46e6efe6de admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:35.707147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e0fd2-4b88-4e0b-9a44-2e46e6efe6de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:35.709330 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e0fd2-4b88-4e0b-9a44-2e46e6efe6de admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:35.742413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1386/2811] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:47:35 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:47:35.748053 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086948a-2f1a-434d-9bbd-0136d819418f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:35.759272 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086948a-2f1a-434d-9bbd-0136d819418f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:35.828914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b106514-f78e-47a7-95a2-7f1543ef7664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:35.829787 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b106514-f78e-47a7-95a2-7f1543ef7664 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:35.830259 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b106514-f78e-47a7-95a2-7f1543ef7664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:35.830779 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b106514-f78e-47a7-95a2-7f1543ef7664 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:35.831685 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b106514-f78e-47a7-95a2-7f1543ef7664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:35.833988 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b106514-f78e-47a7-95a2-7f1543ef7664 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:35.858291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1426/2812] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:47:35 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:47:35.862897 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e0fd2-4b88-4e0b-9a44-2e46e6efe6de admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:35.875168 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e0fd2-4b88-4e0b-9a44-2e46e6efe6de admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:35.881126 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471193c-a2e3-4b54-b88e-f857ae37b7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:35.881967 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471193c-a2e3-4b54-b88e-f857ae37b7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:35.882345 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471193c-a2e3-4b54-b88e-f857ae37b7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:35.882737 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471193c-a2e3-4b54-b88e-f857ae37b7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:35.883633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471193c-a2e3-4b54-b88e-f857ae37b7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:35.885645 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471193c-a2e3-4b54-b88e-f857ae37b7c9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:35.899510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1387/2813] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:47:35.903993 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b106514-f78e-47a7-95a2-7f1543ef7664 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:35.918308 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b106514-f78e-47a7-95a2-7f1543ef7664 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:35.925491 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09a47f-e1ec-4056-9e98-07f421a7111c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:35.926187 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09a47f-e1ec-4056-9e98-07f421a7111c admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:35.926463 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09a47f-e1ec-4056-9e98-07f421a7111c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:35.926732 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09a47f-e1ec-4056-9e98-07f421a7111c admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:35.927490 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09a47f-e1ec-4056-9e98-07f421a7111c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:35.929188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09a47f-e1ec-4056-9e98-07f421a7111c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:35.940810 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1427/2814] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:47:35.946465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471193c-a2e3-4b54-b88e-f857ae37b7c9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:35.964907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471193c-a2e3-4b54-b88e-f857ae37b7c9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:35.973019 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba3fa1-36ff-41c1-a3b7-f59352072060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:35.974619 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba3fa1-36ff-41c1-a3b7-f59352072060 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:35.975138 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba3fa1-36ff-41c1-a3b7-f59352072060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:35.975662 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba3fa1-36ff-41c1-a3b7-f59352072060 admin admin] PATH_INFO: `/v3/projects/49e1d35e234b43aeaeb993b7a8b46a01/users/92eb324dac064292bb16bc1c551f252a/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:36.004420 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba3fa1-36ff-41c1-a3b7-f59352072060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e1d35e234b43aeaeb993b7a8b46a01, user_id=92eb324dac064292bb16bc1c551f252a, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:36.009946 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba3fa1-36ff-41c1-a3b7-f59352072060 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:36.032486 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1388/2815] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:47:35 2022] PUT /identity/v3/projects/49e1d35e234b43aeaeb993b7a8b46a01/users/92eb324dac064292bb16bc1c551f252a/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:47:36.039259 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8778d1-09f5-4e27-9796-cfcd934fab86 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:36.039704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8778d1-09f5-4e27-9796-cfcd934fab86 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:36.040128 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8778d1-09f5-4e27-9796-cfcd934fab86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:36.050809 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:47:36.070971 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9d8778d1-09f5-4e27-9796-cfcd934fab86 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:47:36.090432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9d8778d1-09f5-4e27-9796-cfcd934fab86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:47:36.208291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1428/2816] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:47:36.219126 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba3fa1-36ff-41c1-a3b7-f59352072060 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:36.221265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-19ba3fa1-36ff-41c1-a3b7-f59352072060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:47:36.313491 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba3fa1-36ff-41c1-a3b7-f59352072060 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:36.318319 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd441e0b-89f1-4f2b-afdb-9b8a950d6d49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:36.319220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd441e0b-89f1-4f2b-afdb-9b8a950d6d49 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:36.319639 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd441e0b-89f1-4f2b-afdb-9b8a950d6d49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:36.320007 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd441e0b-89f1-4f2b-afdb-9b8a950d6d49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:36.332441 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd441e0b-89f1-4f2b-afdb-9b8a950d6d49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:36.334782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd441e0b-89f1-4f2b-afdb-9b8a950d6d49 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:36.349308 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1389/2817] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:47:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:47:41.459971 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3518c71-9ff7-46a1-ba01-9c66c265fd09 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:41.460509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3518c71-9ff7-46a1-ba01-9c66c265fd09 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:41.461254 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3518c71-9ff7-46a1-ba01-9c66c265fd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:41.508763 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e3518c71-9ff7-46a1-ba01-9c66c265fd09 None None] MFA Rules not processed for user `92eb324dac064292bb16bc1c551f252a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:47:41.510160 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e3518c71-9ff7-46a1-ba01-9c66c265fd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:47:41.625394 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1429/2818] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:47:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:47:41.632231 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd441e0b-89f1-4f2b-afdb-9b8a950d6d49 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:41.665098 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd441e0b-89f1-4f2b-afdb-9b8a950d6d49 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:41.673467 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c6e11-bfb9-4a60-95c6-86571cfac8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:41.674883 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c6e11-bfb9-4a60-95c6-86571cfac8cc admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:41.675447 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c6e11-bfb9-4a60-95c6-86571cfac8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:41.675927 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c6e11-bfb9-4a60-95c6-86571cfac8cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:41.677154 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c6e11-bfb9-4a60-95c6-86571cfac8cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:41.680159 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c6e11-bfb9-4a60-95c6-86571cfac8cc admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:41.728971 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1390/2819] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:47:41 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:47:41.735297 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3518c71-9ff7-46a1-ba01-9c66c265fd09 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:41.755789 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3518c71-9ff7-46a1-ba01-9c66c265fd09 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:41.860657 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe40376-c73f-4f53-9a28-461a208ce25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:41.861557 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe40376-c73f-4f53-9a28-461a208ce25c admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:41.861954 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe40376-c73f-4f53-9a28-461a208ce25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:41.862450 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe40376-c73f-4f53-9a28-461a208ce25c admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:41.863451 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe40376-c73f-4f53-9a28-461a208ce25c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:41.865970 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe40376-c73f-4f53-9a28-461a208ce25c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:41.891886 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1430/2820] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:47:41 2022] POST /identity/v3/users => generated 299 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:47:41.896418 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c6e11-bfb9-4a60-95c6-86571cfac8cc admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:41.907958 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c6e11-bfb9-4a60-95c6-86571cfac8cc admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:41.913458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf8bef-76c2-4871-b502-fc38629afce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:41.914665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf8bef-76c2-4871-b502-fc38629afce6 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:41.915094 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf8bef-76c2-4871-b502-fc38629afce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:41.915481 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf8bef-76c2-4871-b502-fc38629afce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:41.916667 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf8bef-76c2-4871-b502-fc38629afce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:41.918633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf8bef-76c2-4871-b502-fc38629afce6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:41.934519 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1391/2821] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:47:41.939382 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe40376-c73f-4f53-9a28-461a208ce25c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:41.953998 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe40376-c73f-4f53-9a28-461a208ce25c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:41.962369 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3980e-7d6a-44f6-8511-03383872c5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:41.963851 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3980e-7d6a-44f6-8511-03383872c5d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:41.964350 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3980e-7d6a-44f6-8511-03383872c5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:41.964895 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3980e-7d6a-44f6-8511-03383872c5d9 admin admin] PATH_INFO: `/v3/projects/fc7e4874457345f3a80acfa9b5db8110/users/be3a66ca16f24413be514018fa982d2c/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:41.993165 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3980e-7d6a-44f6-8511-03383872c5d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7e4874457345f3a80acfa9b5db8110, user_id=be3a66ca16f24413be514018fa982d2c, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:41.997155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3980e-7d6a-44f6-8511-03383872c5d9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:42.011787 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:47:42.019688 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1431/2822] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:47:41 2022] PUT /identity/v3/projects/fc7e4874457345f3a80acfa9b5db8110/users/be3a66ca16f24413be514018fa982d2c/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:47:42.024968 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf8bef-76c2-4871-b502-fc38629afce6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:42.037735 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf8bef-76c2-4871-b502-fc38629afce6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:42.067536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:47:42.113244 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f661c25-c082-4b7a-aac1-beb7ed059f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:42.114267 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f661c25-c082-4b7a-aac1-beb7ed059f9f admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:42.114798 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f661c25-c082-4b7a-aac1-beb7ed059f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:42.115258 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f661c25-c082-4b7a-aac1-beb7ed059f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:42.116340 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f661c25-c082-4b7a-aac1-beb7ed059f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:42.119141 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f661c25-c082-4b7a-aac1-beb7ed059f9f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:42.133124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1392/2823] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:47:42.137633 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3980e-7d6a-44f6-8511-03383872c5d9 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:42.149639 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3980e-7d6a-44f6-8511-03383872c5d9 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:42.156027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ff953-4ebc-4fa3-af7a-8521b54a6218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:42.157196 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ff953-4ebc-4fa3-af7a-8521b54a6218 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:42.157484 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ff953-4ebc-4fa3-af7a-8521b54a6218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:42.157759 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ff953-4ebc-4fa3-af7a-8521b54a6218 admin admin] PATH_INFO: `/v3/projects/fc7e4874457345f3a80acfa9b5db8110/users/be3a66ca16f24413be514018fa982d2c/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:42.160229 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ff953-4ebc-4fa3-af7a-8521b54a6218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7e4874457345f3a80acfa9b5db8110, user_id=be3a66ca16f24413be514018fa982d2c, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:42.163007 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ff953-4ebc-4fa3-af7a-8521b54a6218 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:42.179059 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1432/2824] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:47:42 2022] PUT /identity/v3/projects/fc7e4874457345f3a80acfa9b5db8110/users/be3a66ca16f24413be514018fa982d2c/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:47:47.995329 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb184b-c4d1-48e2-82c8-b5b2d8a6c1c6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:47.996002 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb184b-c4d1-48e2-82c8-b5b2d8a6c1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:47.996002 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb184b-c4d1-48e2-82c8-b5b2d8a6c1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:48.027011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-76eb184b-c4d1-48e2-82c8-b5b2d8a6c1c6 None None] MFA Rules not processed for user `be3a66ca16f24413be514018fa982d2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:47:48.028268 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-76eb184b-c4d1-48e2-82c8-b5b2d8a6c1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:47:48.123201 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1393/2825] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:47:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:47:48.136272 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ff953-4ebc-4fa3-af7a-8521b54a6218 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:48.138242 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-150ff953-4ebc-4fa3-af7a-8521b54a6218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:47:48.267263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ff953-4ebc-4fa3-af7a-8521b54a6218 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:48.272220 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7d8d3-558d-4989-bb93-548299cdd04d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bcfbee5a5e4016a77901d0a637da63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:48.272895 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7d8d3-558d-4989-bb93-548299cdd04d service glance] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:48.273122 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7d8d3-558d-4989-bb93-548299cdd04d service glance] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:48.273396 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7d8d3-558d-4989-bb93-548299cdd04d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:48.342565 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7d8d3-558d-4989-bb93-548299cdd04d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:48.343954 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7d8d3-558d-4989-bb93-548299cdd04d service glance] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:48.354319 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1433/2826] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:47:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:47:48.539407 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037d987-dcae-4fd8-a237-3ac4543494b6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:48.539854 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037d987-dcae-4fd8-a237-3ac4543494b6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:48.540287 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037d987-dcae-4fd8-a237-3ac4543494b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:48.604319 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6037d987-dcae-4fd8-a237-3ac4543494b6 None None] MFA Rules not processed for user `654631b067b94b269f93ea7b3977609d`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:47:48.605617 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6037d987-dcae-4fd8-a237-3ac4543494b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:47:48.726494 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1394/2827] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 19 11:47:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:47:48.790773 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7d8d3-558d-4989-bb93-548299cdd04d service glance] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:48.793577 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2ff7d8d3-558d-4989-bb93-548299cdd04d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:47:48.939734 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:47:48.943532 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7d8d3-558d-4989-bb93-548299cdd04d service glance] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:48.952556 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f643947-9a4b-4fdd-a0ca-44e59eaf23ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa6a9aa611640f893b5e717a094acf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:48.953313 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f643947-9a4b-4fdd-a0ca-44e59eaf23ef service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:48.953594 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f643947-9a4b-4fdd-a0ca-44e59eaf23ef service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:48.953871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f643947-9a4b-4fdd-a0ca-44e59eaf23ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:48.970150 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f643947-9a4b-4fdd-a0ca-44e59eaf23ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:48.973314 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f643947-9a4b-4fdd-a0ca-44e59eaf23ef service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:48.990544 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1434/2828] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 19 11:47:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:47:58.722939 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:47:58.983696 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:47:59.274766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d4011-61b6-4922-af74-1a4af6672464 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:59.275071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d4011-61b6-4922-af74-1a4af6672464 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:59.275318 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d4011-61b6-4922-af74-1a4af6672464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:59.294906 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a78d4011-61b6-4922-af74-1a4af6672464 None None] MFA Rules not processed for user `92eb324dac064292bb16bc1c551f252a`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:47:59.296156 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a78d4011-61b6-4922-af74-1a4af6672464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:47:59.304504 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1395/2829] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:47:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:48:02.012798 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04965379-e750-49b3-8837-739b8b19483a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:02.013454 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04965379-e750-49b3-8837-739b8b19483a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:02.013454 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04965379-e750-49b3-8837-739b8b19483a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:02.043612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-04965379-e750-49b3-8837-739b8b19483a None None] MFA Rules not processed for user `654631b067b94b269f93ea7b3977609d`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:48:02.046113 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-04965379-e750-49b3-8837-739b8b19483a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:48:02.059519 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1435/2830] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 19 11:48:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:48:02.085165 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d4011-61b6-4922-af74-1a4af6672464 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:48:02.099913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d4011-61b6-4922-af74-1a4af6672464 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:48:02.106437 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f49d9-d7f0-4a6d-8fd1-548f0d1eb852 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa6a9aa611640f893b5e717a094acf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:48:02.107127 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f49d9-d7f0-4a6d-8fd1-548f0d1eb852 service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:02.107577 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f49d9-d7f0-4a6d-8fd1-548f0d1eb852 service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:02.107855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f49d9-d7f0-4a6d-8fd1-548f0d1eb852 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:02.118258 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f49d9-d7f0-4a6d-8fd1-548f0d1eb852 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:48:02.119922 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f49d9-d7f0-4a6d-8fd1-548f0d1eb852 service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:48:02.133683 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1396/2831] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 19 11:48:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:48:12.035619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:48:12.129098 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=9 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:48:41.049095 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04965379-e750-49b3-8837-739b8b19483a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:48:41.051281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-04965379-e750-49b3-8837-739b8b19483a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:48:41.125287 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04965379-e750-49b3-8837-739b8b19483a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:48:41.130161 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecb197-4aca-4af2-a139-42ce8595a0fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:48:41.130898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecb197-4aca-4af2-a139-42ce8595a0fe service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:41.131181 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecb197-4aca-4af2-a139-42ce8595a0fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:41.131456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecb197-4aca-4af2-a139-42ce8595a0fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:41.142977 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdecb197-4aca-4af2-a139-42ce8595a0fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:48:41.144904 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdecb197-4aca-4af2-a139-42ce8595a0fe service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:48:41.156863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1436/2832] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:48:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:48:51.151704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=26 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:54.059376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f49d9-d7f0-4a6d-8fd1-548f0d1eb852 service swift] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:54.061071 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f31f49d9-d7f0-4a6d-8fd1-548f0d1eb852 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:54.148954 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f49d9-d7f0-4a6d-8fd1-548f0d1eb852 service swift] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:54.154557 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf55f4a-98be-4b14-b45f-bf6d1169762f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:54.155272 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf55f4a-98be-4b14-b45f-bf6d1169762f service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:54.155558 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf55f4a-98be-4b14-b45f-bf6d1169762f service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:54.155835 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf55f4a-98be-4b14-b45f-bf6d1169762f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:54.157800 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4cf55f4a-98be-4b14-b45f-bf6d1169762f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:54.170601 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf55f4a-98be-4b14-b45f-bf6d1169762f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:54.172580 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf55f4a-98be-4b14-b45f-bf6d1169762f service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:54.183193 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1397/2833] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:49:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:50:04.178652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=37 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:50:55.703525 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecb197-4aca-4af2-a139-42ce8595a0fe service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:50:55.715917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecb197-4aca-4af2-a139-42ce8595a0fe service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:50:55.720378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c037c4-efa4-458a-9cb6-4e15c3a5f482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:50:55.721383 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c037c4-efa4-458a-9cb6-4e15c3a5f482 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:55.721673 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c037c4-efa4-458a-9cb6-4e15c3a5f482 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:55.721941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c037c4-efa4-458a-9cb6-4e15c3a5f482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:55.724068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-38c037c4-efa4-458a-9cb6-4e15c3a5f482 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:50:55.840385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c037c4-efa4-458a-9cb6-4e15c3a5f482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:50:55.842603 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c037c4-efa4-458a-9cb6-4e15c3a5f482 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:50:55.858596 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1437/2834] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:50:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:50:57.095623 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf55f4a-98be-4b14-b45f-bf6d1169762f service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:50:57.113407 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf55f4a-98be-4b14-b45f-bf6d1169762f service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:50:57.119694 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21120254-aa36-413a-b85a-6c0cba3db0ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:50:57.120844 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21120254-aa36-413a-b85a-6c0cba3db0ae service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:57.121302 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21120254-aa36-413a-b85a-6c0cba3db0ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:57.121769 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21120254-aa36-413a-b85a-6c0cba3db0ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:57.124979 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-21120254-aa36-413a-b85a-6c0cba3db0ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:50:57.143465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21120254-aa36-413a-b85a-6c0cba3db0ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:50:57.144962 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21120254-aa36-413a-b85a-6c0cba3db0ae service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:50:57.168548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1398/2835] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:50:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:51:05.852926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=34 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:51:07.153054 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:51:56.763602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c037c4-efa4-458a-9cb6-4e15c3a5f482 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:56.773838 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c037c4-efa4-458a-9cb6-4e15c3a5f482 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:56.779475 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89300d16-e265-42dd-9fdf-249d40d02ded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:56.780165 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89300d16-e265-42dd-9fdf-249d40d02ded service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:56.780446 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89300d16-e265-42dd-9fdf-249d40d02ded service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:56.780738 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89300d16-e265-42dd-9fdf-249d40d02ded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:56.782980 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-89300d16-e265-42dd-9fdf-249d40d02ded service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:56.795478 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89300d16-e265-42dd-9fdf-249d40d02ded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:56.797026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89300d16-e265-42dd-9fdf-249d40d02ded service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:56.806784 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1438/2836] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:51:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:52:06.802492 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:43.149376 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21120254-aa36-413a-b85a-6c0cba3db0ae service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:43.158395 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-21120254-aa36-413a-b85a-6c0cba3db0ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:43.197367 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21120254-aa36-413a-b85a-6c0cba3db0ae service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:43.215837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4f30b-c504-4403-8cb4-6ec1a0bf0d65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:43.220766 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4f30b-c504-4403-8cb4-6ec1a0bf0d65 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:43.221602 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4f30b-c504-4403-8cb4-6ec1a0bf0d65 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:43.222334 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4f30b-c504-4403-8cb4-6ec1a0bf0d65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:43.226293 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-96f4f30b-c504-4403-8cb4-6ec1a0bf0d65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:43.258090 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4f30b-c504-4403-8cb4-6ec1a0bf0d65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:43.262594 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4f30b-c504-4403-8cb4-6ec1a0bf0d65 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:43.298390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1399/2837] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:52:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:52:48.410788 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89300d16-e265-42dd-9fdf-249d40d02ded service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:48.428440 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89300d16-e265-42dd-9fdf-249d40d02ded service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:48.435983 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2a2e6-4ab9-4edd-b475-396dd2c09657 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:48.436831 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2a2e6-4ab9-4edd-b475-396dd2c09657 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:48.437151 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2a2e6-4ab9-4edd-b475-396dd2c09657 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:48.437460 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2a2e6-4ab9-4edd-b475-396dd2c09657 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:48.450194 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2a2e6-4ab9-4edd-b475-396dd2c09657 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:48.451980 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2a2e6-4ab9-4edd-b475-396dd2c09657 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:48.463700 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1439/2838] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:52:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:52:53.277150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:58.458714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:59.360571 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0614ca-11f9-4721-8278-2575cf5ebb3f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:59.361261 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0614ca-11f9-4721-8278-2575cf5ebb3f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:59.361261 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0614ca-11f9-4721-8278-2575cf5ebb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:59.383015 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fa0614ca-11f9-4721-8278-2575cf5ebb3f None None] MFA Rules not processed for user `654631b067b94b269f93ea7b3977609d`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:52:59.384400 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fa0614ca-11f9-4721-8278-2575cf5ebb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:59.393508 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1400/2839] 10.222.0.18 () {58 vars in 967 bytes} [Tue Jul 19 11:52:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:52:59.460676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2a2e6-4ab9-4edd-b475-396dd2c09657 service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:59.472967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2a2e6-4ab9-4edd-b475-396dd2c09657 service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:59.478314 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521676ea-46f3-4f01-8d7b-6317ae726f9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa6a9aa611640f893b5e717a094acf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:59.478992 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521676ea-46f3-4f01-8d7b-6317ae726f9a service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:59.479274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521676ea-46f3-4f01-8d7b-6317ae726f9a service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:59.479546 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521676ea-46f3-4f01-8d7b-6317ae726f9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:59.490713 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521676ea-46f3-4f01-8d7b-6317ae726f9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:59.492843 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521676ea-46f3-4f01-8d7b-6317ae726f9a service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:59.503715 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1440/2840] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 19 11:52:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:53:00.078177 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261c607-1598-4491-8bd6-23029a5da1ec None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:00.078483 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261c607-1598-4491-8bd6-23029a5da1ec None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:00.078730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261c607-1598-4491-8bd6-23029a5da1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:00.100303 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b261c607-1598-4491-8bd6-23029a5da1ec None None] MFA Rules not processed for user `654631b067b94b269f93ea7b3977609d`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:53:00.102190 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b261c607-1598-4491-8bd6-23029a5da1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:00.109887 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1401/2841] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 19 11:53:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:53:00.126758 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521676ea-46f3-4f01-8d7b-6317ae726f9a service swift] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:00.140508 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521676ea-46f3-4f01-8d7b-6317ae726f9a service swift] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:00.147664 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6bdb6-354c-414a-837d-75bc1227060c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa6a9aa611640f893b5e717a094acf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:00.148477 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6bdb6-354c-414a-837d-75bc1227060c service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:00.148994 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6bdb6-354c-414a-837d-75bc1227060c service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:00.149390 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6bdb6-354c-414a-837d-75bc1227060c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:00.160159 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6bdb6-354c-414a-837d-75bc1227060c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:00.161863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6bdb6-354c-414a-837d-75bc1227060c service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:00.171749 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1441/2842] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 19 11:53:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:53:10.093416 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:53:10.167635 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=12 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:53:10.332283 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0cbbc-5a63-47b5-b603-010d88d7a8b6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:10.332812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0cbbc-5a63-47b5-b603-010d88d7a8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:10.333206 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0cbbc-5a63-47b5-b603-010d88d7a8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:10.488102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3cd0cbbc-5a63-47b5-b603-010d88d7a8b6 None None] MFA Rules not processed for user `92eb324dac064292bb16bc1c551f252a`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:53:10.489418 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3cd0cbbc-5a63-47b5-b603-010d88d7a8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:10.497849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1402/2843] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:53:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:53:10.808885 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6bdb6-354c-414a-837d-75bc1227060c service swift] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:10.819967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6bdb6-354c-414a-837d-75bc1227060c service swift] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:10.824587 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbec81b-3fda-4f03-8094-9ac5c2a1c9fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:10.825311 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbec81b-3fda-4f03-8094-9ac5c2a1c9fd service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:10.825596 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbec81b-3fda-4f03-8094-9ac5c2a1c9fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:10.825868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbec81b-3fda-4f03-8094-9ac5c2a1c9fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:10.828127 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4cbec81b-3fda-4f03-8094-9ac5c2a1c9fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:10.839586 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbec81b-3fda-4f03-8094-9ac5c2a1c9fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:10.841164 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbec81b-3fda-4f03-8094-9ac5c2a1c9fd service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:10.851074 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1442/2844] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:53:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:53:11.226584 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0cbbc-5a63-47b5-b603-010d88d7a8b6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:11.228778 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3cd0cbbc-5a63-47b5-b603-010d88d7a8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:11.251501 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0cbbc-5a63-47b5-b603-010d88d7a8b6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:11.256822 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bd591-191c-4b39-89fe-baa8a05cc507 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:11.257496 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bd591-191c-4b39-89fe-baa8a05cc507 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:11.257777 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bd591-191c-4b39-89fe-baa8a05cc507 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:11.258052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bd591-191c-4b39-89fe-baa8a05cc507 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:11.260056 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-603bd591-191c-4b39-89fe-baa8a05cc507 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:11.280053 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bd591-191c-4b39-89fe-baa8a05cc507 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:11.281862 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bd591-191c-4b39-89fe-baa8a05cc507 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:11.293855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1403/2845] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:53:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:53:12.640805 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38603286-8b81-4da1-9702-d37ad807cbca None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:12.641459 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38603286-8b81-4da1-9702-d37ad807cbca None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:12.641758 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38603286-8b81-4da1-9702-d37ad807cbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:12.671246 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-38603286-8b81-4da1-9702-d37ad807cbca None None] MFA Rules not processed for user `654631b067b94b269f93ea7b3977609d`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:53:12.673584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-38603286-8b81-4da1-9702-d37ad807cbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:12.686598 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1443/2846] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 19 11:53:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:53:12.713079 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bd591-191c-4b39-89fe-baa8a05cc507 service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:12.725561 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bd591-191c-4b39-89fe-baa8a05cc507 service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:12.731923 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b60bba-32bc-4739-bd7f-918af533f15a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa6a9aa611640f893b5e717a094acf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:12.732609 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b60bba-32bc-4739-bd7f-918af533f15a service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:12.732936 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b60bba-32bc-4739-bd7f-918af533f15a service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:12.733205 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b60bba-32bc-4739-bd7f-918af533f15a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:12.743164 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b60bba-32bc-4739-bd7f-918af533f15a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:12.744963 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b60bba-32bc-4739-bd7f-918af533f15a service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:12.754886 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1404/2847] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 19 11:53:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 11:53:22.663290 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=9 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:53:22.751594 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=15 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:53:29.469575 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38603286-8b81-4da1-9702-d37ad807cbca None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:29.488334 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38603286-8b81-4da1-9702-d37ad807cbca None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:29.495497 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76613101-51f3-41b1-9f89-d87502340775 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:29.496499 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76613101-51f3-41b1-9f89-d87502340775 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:29.497008 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76613101-51f3-41b1-9f89-d87502340775 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:29.497493 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76613101-51f3-41b1-9f89-d87502340775 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:29.499899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-76613101-51f3-41b1-9f89-d87502340775 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:29.513235 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76613101-51f3-41b1-9f89-d87502340775 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:29.515205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76613101-51f3-41b1-9f89-d87502340775 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:29.529138 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1444/2848] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:53:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:53:39.523553 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:53:46.379803 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b60bba-32bc-4739-bd7f-918af533f15a service swift] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:46.390224 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b60bba-32bc-4739-bd7f-918af533f15a service swift] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:46.394124 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8b408-6fb9-4ebf-bc48-97b7b6d1fb0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:46.394776 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8b408-6fb9-4ebf-bc48-97b7b6d1fb0c service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:46.395058 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8b408-6fb9-4ebf-bc48-97b7b6d1fb0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:46.395332 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8b408-6fb9-4ebf-bc48-97b7b6d1fb0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:46.404927 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8b408-6fb9-4ebf-bc48-97b7b6d1fb0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:46.406539 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8b408-6fb9-4ebf-bc48-97b7b6d1fb0c service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:46.417434 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1405/2849] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:53:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:53:48.636253 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76613101-51f3-41b1-9f89-d87502340775 service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:48.650476 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76613101-51f3-41b1-9f89-d87502340775 service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:48.659634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ab52b-b68a-4faf-8a54-8bd3a3ff69b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:48.661440 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ab52b-b68a-4faf-8a54-8bd3a3ff69b9 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:48.662239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ab52b-b68a-4faf-8a54-8bd3a3ff69b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:48.662946 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ab52b-b68a-4faf-8a54-8bd3a3ff69b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:48.666310 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-192ab52b-b68a-4faf-8a54-8bd3a3ff69b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:48.691363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ab52b-b68a-4faf-8a54-8bd3a3ff69b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:48.694407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ab52b-b68a-4faf-8a54-8bd3a3ff69b9 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:48.715204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1445/2850] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:53:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:53:56.412528 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:53:58.707218 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:55:01.104320 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8b408-6fb9-4ebf-bc48-97b7b6d1fb0c service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:55:01.176970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8b408-6fb9-4ebf-bc48-97b7b6d1fb0c service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:55:01.182552 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629a731-ffaa-4b90-b5e5-24640ff16c6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:55:01.183227 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629a731-ffaa-4b90-b5e5-24640ff16c6c service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:55:01.183512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629a731-ffaa-4b90-b5e5-24640ff16c6c service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:55:01.183782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629a731-ffaa-4b90-b5e5-24640ff16c6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:55:01.194416 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629a731-ffaa-4b90-b5e5-24640ff16c6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:55:01.196041 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629a731-ffaa-4b90-b5e5-24640ff16c6c service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:55:01.208389 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1406/2851] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:55:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:55:11.202628 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=27 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:56:02.275344 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ab52b-b68a-4faf-8a54-8bd3a3ff69b9 service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:02.277582 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-192ab52b-b68a-4faf-8a54-8bd3a3ff69b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:56:02.373108 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ab52b-b68a-4faf-8a54-8bd3a3ff69b9 service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:02.377398 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7980946-746f-4c98-aa7f-f7c78281ace7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8112def59003484483552fc76f14e281', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:02.377991 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7980946-746f-4c98-aa7f-f7c78281ace7 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:02.378251 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7980946-746f-4c98-aa7f-f7c78281ace7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:02.378528 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7980946-746f-4c98-aa7f-f7c78281ace7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:02.391168 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7980946-746f-4c98-aa7f-f7c78281ace7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:02.392652 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7980946-746f-4c98-aa7f-f7c78281ace7 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:02.405516 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1446/2852] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:56:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:56:07.123257 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3419a-fc5e-4a38-bd0a-10cd1b27f59f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:07.123923 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3419a-fc5e-4a38-bd0a-10cd1b27f59f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:07.124093 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3419a-fc5e-4a38-bd0a-10cd1b27f59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:07.201688 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-12c3419a-fc5e-4a38-bd0a-10cd1b27f59f None None] MFA Rules not processed for user `07eaacc831ae481d99e8ab03ee295e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:56:07.202955 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-12c3419a-fc5e-4a38-bd0a-10cd1b27f59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:56:07.221197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1407/2853] 10.222.0.18 () {58 vars in 1062 bytes} [Tue Jul 19 11:56:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:56:07.227564 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7980946-746f-4c98-aa7f-f7c78281ace7 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:07.237428 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7980946-746f-4c98-aa7f-f7c78281ace7 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:07.241295 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f181b-5ca7-4ee1-a04a-fa922f14651c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:07.241945 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f181b-5ca7-4ee1-a04a-fa922f14651c service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:07.242351 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f181b-5ca7-4ee1-a04a-fa922f14651c service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:07.242655 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f181b-5ca7-4ee1-a04a-fa922f14651c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:07.263222 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f181b-5ca7-4ee1-a04a-fa922f14651c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:07.264702 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f181b-5ca7-4ee1-a04a-fa922f14651c service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:07.287815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1447/2854] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:56:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:56:09.806102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb009f5-2918-4ac1-8bd5-0070f9fd78d5 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:09.806613 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb009f5-2918-4ac1-8bd5-0070f9fd78d5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:09.806718 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb009f5-2918-4ac1-8bd5-0070f9fd78d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:09.828412 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-feb009f5-2918-4ac1-8bd5-0070f9fd78d5 None None] MFA Rules not processed for user `654631b067b94b269f93ea7b3977609d`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:56:09.829691 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-feb009f5-2918-4ac1-8bd5-0070f9fd78d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:56:09.837830 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1408/2855] 10.222.0.18 () {58 vars in 967 bytes} [Tue Jul 19 11:56:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:56:09.879865 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f181b-5ca7-4ee1-a04a-fa922f14651c service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:09.892845 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f181b-5ca7-4ee1-a04a-fa922f14651c service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:09.898186 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dec23b-4950-42f5-b8ae-5f36a6adcb99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa6a9aa611640f893b5e717a094acf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:09.898847 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dec23b-4950-42f5-b8ae-5f36a6adcb99 service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:09.899120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dec23b-4950-42f5-b8ae-5f36a6adcb99 service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:09.899389 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dec23b-4950-42f5-b8ae-5f36a6adcb99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:09.908600 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dec23b-4950-42f5-b8ae-5f36a6adcb99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:09.910216 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dec23b-4950-42f5-b8ae-5f36a6adcb99 service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:09.918683 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1448/2856] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 19 11:56:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:56:10.303844 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb009f5-2918-4ac1-8bd5-0070f9fd78d5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:10.313974 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb009f5-2918-4ac1-8bd5-0070f9fd78d5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:10.318027 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c1d58-6d67-4849-8de0-ab568eff1c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:10.318675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c1d58-6d67-4849-8de0-ab568eff1c60 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:10.318948 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c1d58-6d67-4849-8de0-ab568eff1c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:10.319215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c1d58-6d67-4849-8de0-ab568eff1c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:10.408171 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c1d58-6d67-4849-8de0-ab568eff1c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:10.409712 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c1d58-6d67-4849-8de0-ab568eff1c60 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:10.431929 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1409/2857] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:56:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:56:13.613546 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dec23b-4950-42f5-b8ae-5f36a6adcb99 service swift] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:13.626995 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dec23b-4950-42f5-b8ae-5f36a6adcb99 service swift] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:13.633509 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd2d75-f628-4870-b1b4-8897f3893790 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:13.634932 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd2d75-f628-4870-b1b4-8897f3893790 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:13.635272 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd2d75-f628-4870-b1b4-8897f3893790 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:13.635548 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd2d75-f628-4870-b1b4-8897f3893790 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:13.637676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fbbd2d75-f628-4870-b1b4-8897f3893790 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:56:13.652281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd2d75-f628-4870-b1b4-8897f3893790 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:13.654366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd2d75-f628-4870-b1b4-8897f3893790 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:13.669297 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1449/2858] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:56:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:56:17.581621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c1d58-6d67-4849-8de0-ab568eff1c60 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:17.593349 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c1d58-6d67-4849-8de0-ab568eff1c60 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:17.599355 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ee2c1-5d69-451e-9d0c-a5c9d897c9bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:17.600106 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ee2c1-5d69-451e-9d0c-a5c9d897c9bb service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:17.600785 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ee2c1-5d69-451e-9d0c-a5c9d897c9bb service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:17.601285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ee2c1-5d69-451e-9d0c-a5c9d897c9bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:17.603142 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dd7ee2c1-5d69-451e-9d0c-a5c9d897c9bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:56:17.615425 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ee2c1-5d69-451e-9d0c-a5c9d897c9bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:17.617697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ee2c1-5d69-451e-9d0c-a5c9d897c9bb service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:17.633213 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1410/2859] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:56:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:56:17.651665 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd2d75-f628-4870-b1b4-8897f3893790 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:17.663019 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd2d75-f628-4870-b1b4-8897f3893790 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:17.669674 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee8de2-63b0-40d4-b331-286e738e3867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:17.670762 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee8de2-63b0-40d4-b331-286e738e3867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:17.670906 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee8de2-63b0-40d4-b331-286e738e3867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:17.671543 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee8de2-63b0-40d4-b331-286e738e3867 admin admin] PATH_INFO: `/v3/users/92eb324dac064292bb16bc1c551f252a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:17.672745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee8de2-63b0-40d4-b331-286e738e3867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92eb324dac064292bb16bc1c551f252a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:17.674679 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee8de2-63b0-40d4-b331-286e738e3867 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:17.728459 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1bee8de2-63b0-40d4-b331-286e738e3867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92eb324dac064292bb16bc1c551f252a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:56:17.738808 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1bee8de2-63b0-40d4-b331-286e738e3867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92eb324dac064292bb16bc1c551f252a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:56:17.748463 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1bee8de2-63b0-40d4-b331-286e738e3867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92eb324dac064292bb16bc1c551f252a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:56:17.749231 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1bee8de2-63b0-40d4-b331-286e738e3867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92eb324dac064292bb16bc1c551f252a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:56:17.749877 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1bee8de2-63b0-40d4-b331-286e738e3867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92eb324dac064292bb16bc1c551f252a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:56:17.758950 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:56:17.771230 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1450/2860] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:56:17 2022] DELETE /identity/v3/users/92eb324dac064292bb16bc1c551f252a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:56:17.956266 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ee2c1-5d69-451e-9d0c-a5c9d897c9bb service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:17.968093 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ee2c1-5d69-451e-9d0c-a5c9d897c9bb service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:18.027369 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a7183-771e-48b3-ad6b-969cce25817d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:18.028251 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a7183-771e-48b3-ad6b-969cce25817d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:18.028562 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a7183-771e-48b3-ad6b-969cce25817d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:18.028937 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a7183-771e-48b3-ad6b-969cce25817d admin admin] PATH_INFO: `/v3/projects/49e1d35e234b43aeaeb993b7a8b46a01` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:18.030220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a7183-771e-48b3-ad6b-969cce25817d admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e1d35e234b43aeaeb993b7a8b46a01)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:18.032010 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a7183-771e-48b3-ad6b-969cce25817d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:18.033651 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:56:18.081107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3e5a7183-771e-48b3-ad6b-969cce25817d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e1d35e234b43aeaeb993b7a8b46a01', 'request_id': 'req-3e5a7183-771e-48b3-ad6b-969cce25817d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:56:18.090203 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3e5a7183-771e-48b3-ad6b-969cce25817d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e1d35e234b43aeaeb993b7a8b46a01', 'request_id': 'req-3e5a7183-771e-48b3-ad6b-969cce25817d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:56:18.095964 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3e5a7183-771e-48b3-ad6b-969cce25817d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e1d35e234b43aeaeb993b7a8b46a01', 'request_id': 'req-3e5a7183-771e-48b3-ad6b-969cce25817d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:56:18.120002 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3e5a7183-771e-48b3-ad6b-969cce25817d admin admin] The token cache is being invalidate because project 49e1d35e234b43aeaeb993b7a8b46a01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:56:18.120290 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3e5a7183-771e-48b3-ad6b-969cce25817d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:56:18.121075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3e5a7183-771e-48b3-ad6b-969cce25817d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:56:18.122711 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1411/2861] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:56:17 2022] DELETE /identity/v3/projects/49e1d35e234b43aeaeb993b7a8b46a01 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:56:18.126853 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee8de2-63b0-40d4-b331-286e738e3867 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:18.128453 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1bee8de2-63b0-40d4-b331-286e738e3867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:56:18.143434 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee8de2-63b0-40d4-b331-286e738e3867 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:18.207930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdef37e-484d-4b03-adc7-fdfebae46528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:18.207930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdef37e-484d-4b03-adc7-fdfebae46528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:18.207930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdef37e-484d-4b03-adc7-fdfebae46528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:18.207930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdef37e-484d-4b03-adc7-fdfebae46528 admin admin] PATH_INFO: `/v3/users/be3a66ca16f24413be514018fa982d2c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:18.210713 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdef37e-484d-4b03-adc7-fdfebae46528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be3a66ca16f24413be514018fa982d2c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:18.212655 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdef37e-484d-4b03-adc7-fdfebae46528 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:18.268581 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fbdef37e-484d-4b03-adc7-fdfebae46528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be3a66ca16f24413be514018fa982d2c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:56:18.277638 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fbdef37e-484d-4b03-adc7-fdfebae46528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be3a66ca16f24413be514018fa982d2c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:56:18.285877 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fbdef37e-484d-4b03-adc7-fdfebae46528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be3a66ca16f24413be514018fa982d2c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:56:18.286609 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fbdef37e-484d-4b03-adc7-fdfebae46528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be3a66ca16f24413be514018fa982d2c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:56:18.287321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fbdef37e-484d-4b03-adc7-fdfebae46528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be3a66ca16f24413be514018fa982d2c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:56:18.306159 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1451/2862] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 11:56:18 2022] DELETE /identity/v3/users/be3a66ca16f24413be514018fa982d2c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:56:18.496899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a7183-771e-48b3-ad6b-969cce25817d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:18.498553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3e5a7183-771e-48b3-ad6b-969cce25817d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:56:18.512968 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a7183-771e-48b3-ad6b-969cce25817d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:18.585695 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410f0a5-e64b-42f9-a6c4-8270e2558108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:18.586626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410f0a5-e64b-42f9-a6c4-8270e2558108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:18.586852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410f0a5-e64b-42f9-a6c4-8270e2558108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:18.587119 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410f0a5-e64b-42f9-a6c4-8270e2558108 admin admin] PATH_INFO: `/v3/projects/fc7e4874457345f3a80acfa9b5db8110` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:18.588872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410f0a5-e64b-42f9-a6c4-8270e2558108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc7e4874457345f3a80acfa9b5db8110)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:18.592122 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410f0a5-e64b-42f9-a6c4-8270e2558108 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:18.644452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f410f0a5-e64b-42f9-a6c4-8270e2558108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc7e4874457345f3a80acfa9b5db8110', 'request_id': 'req-f410f0a5-e64b-42f9-a6c4-8270e2558108'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:56:18.652745 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f410f0a5-e64b-42f9-a6c4-8270e2558108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc7e4874457345f3a80acfa9b5db8110', 'request_id': 'req-f410f0a5-e64b-42f9-a6c4-8270e2558108'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:56:18.658762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f410f0a5-e64b-42f9-a6c4-8270e2558108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc7e4874457345f3a80acfa9b5db8110', 'request_id': 'req-f410f0a5-e64b-42f9-a6c4-8270e2558108'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:56:18.671641 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f410f0a5-e64b-42f9-a6c4-8270e2558108 admin admin] The token cache is being invalidate because project fc7e4874457345f3a80acfa9b5db8110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:56:18.671930 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f410f0a5-e64b-42f9-a6c4-8270e2558108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:56:18.672662 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f410f0a5-e64b-42f9-a6c4-8270e2558108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:56:18.674341 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1412/2863] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 11:56:18 2022] DELETE /identity/v3/projects/fc7e4874457345f3a80acfa9b5db8110 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:56:18.679676 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407ff5b-fbce-4622-af31-72dcc535ad61 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:18.680188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407ff5b-fbce-4622-af31-72dcc535ad61 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:18.680282 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407ff5b-fbce-4622-af31-72dcc535ad61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:18.730297 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2407ff5b-fbce-4622-af31-72dcc535ad61 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:56:18.732275 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2407ff5b-fbce-4622-af31-72dcc535ad61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:56:18.789110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:56:18.809590 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1452/2864] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:56:18.817732 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39fed6-c3bb-4183-8cff-6462572ab840 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:18.818015 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39fed6-c3bb-4183-8cff-6462572ab840 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:18.818292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39fed6-c3bb-4183-8cff-6462572ab840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:18.840234 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6f39fed6-c3bb-4183-8cff-6462572ab840 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:56:18.841514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6f39fed6-c3bb-4183-8cff-6462572ab840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:56:18.850824 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1413/2865] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:56:18.855679 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407ff5b-fbce-4622-af31-72dcc535ad61 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:18.866017 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407ff5b-fbce-4622-af31-72dcc535ad61 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:18.871529 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd3ea2-ec4c-4351-90c5-ef6f17e8b14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:18.872232 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd3ea2-ec4c-4351-90c5-ef6f17e8b14a admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:18.872512 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd3ea2-ec4c-4351-90c5-ef6f17e8b14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:18.872815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd3ea2-ec4c-4351-90c5-ef6f17e8b14a admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:18.873545 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd3ea2-ec4c-4351-90c5-ef6f17e8b14a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:56:18.873873 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd3ea2-ec4c-4351-90c5-ef6f17e8b14a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:18.875511 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd3ea2-ec4c-4351-90c5-ef6f17e8b14a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:18.890504 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1453/2866] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 11:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:56:18.896297 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39fed6-c3bb-4183-8cff-6462572ab840 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:18.900746 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:56:18.907145 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39fed6-c3bb-4183-8cff-6462572ab840 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:18.913889 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19738d4-a7ac-4d22-aadb-5b8d863592cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:18.914581 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19738d4-a7ac-4d22-aadb-5b8d863592cc admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:18.914871 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19738d4-a7ac-4d22-aadb-5b8d863592cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:18.915150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19738d4-a7ac-4d22-aadb-5b8d863592cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:18.915867 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19738d4-a7ac-4d22-aadb-5b8d863592cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:18.918370 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19738d4-a7ac-4d22-aadb-5b8d863592cc admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:18.958016 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1414/2867] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:56:18 2022] POST /identity/v3/projects => generated 393 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:56:18.962976 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd3ea2-ec4c-4351-90c5-ef6f17e8b14a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:18.976959 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd3ea2-ec4c-4351-90c5-ef6f17e8b14a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:19.039343 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d875d5-a8c7-41e7-9f23-2c8bce0a4692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:19.040027 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d875d5-a8c7-41e7-9f23-2c8bce0a4692 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:19.040352 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d875d5-a8c7-41e7-9f23-2c8bce0a4692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:19.040584 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d875d5-a8c7-41e7-9f23-2c8bce0a4692 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:19.041302 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d875d5-a8c7-41e7-9f23-2c8bce0a4692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:19.043294 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d875d5-a8c7-41e7-9f23-2c8bce0a4692 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:19.063987 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1454/2868] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:56:18 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:56:19.068544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19738d4-a7ac-4d22-aadb-5b8d863592cc admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:19.080179 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19738d4-a7ac-4d22-aadb-5b8d863592cc admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:19.086599 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad1ece-15cb-4087-8c05-82a9514574fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:19.087365 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad1ece-15cb-4087-8c05-82a9514574fd admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:19.087645 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad1ece-15cb-4087-8c05-82a9514574fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:19.087983 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad1ece-15cb-4087-8c05-82a9514574fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:19.088907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad1ece-15cb-4087-8c05-82a9514574fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:19.090671 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad1ece-15cb-4087-8c05-82a9514574fd admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:19.102458 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1415/2869] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:56:19.106840 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d875d5-a8c7-41e7-9f23-2c8bce0a4692 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:19.117889 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d875d5-a8c7-41e7-9f23-2c8bce0a4692 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:19.123147 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ae620-c8b0-4e01-b625-2c3381f68727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:19.123816 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ae620-c8b0-4e01-b625-2c3381f68727 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:19.124138 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ae620-c8b0-4e01-b625-2c3381f68727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:19.124411 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ae620-c8b0-4e01-b625-2c3381f68727 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:19.125182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ae620-c8b0-4e01-b625-2c3381f68727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:19.126797 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ae620-c8b0-4e01-b625-2c3381f68727 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:19.138485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1455/2870] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:56:19.142919 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad1ece-15cb-4087-8c05-82a9514574fd admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:19.155184 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad1ece-15cb-4087-8c05-82a9514574fd admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:19.161493 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11395ab3-ea38-4a44-bfe6-bfb4649546d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:19.162740 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11395ab3-ea38-4a44-bfe6-bfb4649546d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:19.163015 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11395ab3-ea38-4a44-bfe6-bfb4649546d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:19.163425 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11395ab3-ea38-4a44-bfe6-bfb4649546d3 admin admin] PATH_INFO: `/v3/projects/b39ad0a67091427aa0efb1d1f141452e/users/0cc2f50a7b3d4c68b496f17b79ec9964/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:19.183902 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11395ab3-ea38-4a44-bfe6-bfb4649546d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b39ad0a67091427aa0efb1d1f141452e, user_id=0cc2f50a7b3d4c68b496f17b79ec9964, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:19.186575 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11395ab3-ea38-4a44-bfe6-bfb4649546d3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:19.207204 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1416/2871] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:56:19 2022] PUT /identity/v3/projects/b39ad0a67091427aa0efb1d1f141452e/users/0cc2f50a7b3d4c68b496f17b79ec9964/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:56:19.220816 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cd2d9-6add-418f-a3ae-e19c5423c14c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:19.221141 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cd2d9-6add-418f-a3ae-e19c5423c14c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:19.221413 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cd2d9-6add-418f-a3ae-e19c5423c14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:19.251042 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-802cd2d9-6add-418f-a3ae-e19c5423c14c None None] MFA Rules not processed for user `0cc2f50a7b3d4c68b496f17b79ec9964`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:56:19.252275 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-802cd2d9-6add-418f-a3ae-e19c5423c14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:56:19.327954 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1456/2872] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:56:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:56:19.332659 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11395ab3-ea38-4a44-bfe6-bfb4649546d3 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:19.402894 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11395ab3-ea38-4a44-bfe6-bfb4649546d3 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:19.408679 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac1b5a-ccbd-4b29-9178-872bba9623ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:19.409304 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac1b5a-ccbd-4b29-9178-872bba9623ca admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:19.409590 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac1b5a-ccbd-4b29-9178-872bba9623ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:19.409874 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac1b5a-ccbd-4b29-9178-872bba9623ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:19.410576 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac1b5a-ccbd-4b29-9178-872bba9623ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:19.412809 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac1b5a-ccbd-4b29-9178-872bba9623ca admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:19.442345 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1417/2873] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 11:56:19 2022] POST /identity/v3/projects => generated 391 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:56:19.446975 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cd2d9-6add-418f-a3ae-e19c5423c14c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:19.458321 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cd2d9-6add-418f-a3ae-e19c5423c14c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:19.501956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:56:19.519777 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c045ef-c4e2-47f6-aa2e-6f32901a1dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:19.520460 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c045ef-c4e2-47f6-aa2e-6f32901a1dea admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:19.520764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c045ef-c4e2-47f6-aa2e-6f32901a1dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:19.521050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c045ef-c4e2-47f6-aa2e-6f32901a1dea admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:19.521765 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c045ef-c4e2-47f6-aa2e-6f32901a1dea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:19.523741 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c045ef-c4e2-47f6-aa2e-6f32901a1dea admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:19.551120 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1457/2874] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 11:56:19 2022] POST /identity/v3/users => generated 302 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:56:19.555825 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac1b5a-ccbd-4b29-9178-872bba9623ca admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:19.573441 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac1b5a-ccbd-4b29-9178-872bba9623ca admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:19.579626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fe1dc-0a68-4405-953a-f97dfdc2c0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:19.580326 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fe1dc-0a68-4405-953a-f97dfdc2c0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:19.580609 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fe1dc-0a68-4405-953a-f97dfdc2c0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:19.580912 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fe1dc-0a68-4405-953a-f97dfdc2c0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:19.581641 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fe1dc-0a68-4405-953a-f97dfdc2c0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:19.583313 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fe1dc-0a68-4405-953a-f97dfdc2c0f8 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:19.596022 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1418/2875] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:56:19.601188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c045ef-c4e2-47f6-aa2e-6f32901a1dea admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:19.612328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c045ef-c4e2-47f6-aa2e-6f32901a1dea admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:19.618462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343f4a8-4694-4028-be4b-5065235e9f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:19.619395 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343f4a8-4694-4028-be4b-5065235e9f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:19.619646 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343f4a8-4694-4028-be4b-5065235e9f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:19.619924 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343f4a8-4694-4028-be4b-5065235e9f32 admin admin] PATH_INFO: `/v3/projects/91cf485d417b4bf5b9b96df0ecc72d7d/users/843675fca77a45ed80e82ed994f7e2f3/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:19.638186 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343f4a8-4694-4028-be4b-5065235e9f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91cf485d417b4bf5b9b96df0ecc72d7d, user_id=843675fca77a45ed80e82ed994f7e2f3, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:19.647558 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343f4a8-4694-4028-be4b-5065235e9f32 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:19.663522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1458/2876] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:56:19 2022] PUT /identity/v3/projects/91cf485d417b4bf5b9b96df0ecc72d7d/users/843675fca77a45ed80e82ed994f7e2f3/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:56:19.668401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fe1dc-0a68-4405-953a-f97dfdc2c0f8 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:19.679504 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fe1dc-0a68-4405-953a-f97dfdc2c0f8 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:19.737434 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49eb8d-4b54-43d0-b2db-770fba4f90bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:19.738117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49eb8d-4b54-43d0-b2db-770fba4f90bb admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:19.738473 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49eb8d-4b54-43d0-b2db-770fba4f90bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:19.738673 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49eb8d-4b54-43d0-b2db-770fba4f90bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:19.739398 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49eb8d-4b54-43d0-b2db-770fba4f90bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:19.741038 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49eb8d-4b54-43d0-b2db-770fba4f90bb admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:19.751216 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1419/2877] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 11:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:56:19.755505 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343f4a8-4694-4028-be4b-5065235e9f32 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:19.767146 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343f4a8-4694-4028-be4b-5065235e9f32 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:19.772586 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a605b64-74f1-46c1-8f96-21a043ae796d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:19.773560 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a605b64-74f1-46c1-8f96-21a043ae796d admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:19.773820 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a605b64-74f1-46c1-8f96-21a043ae796d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:19.774097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a605b64-74f1-46c1-8f96-21a043ae796d admin admin] PATH_INFO: `/v3/projects/91cf485d417b4bf5b9b96df0ecc72d7d/users/843675fca77a45ed80e82ed994f7e2f3/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:19.776326 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a605b64-74f1-46c1-8f96-21a043ae796d admin admin] RBAC: Authorizing `identity:create_grant(project_id=91cf485d417b4bf5b9b96df0ecc72d7d, user_id=843675fca77a45ed80e82ed994f7e2f3, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:19.779031 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a605b64-74f1-46c1-8f96-21a043ae796d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:19.791069 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1459/2878] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 11:56:19 2022] PUT /identity/v3/projects/91cf485d417b4bf5b9b96df0ecc72d7d/users/843675fca77a45ed80e82ed994f7e2f3/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:56:19.803565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd241d36-9002-4241-b9ed-bbd20f8b7d7a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:19.803855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd241d36-9002-4241-b9ed-bbd20f8b7d7a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:19.804137 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd241d36-9002-4241-b9ed-bbd20f8b7d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:19.817145 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:56:19.833517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-dd241d36-9002-4241-b9ed-bbd20f8b7d7a None None] MFA Rules not processed for user `843675fca77a45ed80e82ed994f7e2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:56:19.834781 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dd241d36-9002-4241-b9ed-bbd20f8b7d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:56:19.909829 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1420/2879] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:56:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:56:19.925948 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a605b64-74f1-46c1-8f96-21a043ae796d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:19.927905 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6a605b64-74f1-46c1-8f96-21a043ae796d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:56:20.019522 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a605b64-74f1-46c1-8f96-21a043ae796d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:20.025963 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73052f89-bdea-430c-959c-8bca6e33e277 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:20.026628 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73052f89-bdea-430c-959c-8bca6e33e277 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:20.026908 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73052f89-bdea-430c-959c-8bca6e33e277 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:20.027178 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73052f89-bdea-430c-959c-8bca6e33e277 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:20.089693 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73052f89-bdea-430c-959c-8bca6e33e277 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:20.091352 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73052f89-bdea-430c-959c-8bca6e33e277 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:20.101694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1460/2880] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:56:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:56:23.018258 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd241d36-9002-4241-b9ed-bbd20f8b7d7a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:23.019939 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dd241d36-9002-4241-b9ed-bbd20f8b7d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:56:23.080509 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd241d36-9002-4241-b9ed-bbd20f8b7d7a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:23.085538 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb47da-3f6f-4253-aab5-80afec0d9b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:23.085884 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb47da-3f6f-4253-aab5-80afec0d9b66 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:23.086188 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb47da-3f6f-4253-aab5-80afec0d9b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:23.086466 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb47da-3f6f-4253-aab5-80afec0d9b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:23.096972 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb47da-3f6f-4253-aab5-80afec0d9b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:23.098435 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb47da-3f6f-4253-aab5-80afec0d9b66 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:23.109198 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1421/2881] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:56:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:56:26.229507 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e706c60-2760-46ca-ba5c-fcebd5bdbf37 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:26.234575 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e706c60-2760-46ca-ba5c-fcebd5bdbf37 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:26.234575 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e706c60-2760-46ca-ba5c-fcebd5bdbf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:26.251411 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4e706c60-2760-46ca-ba5c-fcebd5bdbf37 None None] MFA Rules not processed for user `0cc2f50a7b3d4c68b496f17b79ec9964`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:56:26.252611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4e706c60-2760-46ca-ba5c-fcebd5bdbf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:56:26.266276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1461/2882] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:56:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:56:27.124019 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b9255-286f-439a-9b27-6d2b97a0c3e0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:27.124997 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b9255-286f-439a-9b27-6d2b97a0c3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:27.125433 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b9255-286f-439a-9b27-6d2b97a0c3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:27.218663 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e14b9255-286f-439a-9b27-6d2b97a0c3e0 None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:56:27.219890 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e14b9255-286f-439a-9b27-6d2b97a0c3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:56:27.305119 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1422/2883] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 11:56:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:56:27.318636 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e706c60-2760-46ca-ba5c-fcebd5bdbf37 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:27.320259 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4e706c60-2760-46ca-ba5c-fcebd5bdbf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:56:27.341975 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e706c60-2760-46ca-ba5c-fcebd5bdbf37 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:27.347294 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd0f00-76fd-4a54-9f39-f2ae624dbb86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:27.347980 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd0f00-76fd-4a54-9f39-f2ae624dbb86 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:27.348264 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd0f00-76fd-4a54-9f39-f2ae624dbb86 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:27.348825 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd0f00-76fd-4a54-9f39-f2ae624dbb86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:27.363898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd0f00-76fd-4a54-9f39-f2ae624dbb86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:27.365903 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd0f00-76fd-4a54-9f39-f2ae624dbb86 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:27.378055 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1462/2884] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:56:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:56:37.293543 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:56:37.373356 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=94,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:57:04.744607 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aec07-9789-4b98-a410-0ff1a29d31fa None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:57:04.745232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aec07-9789-4b98-a410-0ff1a29d31fa None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:57:04.745232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aec07-9789-4b98-a410-0ff1a29d31fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:57:04.766478 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6f0aec07-9789-4b98-a410-0ff1a29d31fa None None] MFA Rules not processed for user `07eaacc831ae481d99e8ab03ee295e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:57:04.767675 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6f0aec07-9789-4b98-a410-0ff1a29d31fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:57:04.775842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1423/2885] 10.222.0.18 () {58 vars in 1062 bytes} [Tue Jul 19 11:57:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:57:04.782119 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd0f00-76fd-4a54-9f39-f2ae624dbb86 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:57:04.792274 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd0f00-76fd-4a54-9f39-f2ae624dbb86 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:57:04.797110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55165954-7319-42bf-bd18-ae0856aa23ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:57:04.797761 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55165954-7319-42bf-bd18-ae0856aa23ee service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:57:04.798038 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55165954-7319-42bf-bd18-ae0856aa23ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:57:04.798304 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55165954-7319-42bf-bd18-ae0856aa23ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:57:04.800407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-55165954-7319-42bf-bd18-ae0856aa23ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:57:04.810824 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55165954-7319-42bf-bd18-ae0856aa23ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:57:04.812264 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55165954-7319-42bf-bd18-ae0856aa23ee service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:57:04.821995 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1463/2886] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:57:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:57:14.759843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:57:14.817668 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:57:53.840018 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0aec07-9789-4b98-a410-0ff1a29d31fa None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:57:53.843432 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6f0aec07-9789-4b98-a410-0ff1a29d31fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:57:53.860163 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0aec07-9789-4b98-a410-0ff1a29d31fa None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:57:53.866824 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c74866-1cf7-4fdf-b568-4fde31d68096 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:57:53.867492 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c74866-1cf7-4fdf-b568-4fde31d68096 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:57:53.867775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c74866-1cf7-4fdf-b568-4fde31d68096 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:57:53.868040 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c74866-1cf7-4fdf-b568-4fde31d68096 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:57:53.870160 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-00c74866-1cf7-4fdf-b568-4fde31d68096 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:57:53.886687 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c74866-1cf7-4fdf-b568-4fde31d68096 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:57:53.886687 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c74866-1cf7-4fdf-b568-4fde31d68096 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:57:53.900911 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1424/2887] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:57:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:58:03.894646 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:58:07.091312 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202667dd-9c80-425d-96e8-548cae3261c9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:58:07.091747 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202667dd-9c80-425d-96e8-548cae3261c9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:58:07.091846 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202667dd-9c80-425d-96e8-548cae3261c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:58:07.113207 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-202667dd-9c80-425d-96e8-548cae3261c9 None None] MFA Rules not processed for user `0cc2f50a7b3d4c68b496f17b79ec9964`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:58:07.118669 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-202667dd-9c80-425d-96e8-548cae3261c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:58:07.133821 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1464/2888] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 11:58:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:58:07.472886 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c74866-1cf7-4fdf-b568-4fde31d68096 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:58:07.482140 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c74866-1cf7-4fdf-b568-4fde31d68096 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:58:07.486336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c43dbb-a57f-4b0d-a281-ba209126624e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:58:07.487015 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c43dbb-a57f-4b0d-a281-ba209126624e service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:58:07.487411 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c43dbb-a57f-4b0d-a281-ba209126624e service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:58:07.487688 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c43dbb-a57f-4b0d-a281-ba209126624e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:58:07.489542 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-13c43dbb-a57f-4b0d-a281-ba209126624e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:58:07.499939 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c43dbb-a57f-4b0d-a281-ba209126624e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:58:07.501514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c43dbb-a57f-4b0d-a281-ba209126624e service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:58:07.510089 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1425/2889] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:58:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:58:08.867240 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4b873-1e27-4101-a24e-10d2b7d4e07a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:58:08.867776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4b873-1e27-4101-a24e-10d2b7d4e07a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:58:08.867776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4b873-1e27-4101-a24e-10d2b7d4e07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:58:08.888523 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a4e4b873-1e27-4101-a24e-10d2b7d4e07a None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:58:08.889802 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a4e4b873-1e27-4101-a24e-10d2b7d4e07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:58:08.900026 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1465/2890] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 11:58:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:58:08.913663 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c43dbb-a57f-4b0d-a281-ba209126624e service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:58:08.915614 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-13c43dbb-a57f-4b0d-a281-ba209126624e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:58:08.934162 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c43dbb-a57f-4b0d-a281-ba209126624e service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:58:08.939940 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9a60d-58a4-4e5b-b88c-4f529a2fd9f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:58:08.940743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9a60d-58a4-4e5b-b88c-4f529a2fd9f8 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:58:08.941110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9a60d-58a4-4e5b-b88c-4f529a2fd9f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:58:08.941511 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9a60d-58a4-4e5b-b88c-4f529a2fd9f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:58:08.950883 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9a60d-58a4-4e5b-b88c-4f529a2fd9f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:58:08.952664 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9a60d-58a4-4e5b-b88c-4f529a2fd9f8 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:58:08.966887 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1426/2891] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 11:58:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:58:18.882706 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:58:18.959343 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=12 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:00:04.361256 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4b873-1e27-4101-a24e-10d2b7d4e07a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:00:04.372605 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4b873-1e27-4101-a24e-10d2b7d4e07a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:00:04.379820 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbda5f-158d-4f9a-b79e-43b691fb66ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:00:04.380476 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbda5f-158d-4f9a-b79e-43b691fb66ba service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:00:04.380754 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbda5f-158d-4f9a-b79e-43b691fb66ba service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:00:04.381036 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbda5f-158d-4f9a-b79e-43b691fb66ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:00:04.383162 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0fcbda5f-158d-4f9a-b79e-43b691fb66ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:00:04.407610 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbda5f-158d-4f9a-b79e-43b691fb66ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:00:04.409280 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbda5f-158d-4f9a-b79e-43b691fb66ba service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:00:04.419951 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1466/2892] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:00:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:00:14.415184 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=11 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:00:33.347743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9a60d-58a4-4e5b-b88c-4f529a2fd9f8 service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:00:33.362388 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9a60d-58a4-4e5b-b88c-4f529a2fd9f8 service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:00:33.367954 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496ad87-9a2b-4ea9-aacd-64abea54528f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:00:33.368615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496ad87-9a2b-4ea9-aacd-64abea54528f service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:00:33.368928 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496ad87-9a2b-4ea9-aacd-64abea54528f service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:00:33.369195 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496ad87-9a2b-4ea9-aacd-64abea54528f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:00:33.371070 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e496ad87-9a2b-4ea9-aacd-64abea54528f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:00:33.390160 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496ad87-9a2b-4ea9-aacd-64abea54528f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:00:33.391553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496ad87-9a2b-4ea9-aacd-64abea54528f service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:00:33.403137 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1427/2893] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:00:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:00:43.398316 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:00:43.578939 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46760dc-47e1-4d2d-97ab-23b56cbb77d7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:00:43.579549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46760dc-47e1-4d2d-97ab-23b56cbb77d7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:00:43.579646 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46760dc-47e1-4d2d-97ab-23b56cbb77d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:00:43.600091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f46760dc-47e1-4d2d-97ab-23b56cbb77d7 None None] MFA Rules not processed for user `0cc2f50a7b3d4c68b496f17b79ec9964`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:00:43.601363 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f46760dc-47e1-4d2d-97ab-23b56cbb77d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:00:43.609892 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1467/2894] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 12:00:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:00:43.997185 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496ad87-9a2b-4ea9-aacd-64abea54528f service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:00:44.008176 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496ad87-9a2b-4ea9-aacd-64abea54528f service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:00:44.012228 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9bdc7-b9f8-446e-92f6-ebcd89cbf4be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:00:44.012939 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9bdc7-b9f8-446e-92f6-ebcd89cbf4be service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:00:44.013235 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9bdc7-b9f8-446e-92f6-ebcd89cbf4be service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:00:44.013480 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9bdc7-b9f8-446e-92f6-ebcd89cbf4be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:00:44.015393 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-94b9bdc7-b9f8-446e-92f6-ebcd89cbf4be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:00:44.031210 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9bdc7-b9f8-446e-92f6-ebcd89cbf4be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:00:44.033309 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9bdc7-b9f8-446e-92f6-ebcd89cbf4be service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:00:44.046665 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1428/2895] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:00:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:00:53.594695 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:00:53.723187 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46760dc-47e1-4d2d-97ab-23b56cbb77d7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:00:53.737498 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46760dc-47e1-4d2d-97ab-23b56cbb77d7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:00:53.743973 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a3d21-d7be-4a4a-9569-db51400a57be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:00:53.744698 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a3d21-d7be-4a4a-9569-db51400a57be service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:00:53.745011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a3d21-d7be-4a4a-9569-db51400a57be service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:00:53.745282 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a3d21-d7be-4a4a-9569-db51400a57be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:00:53.747255 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1e2a3d21-d7be-4a4a-9569-db51400a57be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:00:53.761587 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a3d21-d7be-4a4a-9569-db51400a57be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:00:53.763204 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a3d21-d7be-4a4a-9569-db51400a57be service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:00:53.774679 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1468/2896] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:00:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:00:54.040573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:01:03.770035 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:01:29.661366 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9bdc7-b9f8-446e-92f6-ebcd89cbf4be service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:01:29.675731 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9bdc7-b9f8-446e-92f6-ebcd89cbf4be service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:01:29.682365 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753e580-5166-4c2b-a24c-320dc4c94bd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:01:29.683050 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753e580-5166-4c2b-a24c-320dc4c94bd4 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:01:29.683335 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753e580-5166-4c2b-a24c-320dc4c94bd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:01:29.683610 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753e580-5166-4c2b-a24c-320dc4c94bd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:01:29.691824 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753e580-5166-4c2b-a24c-320dc4c94bd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:01:29.693483 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753e580-5166-4c2b-a24c-320dc4c94bd4 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:01:29.702478 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1429/2897] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:01:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:01:39.698523 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:02:00.452737 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a3d21-d7be-4a4a-9569-db51400a57be service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:02:00.459110 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753e580-5166-4c2b-a24c-320dc4c94bd4 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:02:00.462662 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a3d21-d7be-4a4a-9569-db51400a57be service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:02:00.466776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8ce07-5592-4e8a-a87a-025e9842d525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:02:00.467432 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8ce07-5592-4e8a-a87a-025e9842d525 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:02:00.467739 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8ce07-5592-4e8a-a87a-025e9842d525 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:02:00.468006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8ce07-5592-4e8a-a87a-025e9842d525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:02:00.468888 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753e580-5166-4c2b-a24c-320dc4c94bd4 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:02:00.470096 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-84d8ce07-5592-4e8a-a87a-025e9842d525 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:02:00.472856 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f14257-2371-4363-9006-7702976274a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:02:00.473513 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f14257-2371-4363-9006-7702976274a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:02:00.473787 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f14257-2371-4363-9006-7702976274a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:02:00.474057 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f14257-2371-4363-9006-7702976274a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:02:00.475843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-15f14257-2371-4363-9006-7702976274a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:02:00.481018 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8ce07-5592-4e8a-a87a-025e9842d525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:02:00.482469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8ce07-5592-4e8a-a87a-025e9842d525 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:02:00.490085 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f14257-2371-4363-9006-7702976274a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:02:00.491490 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1469/2898] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:02:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:02:00.491632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f14257-2371-4363-9006-7702976274a2 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:02:00.503770 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1430/2899] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:02:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:02:00.611159 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7f1fb-ed67-41df-8e4d-c92194cdb4cf None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:02:00.611486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7f1fb-ed67-41df-8e4d-c92194cdb4cf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:02:00.611760 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7f1fb-ed67-41df-8e4d-c92194cdb4cf None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:02:00.613492 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1470/2900] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 19 12:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:02:00.618492 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a218e21-e152-4a8d-a38f-4acf80d54493 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:02:00.618804 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a218e21-e152-4a8d-a38f-4acf80d54493 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:02:00.619081 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a218e21-e152-4a8d-a38f-4acf80d54493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:02:00.639778 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9a218e21-e152-4a8d-a38f-4acf80d54493 None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:02:00.641207 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9a218e21-e152-4a8d-a38f-4acf80d54493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:02:00.654838 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1431/2901] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 12:02:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:02:00.678827 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7f1fb-ed67-41df-8e4d-c92194cdb4cf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:02:00.702655 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7f1fb-ed67-41df-8e4d-c92194cdb4cf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:02:00.708399 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6823d2-d74a-41fe-887c-3841118fd5ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:02:00.709091 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6823d2-d74a-41fe-887c-3841118fd5ce service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:02:00.709371 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6823d2-d74a-41fe-887c-3841118fd5ce service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:02:00.709646 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6823d2-d74a-41fe-887c-3841118fd5ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:02:00.719097 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6823d2-d74a-41fe-887c-3841118fd5ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:02:00.720714 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6823d2-d74a-41fe-887c-3841118fd5ce service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:02:00.730981 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1471/2902] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:02:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:02:00.910373 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a218e21-e152-4a8d-a38f-4acf80d54493 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:02:00.920899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a218e21-e152-4a8d-a38f-4acf80d54493 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:02:00.925226 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08a0d6-1eda-4686-a24f-30f433398659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:02:00.925872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08a0d6-1eda-4686-a24f-30f433398659 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:02:00.926147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08a0d6-1eda-4686-a24f-30f433398659 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:02:00.926413 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08a0d6-1eda-4686-a24f-30f433398659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:02:00.928470 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9d08a0d6-1eda-4686-a24f-30f433398659 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:02:00.943383 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08a0d6-1eda-4686-a24f-30f433398659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:02:00.944847 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08a0d6-1eda-4686-a24f-30f433398659 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:02:00.956379 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1432/2903] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:02:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:02:01.363886 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95a984-b303-4490-8178-d9bd412452be None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:02:01.364186 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95a984-b303-4490-8178-d9bd412452be None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:02:01.364407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95a984-b303-4490-8178-d9bd412452be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:02:01.386832 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4d95a984-b303-4490-8178-d9bd412452be None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:02:01.388117 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4d95a984-b303-4490-8178-d9bd412452be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:02:01.398307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1472/2904] 10.222.0.17 () {58 vars in 1015 bytes} [Tue Jul 19 12:02:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:02:01.411474 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa4842-ace9-4723-9861-66dc406e665d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:02:01.411763 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa4842-ace9-4723-9861-66dc406e665d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:02:01.412017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa4842-ace9-4723-9861-66dc406e665d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:02:01.434587 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-13fa4842-ace9-4723-9861-66dc406e665d None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:02:01.435789 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-13fa4842-ace9-4723-9861-66dc406e665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:02:01.444920 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1433/2905] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Jul 19 12:02:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:02:01.451188 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95a984-b303-4490-8178-d9bd412452be None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:02:01.461943 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95a984-b303-4490-8178-d9bd412452be None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:02:01.469485 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57162b2e-bdf7-45a5-b63a-4ec56bc593ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:02:01.470205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57162b2e-bdf7-45a5-b63a-4ec56bc593ea service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:02:01.470550 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57162b2e-bdf7-45a5-b63a-4ec56bc593ea service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:02:01.470822 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57162b2e-bdf7-45a5-b63a-4ec56bc593ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:02:01.482794 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57162b2e-bdf7-45a5-b63a-4ec56bc593ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:02:01.484372 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57162b2e-bdf7-45a5-b63a-4ec56bc593ea service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:02:01.494147 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1473/2906] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:02:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:02:01.723847 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa4842-ace9-4723-9861-66dc406e665d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:02:01.734870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa4842-ace9-4723-9861-66dc406e665d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:02:01.738909 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7bcbc-caa3-4873-924a-63b38d1c6811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:02:01.739544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7bcbc-caa3-4873-924a-63b38d1c6811 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:02:01.739824 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7bcbc-caa3-4873-924a-63b38d1c6811 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:02:01.740098 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7bcbc-caa3-4873-924a-63b38d1c6811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:02:01.742087 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-53c7bcbc-caa3-4873-924a-63b38d1c6811 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:02:01.757194 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7bcbc-caa3-4873-924a-63b38d1c6811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:02:01.758650 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7bcbc-caa3-4873-924a-63b38d1c6811 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:02:01.770840 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1434/2907] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:02:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:02:11.490144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=21 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:02:11.765151 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=24 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:02:12.776626 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57162b2e-bdf7-45a5-b63a-4ec56bc593ea service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:02:12.786975 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57162b2e-bdf7-45a5-b63a-4ec56bc593ea service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:02:12.791202 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed70c61-c077-4590-be7b-34917326a483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:02:12.791858 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed70c61-c077-4590-be7b-34917326a483 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:02:12.792140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed70c61-c077-4590-be7b-34917326a483 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:02:12.792409 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed70c61-c077-4590-be7b-34917326a483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:02:12.800630 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed70c61-c077-4590-be7b-34917326a483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:02:12.802164 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed70c61-c077-4590-be7b-34917326a483 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:02:12.811078 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1474/2908] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:02:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:02:22.806828 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:03:07.786117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193356e-0755-4d2c-b558-16fdb59ed65b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:07.786674 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193356e-0755-4d2c-b558-16fdb59ed65b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:07.786775 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193356e-0755-4d2c-b558-16fdb59ed65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:07.827356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8193356e-0755-4d2c-b558-16fdb59ed65b None None] MFA Rules not processed for user `3c50a821e9ef44cb9fccd49ee4af7dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:03:07.828648 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8193356e-0755-4d2c-b558-16fdb59ed65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:03:07.838221 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1435/2909] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Jul 19 12:03:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:03:07.844685 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed70c61-c077-4590-be7b-34917326a483 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:03:07.858691 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed70c61-c077-4590-be7b-34917326a483 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:03:07.864473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8d829-bf7f-4c7b-943d-2b851c21efae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:03:07.865220 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8d829-bf7f-4c7b-943d-2b851c21efae service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:07.865530 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8d829-bf7f-4c7b-943d-2b851c21efae service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:07.865806 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8d829-bf7f-4c7b-943d-2b851c21efae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:07.875888 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8d829-bf7f-4c7b-943d-2b851c21efae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:03:07.877607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8d829-bf7f-4c7b-943d-2b851c21efae service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:03:07.890276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1475/2910] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:03:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:03:07.963219 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95f12f-f398-48e4-b4d6-6df0ecfceb65 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:07.963536 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95f12f-f398-48e4-b4d6-6df0ecfceb65 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:07.963848 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95f12f-f398-48e4-b4d6-6df0ecfceb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:07.983985 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5e95f12f-f398-48e4-b4d6-6df0ecfceb65 None None] MFA Rules not processed for user `3c50a821e9ef44cb9fccd49ee4af7dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:03:07.985246 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5e95f12f-f398-48e4-b4d6-6df0ecfceb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:03:07.994503 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1436/2911] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Jul 19 12:03:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:03:08.056138 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec22e6b-2b6a-4926-b95a-9987cd566215 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:08.056561 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec22e6b-2b6a-4926-b95a-9987cd566215 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:08.056925 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec22e6b-2b6a-4926-b95a-9987cd566215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:08.078112 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8ec22e6b-2b6a-4926-b95a-9987cd566215 None None] MFA Rules not processed for user `3c50a821e9ef44cb9fccd49ee4af7dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:03:08.079492 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8ec22e6b-2b6a-4926-b95a-9987cd566215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:03:08.089615 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1476/2912] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 19 12:03:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:03:08.100688 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95f12f-f398-48e4-b4d6-6df0ecfceb65 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:03:08.110695 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95f12f-f398-48e4-b4d6-6df0ecfceb65 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:03:08.116145 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757acbd-4ee6-49a8-aea8-a5bb37a19f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:03:08.116145 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757acbd-4ee6-49a8-aea8-a5bb37a19f96 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:08.116482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757acbd-4ee6-49a8-aea8-a5bb37a19f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:08.116482 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757acbd-4ee6-49a8-aea8-a5bb37a19f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:08.128348 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757acbd-4ee6-49a8-aea8-a5bb37a19f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:03:08.130272 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757acbd-4ee6-49a8-aea8-a5bb37a19f96 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:03:08.141617 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1437/2913] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:03:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:03:14.337856 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5e91c-6b84-45b0-a0ae-03aad0057fb8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:14.339018 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5e91c-6b84-45b0-a0ae-03aad0057fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:14.339205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5e91c-6b84-45b0-a0ae-03aad0057fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:14.357856 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f7c5e91c-6b84-45b0-a0ae-03aad0057fb8 None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:03:14.359077 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f7c5e91c-6b84-45b0-a0ae-03aad0057fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:03:14.368567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1477/2914] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 12:03:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:03:14.386974 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7eded-9b18-45a2-b65d-d765307e3b1e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:14.387437 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7eded-9b18-45a2-b65d-d765307e3b1e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:14.387548 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7eded-9b18-45a2-b65d-d765307e3b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:14.410232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-21a7eded-9b18-45a2-b65d-d765307e3b1e None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:03:14.411529 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-21a7eded-9b18-45a2-b65d-d765307e3b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:03:14.430952 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1438/2915] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Jul 19 12:03:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:03:14.438171 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5e91c-6b84-45b0-a0ae-03aad0057fb8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:03:14.451697 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5e91c-6b84-45b0-a0ae-03aad0057fb8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:03:14.457906 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926be15d-89f6-43fd-a603-4ccdc2202475 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:03:14.458572 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926be15d-89f6-43fd-a603-4ccdc2202475 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:14.458852 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926be15d-89f6-43fd-a603-4ccdc2202475 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:14.459125 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926be15d-89f6-43fd-a603-4ccdc2202475 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:14.468935 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926be15d-89f6-43fd-a603-4ccdc2202475 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:03:14.470538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926be15d-89f6-43fd-a603-4ccdc2202475 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:03:14.480848 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1478/2916] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:03:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:03:19.741006 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7eded-9b18-45a2-b65d-d765307e3b1e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:03:19.751333 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7eded-9b18-45a2-b65d-d765307e3b1e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:03:19.755939 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1464e8-9def-4ff5-ace2-25ad08e41365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:03:19.756598 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1464e8-9def-4ff5-ace2-25ad08e41365 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:19.757327 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1464e8-9def-4ff5-ace2-25ad08e41365 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:19.757490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1464e8-9def-4ff5-ace2-25ad08e41365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:19.767804 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1464e8-9def-4ff5-ace2-25ad08e41365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:03:19.769336 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1464e8-9def-4ff5-ace2-25ad08e41365 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:03:19.780702 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1439/2917] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:03:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:03:22.588251 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedd0dd-88d2-461a-b97a-9176fefd16c2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:22.588795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedd0dd-88d2-461a-b97a-9176fefd16c2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:22.589005 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedd0dd-88d2-461a-b97a-9176fefd16c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:22.616400 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5cedd0dd-88d2-461a-b97a-9176fefd16c2 None None] MFA Rules not processed for user `0cc2f50a7b3d4c68b496f17b79ec9964`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:03:22.619788 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5cedd0dd-88d2-461a-b97a-9176fefd16c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:03:22.631407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1479/2918] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 12:03:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:03:22.669805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9eb72-555f-446c-a6b5-225825e3b1a8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:22.670479 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9eb72-555f-446c-a6b5-225825e3b1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:22.671078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9eb72-555f-446c-a6b5-225825e3b1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:22.714893 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-66c9eb72-555f-446c-a6b5-225825e3b1a8 None None] MFA Rules not processed for user `3c50a821e9ef44cb9fccd49ee4af7dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:03:22.716563 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-66c9eb72-555f-446c-a6b5-225825e3b1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:03:22.728224 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1440/2919] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 19 12:03:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:03:22.748693 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018397b4-b708-42c9-bff2-f48dfbd84d20 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:22.749376 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018397b4-b708-42c9-bff2-f48dfbd84d20 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:22.749886 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018397b4-b708-42c9-bff2-f48dfbd84d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:22.815454 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-018397b4-b708-42c9-bff2-f48dfbd84d20 None None] MFA Rules not processed for user `d1bcfbee5a5e4016a77901d0a637da63`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:03:22.817780 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-018397b4-b708-42c9-bff2-f48dfbd84d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:03:22.923260 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1480/2920] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Jul 19 12:03:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:03:22.930508 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9eb72-555f-446c-a6b5-225825e3b1a8 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:03:22.945344 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9eb72-555f-446c-a6b5-225825e3b1a8 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:03:22.952203 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5c638-0eb1-4ddb-a9c4-46dd3ed23c65 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bcfbee5a5e4016a77901d0a637da63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:03:22.953387 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5c638-0eb1-4ddb-a9c4-46dd3ed23c65 service glance] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:22.953770 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5c638-0eb1-4ddb-a9c4-46dd3ed23c65 service glance] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:22.954247 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5c638-0eb1-4ddb-a9c4-46dd3ed23c65 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:22.970526 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5c638-0eb1-4ddb-a9c4-46dd3ed23c65 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:03:22.972283 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5c638-0eb1-4ddb-a9c4-46dd3ed23c65 service glance] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:03:22.986883 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1441/2921] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:03:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:03:23.304871 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f6a0e-2733-4720-a662-64e328ce2d5c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:23.305164 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f6a0e-2733-4720-a662-64e328ce2d5c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:23.305477 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f6a0e-2733-4720-a662-64e328ce2d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:23.324562 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-713f6a0e-2733-4720-a662-64e328ce2d5c None None] MFA Rules not processed for user `07eaacc831ae481d99e8ab03ee295e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:03:23.326178 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-713f6a0e-2733-4720-a662-64e328ce2d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:03:23.333501 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1481/2922] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 19 12:03:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:03:23.345594 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5c638-0eb1-4ddb-a9c4-46dd3ed23c65 service glance] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:03:23.358335 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5c638-0eb1-4ddb-a9c4-46dd3ed23c65 service glance] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:03:23.362517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2ddf7-e429-4db6-a01b-bceffc01ec22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:03:23.363225 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2ddf7-e429-4db6-a01b-bceffc01ec22 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:23.363523 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2ddf7-e429-4db6-a01b-bceffc01ec22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:23.363796 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2ddf7-e429-4db6-a01b-bceffc01ec22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:23.373146 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2ddf7-e429-4db6-a01b-bceffc01ec22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:03:23.374852 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2ddf7-e429-4db6-a01b-bceffc01ec22 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:03:23.385218 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1442/2923] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:03:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:03:24.760597 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f6a0e-2733-4720-a662-64e328ce2d5c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:03:24.776595 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f6a0e-2733-4720-a662-64e328ce2d5c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:03:24.782609 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5bbcf-f93e-4270-99d8-5cb47f3eecfa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:03:24.783559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5bbcf-f93e-4270-99d8-5cb47f3eecfa service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:24.783916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5bbcf-f93e-4270-99d8-5cb47f3eecfa service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:24.784421 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5bbcf-f93e-4270-99d8-5cb47f3eecfa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:24.795804 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5bbcf-f93e-4270-99d8-5cb47f3eecfa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:03:24.797491 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5bbcf-f93e-4270-99d8-5cb47f3eecfa service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:03:24.809381 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1482/2924] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:03:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:03:26.763235 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f53e7-97a4-4927-8c1f-103f349a5c91 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:26.763807 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f53e7-97a4-4927-8c1f-103f349a5c91 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:26.763807 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f53e7-97a4-4927-8c1f-103f349a5c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:26.787353 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ef7f53e7-97a4-4927-8c1f-103f349a5c91 None None] MFA Rules not processed for user `07eaacc831ae481d99e8ab03ee295e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:03:26.789634 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ef7f53e7-97a4-4927-8c1f-103f349a5c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:03:26.801582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1443/2925] 10.222.0.17 () {58 vars in 1015 bytes} [Tue Jul 19 12:03:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:03:26.814139 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5bbcf-f93e-4270-99d8-5cb47f3eecfa service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:03:26.824791 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5bbcf-f93e-4270-99d8-5cb47f3eecfa service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:03:26.828906 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f762c-b5b2-4811-b89f-1804354c626d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:03:26.829582 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f762c-b5b2-4811-b89f-1804354c626d service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:26.829860 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f762c-b5b2-4811-b89f-1804354c626d service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:26.830159 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f762c-b5b2-4811-b89f-1804354c626d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:26.838710 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f762c-b5b2-4811-b89f-1804354c626d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:03:26.840209 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f762c-b5b2-4811-b89f-1804354c626d service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:03:26.849304 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1483/2926] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:03:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:03:27.578878 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f41836-2be0-4c01-8229-c43f4c6d37b8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:27.579459 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f41836-2be0-4c01-8229-c43f4c6d37b8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:27.579960 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f41836-2be0-4c01-8229-c43f4c6d37b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:27.604987 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f6f41836-2be0-4c01-8229-c43f4c6d37b8 None None] MFA Rules not processed for user `3c50a821e9ef44cb9fccd49ee4af7dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:03:27.606144 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f6f41836-2be0-4c01-8229-c43f4c6d37b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:03:27.619319 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1444/2927] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 12:03:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:03:27.632534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f762c-b5b2-4811-b89f-1804354c626d service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:03:27.646405 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f762c-b5b2-4811-b89f-1804354c626d service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:03:27.652352 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8d1bf-4a77-465d-a31d-0df517281b00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:03:27.653071 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8d1bf-4a77-465d-a31d-0df517281b00 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:27.653347 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8d1bf-4a77-465d-a31d-0df517281b00 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:27.653619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8d1bf-4a77-465d-a31d-0df517281b00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:27.663971 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8d1bf-4a77-465d-a31d-0df517281b00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:03:27.665768 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8d1bf-4a77-465d-a31d-0df517281b00 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:03:27.679615 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1484/2928] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:03:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:03:37.595462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=48 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:03:37.674044 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=80 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:05:52.618575 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2946b0d-37da-4c56-90f8-590f0d1689e0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:05:52.619282 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2946b0d-37da-4c56-90f8-590f0d1689e0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:05:52.619414 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2946b0d-37da-4c56-90f8-590f0d1689e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:05:52.639881 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a2946b0d-37da-4c56-90f8-590f0d1689e0 None None] MFA Rules not processed for user `cc3d4e645a3349e78452f67cbe79f052`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:05:52.642323 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a2946b0d-37da-4c56-90f8-590f0d1689e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:05:52.702670 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1445/2929] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 12:05:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:05:52.724373 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8d1bf-4a77-465d-a31d-0df517281b00 service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:05:52.762566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8d1bf-4a77-465d-a31d-0df517281b00 service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:05:52.768473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e38f6-60b4-4fad-844f-a72f2ae94663 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:05:52.769815 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e38f6-60b4-4fad-844f-a72f2ae94663 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:05:52.770122 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e38f6-60b4-4fad-844f-a72f2ae94663 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:05:52.770414 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e38f6-60b4-4fad-844f-a72f2ae94663 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:05:52.779793 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e38f6-60b4-4fad-844f-a72f2ae94663 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:05:52.781452 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e38f6-60b4-4fad-844f-a72f2ae94663 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:05:52.792239 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1485/2930] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:05:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:05:59.050733 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211084f-9454-4847-a029-82c3ff92ed50 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:05:59.051341 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211084f-9454-4847-a029-82c3ff92ed50 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:05:59.051341 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211084f-9454-4847-a029-82c3ff92ed50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:05:59.071843 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3211084f-9454-4847-a029-82c3ff92ed50 None None] MFA Rules not processed for user `0cc2f50a7b3d4c68b496f17b79ec9964`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:05:59.073501 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3211084f-9454-4847-a029-82c3ff92ed50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:05:59.081879 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1446/2931] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 12:05:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:05:59.951197 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e38f6-60b4-4fad-844f-a72f2ae94663 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:05:59.973713 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e38f6-60b4-4fad-844f-a72f2ae94663 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:05:59.981651 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8efad-0490-4b76-8630-a171461e45e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:05:59.982662 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8efad-0490-4b76-8630-a171461e45e1 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:05:59.983129 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8efad-0490-4b76-8630-a171461e45e1 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:05:59.983585 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8efad-0490-4b76-8630-a171461e45e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:06:00.001591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8efad-0490-4b76-8630-a171461e45e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:06:00.003315 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8efad-0490-4b76-8630-a171461e45e1 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:06:00.037723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1486/2932] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:05:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:06:07.142787 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db0194-0613-47fd-8dd1-a1cfcb3dcb4a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:06:07.143490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db0194-0613-47fd-8dd1-a1cfcb3dcb4a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:06:07.143490 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db0194-0613-47fd-8dd1-a1cfcb3dcb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:06:07.212164 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f8db0194-0613-47fd-8dd1-a1cfcb3dcb4a None None] MFA Rules not processed for user `3c50a821e9ef44cb9fccd49ee4af7dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:06:07.213430 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f8db0194-0613-47fd-8dd1-a1cfcb3dcb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:06:07.247331 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1447/2933] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 12:06:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:06:07.260611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8efad-0490-4b76-8630-a171461e45e1 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:06:07.303271 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8efad-0490-4b76-8630-a171461e45e1 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:06:07.310723 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4a9ec-6f2a-4a5a-a148-b5b858e06032 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:06:07.311391 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4a9ec-6f2a-4a5a-a148-b5b858e06032 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:06:07.311671 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4a9ec-6f2a-4a5a-a148-b5b858e06032 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:06:07.311941 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4a9ec-6f2a-4a5a-a148-b5b858e06032 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:06:07.323186 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4a9ec-6f2a-4a5a-a148-b5b858e06032 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:06:07.324893 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4a9ec-6f2a-4a5a-a148-b5b858e06032 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:06:07.336693 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1487/2934] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:06:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:06:11.446537 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b21703-a368-4187-9006-3a3d9a815bcf None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:06:11.446537 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b21703-a368-4187-9006-3a3d9a815bcf None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:06:11.446537 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b21703-a368-4187-9006-3a3d9a815bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:06:11.468292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a4b21703-a368-4187-9006-3a3d9a815bcf None None] MFA Rules not processed for user `3c50a821e9ef44cb9fccd49ee4af7dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:06:11.470112 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a4b21703-a368-4187-9006-3a3d9a815bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:06:11.480872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1448/2935] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 12:06:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:06:11.494607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4a9ec-6f2a-4a5a-a148-b5b858e06032 service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:06:11.507072 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4a9ec-6f2a-4a5a-a148-b5b858e06032 service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:06:11.513057 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb02d0-1e8d-40a5-9e90-e891578bd336 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:06:11.514165 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb02d0-1e8d-40a5-9e90-e891578bd336 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:06:11.514617 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb02d0-1e8d-40a5-9e90-e891578bd336 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:06:11.515050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb02d0-1e8d-40a5-9e90-e891578bd336 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:06:11.526416 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb02d0-1e8d-40a5-9e90-e891578bd336 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:06:11.528410 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb02d0-1e8d-40a5-9e90-e891578bd336 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:06:11.540833 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1488/2936] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:06:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:06:21.461970 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=46 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:06:21.536008 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=45 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:06:44.914828 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b21703-a368-4187-9006-3a3d9a815bcf None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:06:44.987565 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b21703-a368-4187-9006-3a3d9a815bcf None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:06:44.993954 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded56f97-867f-4ce8-a744-8925ebedefe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:06:44.994599 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded56f97-867f-4ce8-a744-8925ebedefe1 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:06:44.994881 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded56f97-867f-4ce8-a744-8925ebedefe1 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:06:44.995157 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded56f97-867f-4ce8-a744-8925ebedefe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:06:44.997294 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ded56f97-867f-4ce8-a744-8925ebedefe1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:06:45.091747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded56f97-867f-4ce8-a744-8925ebedefe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:06:45.093401 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded56f97-867f-4ce8-a744-8925ebedefe1 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:06:45.112596 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1449/2937] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:06:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:06:55.110239 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=69 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:07:12.004688 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb02d0-1e8d-40a5-9e90-e891578bd336 service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:12.076970 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb02d0-1e8d-40a5-9e90-e891578bd336 service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:12.082319 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01679c6-4742-46b7-847a-2404928ef298 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:12.082988 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01679c6-4742-46b7-847a-2404928ef298 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:12.083266 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01679c6-4742-46b7-847a-2404928ef298 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:12.083521 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01679c6-4742-46b7-847a-2404928ef298 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:12.092663 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01679c6-4742-46b7-847a-2404928ef298 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:12.094290 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01679c6-4742-46b7-847a-2404928ef298 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:12.105076 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1489/2938] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:07:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:07:22.100351 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=32 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:07:29.905881 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded56f97-867f-4ce8-a744-8925ebedefe1 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:29.906755 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ded56f97-867f-4ce8-a744-8925ebedefe1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:30.012290 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded56f97-867f-4ce8-a744-8925ebedefe1 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:30.018078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d73d5-020d-4773-8224-f9b3b370e883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:30.019011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d73d5-020d-4773-8224-f9b3b370e883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:30.019468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d73d5-020d-4773-8224-f9b3b370e883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:30.019772 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d73d5-020d-4773-8224-f9b3b370e883 admin admin] PATH_INFO: `/v3/users/0cc2f50a7b3d4c68b496f17b79ec9964` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:30.021597 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d73d5-020d-4773-8224-f9b3b370e883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc2f50a7b3d4c68b496f17b79ec9964)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:30.023673 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d73d5-020d-4773-8224-f9b3b370e883 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:30.092770 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a47d73d5-020d-4773-8224-f9b3b370e883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc2f50a7b3d4c68b496f17b79ec9964'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:30.106065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a47d73d5-020d-4773-8224-f9b3b370e883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc2f50a7b3d4c68b496f17b79ec9964'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:30.121255 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a47d73d5-020d-4773-8224-f9b3b370e883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc2f50a7b3d4c68b496f17b79ec9964'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:30.122063 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a47d73d5-020d-4773-8224-f9b3b370e883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc2f50a7b3d4c68b496f17b79ec9964'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:30.136882 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a47d73d5-020d-4773-8224-f9b3b370e883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc2f50a7b3d4c68b496f17b79ec9964'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:30.147700 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1450/2939] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 12:07:29 2022] DELETE /identity/v3/users/0cc2f50a7b3d4c68b496f17b79ec9964 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:07:30.153093 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaa04e-d9bf-4863-ad2d-6bb0ab2c3eba None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:30.153930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaa04e-d9bf-4863-ad2d-6bb0ab2c3eba None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:30.153930 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaa04e-d9bf-4863-ad2d-6bb0ab2c3eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:30.189966 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2eeaa04e-d9bf-4863-ad2d-6bb0ab2c3eba None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:07:30.191586 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2eeaa04e-d9bf-4863-ad2d-6bb0ab2c3eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:30.284488 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1490/2940] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 12:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:07:30.295159 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d73d5-020d-4773-8224-f9b3b370e883 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:30.296824 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a47d73d5-020d-4773-8224-f9b3b370e883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:30.381041 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:07:30.418977 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d73d5-020d-4773-8224-f9b3b370e883 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:30.426309 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a6546-5d21-404d-9317-7a66fbed7579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:30.427040 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a6546-5d21-404d-9317-7a66fbed7579 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:30.427388 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a6546-5d21-404d-9317-7a66fbed7579 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:30.427666 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a6546-5d21-404d-9317-7a66fbed7579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:30.438697 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a6546-5d21-404d-9317-7a66fbed7579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:30.440252 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a6546-5d21-404d-9317-7a66fbed7579 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:30.452553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1451/2941] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:07:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:07:30.671886 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeaa04e-d9bf-4863-ad2d-6bb0ab2c3eba None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:30.673090 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2eeaa04e-d9bf-4863-ad2d-6bb0ab2c3eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:30.689397 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeaa04e-d9bf-4863-ad2d-6bb0ab2c3eba None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:30.696864 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb717f-dd3c-453e-ba7a-e9956b3a3088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:30.697813 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb717f-dd3c-453e-ba7a-e9956b3a3088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:30.698160 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb717f-dd3c-453e-ba7a-e9956b3a3088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:30.698449 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb717f-dd3c-453e-ba7a-e9956b3a3088 admin admin] PATH_INFO: `/v3/projects/b39ad0a67091427aa0efb1d1f141452e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:30.699958 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb717f-dd3c-453e-ba7a-e9956b3a3088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b39ad0a67091427aa0efb1d1f141452e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:30.702006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb717f-dd3c-453e-ba7a-e9956b3a3088 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:30.758417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fcbb717f-dd3c-453e-ba7a-e9956b3a3088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b39ad0a67091427aa0efb1d1f141452e', 'request_id': 'req-fcbb717f-dd3c-453e-ba7a-e9956b3a3088'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:30.765659 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fcbb717f-dd3c-453e-ba7a-e9956b3a3088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b39ad0a67091427aa0efb1d1f141452e', 'request_id': 'req-fcbb717f-dd3c-453e-ba7a-e9956b3a3088'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:30.772375 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fcbb717f-dd3c-453e-ba7a-e9956b3a3088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b39ad0a67091427aa0efb1d1f141452e', 'request_id': 'req-fcbb717f-dd3c-453e-ba7a-e9956b3a3088'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:30.791071 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fcbb717f-dd3c-453e-ba7a-e9956b3a3088 admin admin] The token cache is being invalidate because project b39ad0a67091427aa0efb1d1f141452e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:07:30.791356 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fcbb717f-dd3c-453e-ba7a-e9956b3a3088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:30.792160 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fcbb717f-dd3c-453e-ba7a-e9956b3a3088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:30.793826 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1491/2942] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 12:07:30 2022] DELETE /identity/v3/projects/b39ad0a67091427aa0efb1d1f141452e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:07:30.798250 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a6546-5d21-404d-9317-7a66fbed7579 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:30.809280 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a6546-5d21-404d-9317-7a66fbed7579 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:30.882279 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fa437-6784-4ed6-908b-5597dbd7d02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:30.883187 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fa437-6784-4ed6-908b-5597dbd7d02b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:30.883468 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fa437-6784-4ed6-908b-5597dbd7d02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:30.883738 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fa437-6784-4ed6-908b-5597dbd7d02b admin admin] PATH_INFO: `/v3/users/843675fca77a45ed80e82ed994f7e2f3` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:30.902060 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fa437-6784-4ed6-908b-5597dbd7d02b admin admin] RBAC: Authorizing `identity:delete_user(user_id=843675fca77a45ed80e82ed994f7e2f3)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:30.905606 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fa437-6784-4ed6-908b-5597dbd7d02b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:30.964418 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0a7fa437-6784-4ed6-908b-5597dbd7d02b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '843675fca77a45ed80e82ed994f7e2f3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:30.973379 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0a7fa437-6784-4ed6-908b-5597dbd7d02b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '843675fca77a45ed80e82ed994f7e2f3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:30.989245 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0a7fa437-6784-4ed6-908b-5597dbd7d02b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '843675fca77a45ed80e82ed994f7e2f3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:30.990032 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0a7fa437-6784-4ed6-908b-5597dbd7d02b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '843675fca77a45ed80e82ed994f7e2f3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:30.998220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0a7fa437-6784-4ed6-908b-5597dbd7d02b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '843675fca77a45ed80e82ed994f7e2f3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:31.005815 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1452/2943] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 12:07:30 2022] DELETE /identity/v3/users/843675fca77a45ed80e82ed994f7e2f3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:07:31.311557 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb717f-dd3c-453e-ba7a-e9956b3a3088 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:31.313559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fcbb717f-dd3c-453e-ba7a-e9956b3a3088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:31.334077 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb717f-dd3c-453e-ba7a-e9956b3a3088 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:31.415916 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbeb23a-59d6-4b25-bac8-753ba3d8c17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:31.416859 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbeb23a-59d6-4b25-bac8-753ba3d8c17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:31.417143 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbeb23a-59d6-4b25-bac8-753ba3d8c17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:31.417417 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbeb23a-59d6-4b25-bac8-753ba3d8c17c admin admin] PATH_INFO: `/v3/projects/91cf485d417b4bf5b9b96df0ecc72d7d` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:31.429554 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbeb23a-59d6-4b25-bac8-753ba3d8c17c admin admin] RBAC: Authorizing `identity:delete_project(project_id=91cf485d417b4bf5b9b96df0ecc72d7d)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:31.431839 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbeb23a-59d6-4b25-bac8-753ba3d8c17c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:31.447182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:07:31.502823 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9dbeb23a-59d6-4b25-bac8-753ba3d8c17c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91cf485d417b4bf5b9b96df0ecc72d7d', 'request_id': 'req-9dbeb23a-59d6-4b25-bac8-753ba3d8c17c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:31.512482 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9dbeb23a-59d6-4b25-bac8-753ba3d8c17c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91cf485d417b4bf5b9b96df0ecc72d7d', 'request_id': 'req-9dbeb23a-59d6-4b25-bac8-753ba3d8c17c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:31.519658 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9dbeb23a-59d6-4b25-bac8-753ba3d8c17c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91cf485d417b4bf5b9b96df0ecc72d7d', 'request_id': 'req-9dbeb23a-59d6-4b25-bac8-753ba3d8c17c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:31.533967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9dbeb23a-59d6-4b25-bac8-753ba3d8c17c admin admin] The token cache is being invalidate because project 91cf485d417b4bf5b9b96df0ecc72d7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:07:31.534276 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9dbeb23a-59d6-4b25-bac8-753ba3d8c17c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:31.534907 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9dbeb23a-59d6-4b25-bac8-753ba3d8c17c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:31.536461 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1492/2944] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 12:07:31 2022] DELETE /identity/v3/projects/91cf485d417b4bf5b9b96df0ecc72d7d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:07:31.542362 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e2677-4c6b-4a82-963c-8242be98c416 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:31.542712 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e2677-4c6b-4a82-963c-8242be98c416 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:31.543024 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e2677-4c6b-4a82-963c-8242be98c416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:31.589353 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-141e2677-4c6b-4a82-963c-8242be98c416 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:07:31.590589 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-141e2677-4c6b-4a82-963c-8242be98c416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:31.614973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:07:31.669990 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1453/2945] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 12:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:07:31.679251 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46c1e1-0d28-445d-855b-d936a9b96988 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:31.679538 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46c1e1-0d28-445d-855b-d936a9b96988 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:31.679790 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46c1e1-0d28-445d-855b-d936a9b96988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:31.699526 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ac46c1e1-0d28-445d-855b-d936a9b96988 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:07:31.700782 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ac46c1e1-0d28-445d-855b-d936a9b96988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:31.709008 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1493/2946] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 12:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:07:31.713759 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e2677-4c6b-4a82-963c-8242be98c416 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:31.725102 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e2677-4c6b-4a82-963c-8242be98c416 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:31.730832 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46ed04-bdac-457a-8ec5-0d7c6e41d283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:31.731544 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46ed04-bdac-457a-8ec5-0d7c6e41d283 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:31.731832 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46ed04-bdac-457a-8ec5-0d7c6e41d283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:31.732114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46ed04-bdac-457a-8ec5-0d7c6e41d283 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:31.732908 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46ed04-bdac-457a-8ec5-0d7c6e41d283 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:07:31.733217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46ed04-bdac-457a-8ec5-0d7c6e41d283 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:31.734907 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46ed04-bdac-457a-8ec5-0d7c6e41d283 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:31.748021 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1454/2947] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 12:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:07:31.753014 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46c1e1-0d28-445d-855b-d936a9b96988 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:31.763599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46c1e1-0d28-445d-855b-d936a9b96988 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:31.768462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad0377-6737-4955-a159-ec2038721d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:31.769185 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad0377-6737-4955-a159-ec2038721d68 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:31.769470 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad0377-6737-4955-a159-ec2038721d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:31.769746 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad0377-6737-4955-a159-ec2038721d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:31.770471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad0377-6737-4955-a159-ec2038721d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:31.772446 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad0377-6737-4955-a159-ec2038721d68 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:31.815025 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1494/2948] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 12:07:31 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:07:31.819374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46ed04-bdac-457a-8ec5-0d7c6e41d283 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:31.830494 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46ed04-bdac-457a-8ec5-0d7c6e41d283 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:31.894346 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb364eab-e3fc-4fdb-a11c-15a348aa82d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:31.895041 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb364eab-e3fc-4fdb-a11c-15a348aa82d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:31.895318 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb364eab-e3fc-4fdb-a11c-15a348aa82d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:31.895590 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb364eab-e3fc-4fdb-a11c-15a348aa82d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:31.896296 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb364eab-e3fc-4fdb-a11c-15a348aa82d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:31.898337 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb364eab-e3fc-4fdb-a11c-15a348aa82d2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:31.924145 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1455/2949] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 12:07:31 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:07:31.928486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad0377-6737-4955-a159-ec2038721d68 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:31.940797 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad0377-6737-4955-a159-ec2038721d68 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:31.946235 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d87b6-607a-4e4d-b548-7361ebe7f70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:31.947137 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d87b6-607a-4e4d-b548-7361ebe7f70f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:31.947411 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d87b6-607a-4e4d-b548-7361ebe7f70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:31.947682 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d87b6-607a-4e4d-b548-7361ebe7f70f admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:31.948433 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d87b6-607a-4e4d-b548-7361ebe7f70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:31.950203 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d87b6-607a-4e4d-b548-7361ebe7f70f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:31.961396 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1495/2950] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 12:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:07:31.966251 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb364eab-e3fc-4fdb-a11c-15a348aa82d2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:31.977533 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb364eab-e3fc-4fdb-a11c-15a348aa82d2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:31.983014 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c544404-1c5d-4603-aa3f-47538cbe48a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:31.983717 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c544404-1c5d-4603-aa3f-47538cbe48a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:31.983996 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c544404-1c5d-4603-aa3f-47538cbe48a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:31.984265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c544404-1c5d-4603-aa3f-47538cbe48a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:31.985037 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c544404-1c5d-4603-aa3f-47538cbe48a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:31.986708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c544404-1c5d-4603-aa3f-47538cbe48a4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:31.998314 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1456/2951] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 12:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:07:32.002990 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d87b6-607a-4e4d-b548-7361ebe7f70f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:32.020416 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d87b6-607a-4e4d-b548-7361ebe7f70f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:32.028343 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f8e16-0a70-4367-9b98-dc8c02af35ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:32.029967 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f8e16-0a70-4367-9b98-dc8c02af35ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:32.030465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f8e16-0a70-4367-9b98-dc8c02af35ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:32.030926 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f8e16-0a70-4367-9b98-dc8c02af35ea admin admin] PATH_INFO: `/v3/projects/6bffead897cd4f21a8850452486e151a/users/739b27bcd1664339b5541314f1d0b75d/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:32.057491 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f8e16-0a70-4367-9b98-dc8c02af35ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bffead897cd4f21a8850452486e151a, user_id=739b27bcd1664339b5541314f1d0b75d, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:32.060596 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f8e16-0a70-4367-9b98-dc8c02af35ea admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:32.075388 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1496/2952] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 12:07:32 2022] PUT /identity/v3/projects/6bffead897cd4f21a8850452486e151a/users/739b27bcd1664339b5541314f1d0b75d/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:07:32.080915 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f19499-d960-4829-aa29-a6af80ec817c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:32.081286 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f19499-d960-4829-aa29-a6af80ec817c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:32.081570 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f19499-d960-4829-aa29-a6af80ec817c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:32.101381 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e4f19499-d960-4829-aa29-a6af80ec817c None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:07:32.102615 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e4f19499-d960-4829-aa29-a6af80ec817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:32.184621 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1457/2953] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 12:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:07:32.196022 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f8e16-0a70-4367-9b98-dc8c02af35ea admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:32.198043 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-414f8e16-0a70-4367-9b98-dc8c02af35ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:32.287560 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f8e16-0a70-4367-9b98-dc8c02af35ea admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:32.292251 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bafea-3aeb-415f-bfd4-d2e2933c55b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:32.292962 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bafea-3aeb-415f-bfd4-d2e2933c55b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:32.293249 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bafea-3aeb-415f-bfd4-d2e2933c55b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:32.293526 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bafea-3aeb-415f-bfd4-d2e2933c55b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:32.308392 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3bafea-3aeb-415f-bfd4-d2e2933c55b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:32.310070 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3bafea-3aeb-415f-bfd4-d2e2933c55b6 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:32.322371 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1497/2954] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:07:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:07:37.660191 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cb460-b703-4816-b645-3e84d86ed560 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:37.660749 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cb460-b703-4816-b645-3e84d86ed560 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:37.660749 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cb460-b703-4816-b645-3e84d86ed560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:37.688825 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-cf7cb460-b703-4816-b645-3e84d86ed560 None None] MFA Rules not processed for user `739b27bcd1664339b5541314f1d0b75d`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:07:37.690049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cf7cb460-b703-4816-b645-3e84d86ed560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:37.711075 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:07:37.759513 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1458/2955] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 12:07:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:07:37.764934 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bafea-3aeb-415f-bfd4-d2e2933c55b6 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:37.777813 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bafea-3aeb-415f-bfd4-d2e2933c55b6 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:37.785407 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb2df1-2719-4d07-b117-896c5530d91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:37.786575 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb2df1-2719-4d07-b117-896c5530d91d admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:37.786862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb2df1-2719-4d07-b117-896c5530d91d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:37.787118 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb2df1-2719-4d07-b117-896c5530d91d admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:37.788036 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb2df1-2719-4d07-b117-896c5530d91d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:37.791011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb2df1-2719-4d07-b117-896c5530d91d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:37.820936 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1498/2956] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 12:07:37 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:07:37.825220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cb460-b703-4816-b645-3e84d86ed560 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:37.838054 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cb460-b703-4816-b645-3e84d86ed560 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:37.895552 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20640c8d-d863-4307-b36e-312e59e57352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:37.896233 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20640c8d-d863-4307-b36e-312e59e57352 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:37.896511 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20640c8d-d863-4307-b36e-312e59e57352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:37.896817 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20640c8d-d863-4307-b36e-312e59e57352 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:37.897515 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20640c8d-d863-4307-b36e-312e59e57352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:37.899434 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20640c8d-d863-4307-b36e-312e59e57352 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:37.920681 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1459/2957] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 12:07:37 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:07:37.926609 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb2df1-2719-4d07-b117-896c5530d91d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:37.944157 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb2df1-2719-4d07-b117-896c5530d91d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:37.949796 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40e1bd-d2fa-4bea-89cf-da3273e93fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:37.950494 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40e1bd-d2fa-4bea-89cf-da3273e93fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:37.950776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40e1bd-d2fa-4bea-89cf-da3273e93fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:37.951050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40e1bd-d2fa-4bea-89cf-da3273e93fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:37.951796 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40e1bd-d2fa-4bea-89cf-da3273e93fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:37.953467 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40e1bd-d2fa-4bea-89cf-da3273e93fc4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:37.954984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:07:37.972145 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1499/2958] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 12:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:07:37.974441 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20640c8d-d863-4307-b36e-312e59e57352 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:37.988892 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20640c8d-d863-4307-b36e-312e59e57352 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:37.994891 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9281930-9b40-42f2-9127-84040b8acc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:37.995826 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9281930-9b40-42f2-9127-84040b8acc9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:37.996104 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9281930-9b40-42f2-9127-84040b8acc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:37.996379 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9281930-9b40-42f2-9127-84040b8acc9f admin admin] PATH_INFO: `/v3/projects/444393d604f5449c8372b4f82fe198a9/users/425d36c7a3d64ed69726079e08076529/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:38.014345 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9281930-9b40-42f2-9127-84040b8acc9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=444393d604f5449c8372b4f82fe198a9, user_id=425d36c7a3d64ed69726079e08076529, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:38.017050 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9281930-9b40-42f2-9127-84040b8acc9f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:38.035524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1460/2959] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 12:07:37 2022] PUT /identity/v3/projects/444393d604f5449c8372b4f82fe198a9/users/425d36c7a3d64ed69726079e08076529/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:07:38.036405 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40e1bd-d2fa-4bea-89cf-da3273e93fc4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:38.047012 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40e1bd-d2fa-4bea-89cf-da3273e93fc4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:38.106089 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c45eec-44d0-4897-a4a4-704aa69ab6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:38.106818 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c45eec-44d0-4897-a4a4-704aa69ab6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:38.107087 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c45eec-44d0-4897-a4a4-704aa69ab6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:38.107378 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c45eec-44d0-4897-a4a4-704aa69ab6d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:38.108111 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c45eec-44d0-4897-a4a4-704aa69ab6d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:38.109770 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c45eec-44d0-4897-a4a4-704aa69ab6d6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:38.121035 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1500/2960] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 12:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:07:38.125534 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9281930-9b40-42f2-9127-84040b8acc9f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:38.136426 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9281930-9b40-42f2-9127-84040b8acc9f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:38.141836 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedd10d-e838-49c7-9a82-2bc425c8c381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:38.142713 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedd10d-e838-49c7-9a82-2bc425c8c381 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:38.142991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedd10d-e838-49c7-9a82-2bc425c8c381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:38.143281 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedd10d-e838-49c7-9a82-2bc425c8c381 admin admin] PATH_INFO: `/v3/projects/444393d604f5449c8372b4f82fe198a9/users/425d36c7a3d64ed69726079e08076529/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:38.145338 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedd10d-e838-49c7-9a82-2bc425c8c381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=444393d604f5449c8372b4f82fe198a9, user_id=425d36c7a3d64ed69726079e08076529, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:38.148060 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedd10d-e838-49c7-9a82-2bc425c8c381 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:38.162910 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1461/2961] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 12:07:38 2022] PUT /identity/v3/projects/444393d604f5449c8372b4f82fe198a9/users/425d36c7a3d64ed69726079e08076529/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:07:42.804818 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a798ce-2661-4322-90b0-4ffd926132f6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:42.805362 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a798ce-2661-4322-90b0-4ffd926132f6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:42.805611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a798ce-2661-4322-90b0-4ffd926132f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:42.842673 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b4a798ce-2661-4322-90b0-4ffd926132f6 None None] MFA Rules not processed for user `425d36c7a3d64ed69726079e08076529`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:07:42.844094 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b4a798ce-2661-4322-90b0-4ffd926132f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:42.942940 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1501/2962] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 12:07:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:07:42.960541 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedd10d-e838-49c7-9a82-2bc425c8c381 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:42.963531 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ebedd10d-e838-49c7-9a82-2bc425c8c381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:43.070426 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:07:43.079040 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedd10d-e838-49c7-9a82-2bc425c8c381 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:43.086890 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e9aa5-1ac8-4013-9f91-5323fd6b7ea9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:43.087514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e9aa5-1ac8-4013-9f91-5323fd6b7ea9 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:43.087801 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e9aa5-1ac8-4013-9f91-5323fd6b7ea9 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:43.088079 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e9aa5-1ac8-4013-9f91-5323fd6b7ea9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:43.156435 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e9aa5-1ac8-4013-9f91-5323fd6b7ea9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:43.158211 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e9aa5-1ac8-4013-9f91-5323fd6b7ea9 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:43.169354 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1462/2963] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:07:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:07:44.288008 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e734ce-f58a-455e-a433-2ab984452ad4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:44.288583 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e734ce-f58a-455e-a433-2ab984452ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:44.288583 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e734ce-f58a-455e-a433-2ab984452ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:44.308977 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-02e734ce-f58a-455e-a433-2ab984452ad4 None None] MFA Rules not processed for user `739b27bcd1664339b5541314f1d0b75d`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:07:44.310200 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-02e734ce-f58a-455e-a433-2ab984452ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:44.318299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1502/2964] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 12:07:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:07:53.164350 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=27 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:07:54.302542 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=68 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:08:00.788654 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e9aa5-1ac8-4013-9f91-5323fd6b7ea9 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:08:00.846273 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e9aa5-1ac8-4013-9f91-5323fd6b7ea9 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:08:00.850641 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4638d61-b524-43fc-b384-96be78c8f8ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:08:00.851292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4638d61-b524-43fc-b384-96be78c8f8ad service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:08:00.851572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4638d61-b524-43fc-b384-96be78c8f8ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:08:00.851844 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4638d61-b524-43fc-b384-96be78c8f8ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:08:00.861763 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4638d61-b524-43fc-b384-96be78c8f8ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:08:00.863200 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4638d61-b524-43fc-b384-96be78c8f8ad service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:08:00.874172 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1463/2965] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:08:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:08:10.868930 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=26 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:09:18.727441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e734ce-f58a-455e-a433-2ab984452ad4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:09:18.729279 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-02e734ce-f58a-455e-a433-2ab984452ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:09:18.742646 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e734ce-f58a-455e-a433-2ab984452ad4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:09:18.747559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b9afe-2807-46fc-95f4-182ccdf256a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:09:18.748214 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b9afe-2807-46fc-95f4-182ccdf256a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:09:18.748495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b9afe-2807-46fc-95f4-182ccdf256a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:09:18.748795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b9afe-2807-46fc-95f4-182ccdf256a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:09:18.750814 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-138b9afe-2807-46fc-95f4-182ccdf256a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:09:18.761078 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b9afe-2807-46fc-95f4-182ccdf256a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:09:18.762524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b9afe-2807-46fc-95f4-182ccdf256a4 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:09:18.771193 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1503/2966] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:09:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:09:28.767298 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:10:29.302677 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4638d61-b524-43fc-b384-96be78c8f8ad service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:10:29.304154 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c4638d61-b524-43fc-b384-96be78c8f8ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:10:29.361802 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4638d61-b524-43fc-b384-96be78c8f8ad service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:10:29.365815 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe8aaf-c271-4111-8d3a-cb43deafb306 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bcfbee5a5e4016a77901d0a637da63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:10:29.366463 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe8aaf-c271-4111-8d3a-cb43deafb306 service glance] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:10:29.366748 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe8aaf-c271-4111-8d3a-cb43deafb306 service glance] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:10:29.366996 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe8aaf-c271-4111-8d3a-cb43deafb306 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:10:29.369012 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-18fe8aaf-c271-4111-8d3a-cb43deafb306 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:10:29.382881 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe8aaf-c271-4111-8d3a-cb43deafb306 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:10:29.384311 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe8aaf-c271-4111-8d3a-cb43deafb306 service glance] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:10:29.395488 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1464/2967] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:10:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:10:29.664487 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b9afe-2807-46fc-95f4-182ccdf256a4 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:10:29.673898 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b9afe-2807-46fc-95f4-182ccdf256a4 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:10:29.678468 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31662b-ac43-41a1-b203-e93cf2ae83ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:10:29.679182 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31662b-ac43-41a1-b203-e93cf2ae83ad service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:10:29.679462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31662b-ac43-41a1-b203-e93cf2ae83ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:10:29.679867 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31662b-ac43-41a1-b203-e93cf2ae83ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:10:29.682086 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9d31662b-ac43-41a1-b203-e93cf2ae83ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:10:29.696119 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31662b-ac43-41a1-b203-e93cf2ae83ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:10:29.697537 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31662b-ac43-41a1-b203-e93cf2ae83ad service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:10:29.709590 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1504/2968] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:10:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:10:39.390641 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=26 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:10:39.704129 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:10:46.141512 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bd5dc-3662-4cb4-9f18-efc3da84f455 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:10:46.142099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bd5dc-3662-4cb4-9f18-efc3da84f455 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:10:46.142099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bd5dc-3662-4cb4-9f18-efc3da84f455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:10:46.197478 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-897bd5dc-3662-4cb4-9f18-efc3da84f455 None None] MFA Rules not processed for user `654631b067b94b269f93ea7b3977609d`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:10:46.198720 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-897bd5dc-3662-4cb4-9f18-efc3da84f455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:10:46.271805 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1465/2969] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 19 12:10:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:10:46.326169 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017079c1-6e34-422a-97cd-c8958fa20265 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:10:46.326693 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017079c1-6e34-422a-97cd-c8958fa20265 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:10:46.327000 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017079c1-6e34-422a-97cd-c8958fa20265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:10:46.378890 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-017079c1-6e34-422a-97cd-c8958fa20265 None None] MFA Rules not processed for user `4fa6a9aa611640f893b5e717a094acf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:10:46.380104 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-017079c1-6e34-422a-97cd-c8958fa20265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:10:46.464855 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1505/2970] 10.222.0.18 () {58 vars in 1040 bytes} [Tue Jul 19 12:10:46 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:10:46.471870 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897bd5dc-3662-4cb4-9f18-efc3da84f455 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:10:46.485328 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897bd5dc-3662-4cb4-9f18-efc3da84f455 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:10:46.490947 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0590bc-a7dc-4c2d-89fe-35f991c36def service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa6a9aa611640f893b5e717a094acf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:10:46.491601 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0590bc-a7dc-4c2d-89fe-35f991c36def service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:10:46.491908 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0590bc-a7dc-4c2d-89fe-35f991c36def service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:10:46.492183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0590bc-a7dc-4c2d-89fe-35f991c36def service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:10:46.502422 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0590bc-a7dc-4c2d-89fe-35f991c36def service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:10:46.504588 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0590bc-a7dc-4c2d-89fe-35f991c36def service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:10:46.518221 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1466/2971] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 19 12:10:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 12:10:56.461984 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=44 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:10:56.512582 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=46 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:10:58.402506 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6de027-40a6-4da2-b8d9-5612379699a3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:10:58.403167 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6de027-40a6-4da2-b8d9-5612379699a3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:10:58.403167 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6de027-40a6-4da2-b8d9-5612379699a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:10:58.447799 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8e6de027-40a6-4da2-b8d9-5612379699a3 None None] MFA Rules not processed for user `07eaacc831ae481d99e8ab03ee295e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:10:58.449053 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8e6de027-40a6-4da2-b8d9-5612379699a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:10:58.456908 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1506/2972] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 19 12:10:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:10:58.469164 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0590bc-a7dc-4c2d-89fe-35f991c36def service swift] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:10:58.479767 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0590bc-a7dc-4c2d-89fe-35f991c36def service swift] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:10:58.483719 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092cfc7-a65a-4d6d-8465-68a5fd842182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:10:58.484381 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092cfc7-a65a-4d6d-8465-68a5fd842182 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:10:58.484667 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092cfc7-a65a-4d6d-8465-68a5fd842182 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:10:58.484999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092cfc7-a65a-4d6d-8465-68a5fd842182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:10:58.492929 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092cfc7-a65a-4d6d-8465-68a5fd842182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:10:58.494374 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092cfc7-a65a-4d6d-8465-68a5fd842182 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:10:58.504264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1467/2973] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:10:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:10:58.620286 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaf402-d240-47db-9466-b7834f277568 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:10:58.620533 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaf402-d240-47db-9466-b7834f277568 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:10:58.620879 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaf402-d240-47db-9466-b7834f277568 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:10:58.622292 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1507/2974] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 19 12:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:10:58.627680 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c4c1f-270e-4746-bda2-5dd05cc91d11 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:10:58.627973 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c4c1f-270e-4746-bda2-5dd05cc91d11 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:10:58.628249 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c4c1f-270e-4746-bda2-5dd05cc91d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:10:58.648569 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6b8c4c1f-270e-4746-bda2-5dd05cc91d11 None None] MFA Rules not processed for user `3c50a821e9ef44cb9fccd49ee4af7dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:10:58.649894 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6b8c4c1f-270e-4746-bda2-5dd05cc91d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:10:58.660589 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1468/2975] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 19 12:10:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:10:58.672699 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aaf402-d240-47db-9466-b7834f277568 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:10:58.684942 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aaf402-d240-47db-9466-b7834f277568 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:10:58.688751 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0fb1c-23b1-4f87-8e56-b2bf3bf6320a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bcfbee5a5e4016a77901d0a637da63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:10:58.689411 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0fb1c-23b1-4f87-8e56-b2bf3bf6320a service glance] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:10:58.689715 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0fb1c-23b1-4f87-8e56-b2bf3bf6320a service glance] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:10:58.689965 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0fb1c-23b1-4f87-8e56-b2bf3bf6320a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:10:58.701462 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0fb1c-23b1-4f87-8e56-b2bf3bf6320a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:10:58.702911 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0fb1c-23b1-4f87-8e56-b2bf3bf6320a service glance] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:10:58.714289 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1508/2976] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:10:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:10:58.781903 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c4c1f-270e-4746-bda2-5dd05cc91d11 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:10:58.791462 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c4c1f-270e-4746-bda2-5dd05cc91d11 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:10:58.795262 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be53efe-69ff-4443-bda3-5c4afc13c457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:10:58.795913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be53efe-69ff-4443-bda3-5c4afc13c457 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:10:58.796200 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be53efe-69ff-4443-bda3-5c4afc13c457 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:10:58.796475 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be53efe-69ff-4443-bda3-5c4afc13c457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:10:58.798390 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8be53efe-69ff-4443-bda3-5c4afc13c457 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:10:58.808060 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be53efe-69ff-4443-bda3-5c4afc13c457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:10:58.809535 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be53efe-69ff-4443-bda3-5c4afc13c457 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:10:58.818030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1469/2977] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:10:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:10:58.895249 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0fb1c-23b1-4f87-8e56-b2bf3bf6320a service glance] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:10:58.905783 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0fb1c-23b1-4f87-8e56-b2bf3bf6320a service glance] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:10:58.909929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72819f0a-0674-4a40-94eb-c0239bf82818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:10:58.910570 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72819f0a-0674-4a40-94eb-c0239bf82818 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:10:58.910847 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72819f0a-0674-4a40-94eb-c0239bf82818 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:10:58.911136 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72819f0a-0674-4a40-94eb-c0239bf82818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:10:58.913073 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-72819f0a-0674-4a40-94eb-c0239bf82818 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:10:58.927481 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72819f0a-0674-4a40-94eb-c0239bf82818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:10:58.928644 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72819f0a-0674-4a40-94eb-c0239bf82818 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:10:58.940176 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1509/2978] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:10:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:11:00.751496 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48c7bf-e4bf-4815-a664-b99d4d1dc60e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:11:00.752167 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48c7bf-e4bf-4815-a664-b99d4d1dc60e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:11:00.752167 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48c7bf-e4bf-4815-a664-b99d4d1dc60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:11:00.771163 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ad48c7bf-e4bf-4815-a664-b99d4d1dc60e None None] MFA Rules not processed for user `654631b067b94b269f93ea7b3977609d`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:11:00.772403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ad48c7bf-e4bf-4815-a664-b99d4d1dc60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:11:00.782065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1470/2979] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 19 12:11:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:11:00.797881 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72819f0a-0674-4a40-94eb-c0239bf82818 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:11:00.810179 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72819f0a-0674-4a40-94eb-c0239bf82818 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:11:00.816881 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea500a-e6c4-442d-b1bc-ccfb79856ec2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa6a9aa611640f893b5e717a094acf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:11:00.817705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea500a-e6c4-442d-b1bc-ccfb79856ec2 service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:11:00.818115 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea500a-e6c4-442d-b1bc-ccfb79856ec2 service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:11:00.818456 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea500a-e6c4-442d-b1bc-ccfb79856ec2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:11:00.829792 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea500a-e6c4-442d-b1bc-ccfb79856ec2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:11:00.831397 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea500a-e6c4-442d-b1bc-ccfb79856ec2 service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:11:00.840227 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1510/2980] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 19 12:11:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:11:10.765189 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=18 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:11:10.836643 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=27 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:11:17.374388 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af2f68-82ca-44c6-8195-c9cf100eddc1 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:11:17.374895 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af2f68-82ca-44c6-8195-c9cf100eddc1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:11:17.375011 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af2f68-82ca-44c6-8195-c9cf100eddc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:11:17.393730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-18af2f68-82ca-44c6-8195-c9cf100eddc1 None None] MFA Rules not processed for user `654631b067b94b269f93ea7b3977609d`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:11:17.395025 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-18af2f68-82ca-44c6-8195-c9cf100eddc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:11:17.402421 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1471/2981] 10.222.0.18 () {58 vars in 967 bytes} [Tue Jul 19 12:11:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:11:17.414900 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea500a-e6c4-442d-b1bc-ccfb79856ec2 service swift] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:11:17.426711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea500a-e6c4-442d-b1bc-ccfb79856ec2 service swift] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:11:17.432737 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195acaf5-6d45-4f16-aa3a-1447f183f4b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa6a9aa611640f893b5e717a094acf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:11:17.433425 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195acaf5-6d45-4f16-aa3a-1447f183f4b1 service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:11:17.433705 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195acaf5-6d45-4f16-aa3a-1447f183f4b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:11:17.433978 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195acaf5-6d45-4f16-aa3a-1447f183f4b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:11:17.442962 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195acaf5-6d45-4f16-aa3a-1447f183f4b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:11:17.444581 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195acaf5-6d45-4f16-aa3a-1447f183f4b1 service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:11:17.453795 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1511/2982] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 19 12:11:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 12:11:18.692742 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af2f68-82ca-44c6-8195-c9cf100eddc1 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:11:18.694152 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-18af2f68-82ca-44c6-8195-c9cf100eddc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:11:18.710039 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af2f68-82ca-44c6-8195-c9cf100eddc1 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:11:18.715932 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976695ed-354c-4a13-9eaf-2ff9efc8a4c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:11:18.716591 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976695ed-354c-4a13-9eaf-2ff9efc8a4c8 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:11:18.716971 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976695ed-354c-4a13-9eaf-2ff9efc8a4c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:11:18.717248 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976695ed-354c-4a13-9eaf-2ff9efc8a4c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:11:18.719027 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-976695ed-354c-4a13-9eaf-2ff9efc8a4c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:11:18.730979 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976695ed-354c-4a13-9eaf-2ff9efc8a4c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:11:18.732603 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976695ed-354c-4a13-9eaf-2ff9efc8a4c8 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:11:18.743097 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1472/2983] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:11:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:11:27.450348 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:11:28.738933 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=9 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:12:47.563863 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195acaf5-6d45-4f16-aa3a-1447f183f4b1 service swift] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:12:47.575173 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195acaf5-6d45-4f16-aa3a-1447f183f4b1 service swift] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:12:47.579920 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c7321-6bfe-4c10-af9f-076e23e4f77a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:12:47.580582 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c7321-6bfe-4c10-af9f-076e23e4f77a service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:12:47.580937 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c7321-6bfe-4c10-af9f-076e23e4f77a service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:12:47.581211 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c7321-6bfe-4c10-af9f-076e23e4f77a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:12:47.591331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c7321-6bfe-4c10-af9f-076e23e4f77a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:12:47.592811 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c7321-6bfe-4c10-af9f-076e23e4f77a service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:12:47.602438 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1512/2984] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:12:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:12:48.846452 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976695ed-354c-4a13-9eaf-2ff9efc8a4c8 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:12:48.858151 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976695ed-354c-4a13-9eaf-2ff9efc8a4c8 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:12:48.865724 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980072f7-18f1-4c61-ac79-49eb87a3930f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:12:48.866402 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980072f7-18f1-4c61-ac79-49eb87a3930f service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:12:48.866948 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980072f7-18f1-4c61-ac79-49eb87a3930f service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:12:48.867289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980072f7-18f1-4c61-ac79-49eb87a3930f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:12:48.869320 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-980072f7-18f1-4c61-ac79-49eb87a3930f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:12:48.883594 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980072f7-18f1-4c61-ac79-49eb87a3930f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:12:48.885477 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980072f7-18f1-4c61-ac79-49eb87a3930f service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:12:48.897495 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1473/2985] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:12:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:12:51.115189 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c7321-6bfe-4c10-af9f-076e23e4f77a service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:12:51.132342 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c7321-6bfe-4c10-af9f-076e23e4f77a service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:12:51.138249 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e354ad-7346-48f2-bd4e-1816c5736bec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:12:51.138912 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e354ad-7346-48f2-bd4e-1816c5736bec service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:12:51.139189 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e354ad-7346-48f2-bd4e-1816c5736bec service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:12:51.139540 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e354ad-7346-48f2-bd4e-1816c5736bec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:12:51.141463 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-61e354ad-7346-48f2-bd4e-1816c5736bec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:12:51.155523 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e354ad-7346-48f2-bd4e-1816c5736bec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:12:51.157845 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e354ad-7346-48f2-bd4e-1816c5736bec service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:12:51.172060 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1513/2986] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:12:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:12:51.524306 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980072f7-18f1-4c61-ac79-49eb87a3930f service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:12:51.525793 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-980072f7-18f1-4c61-ac79-49eb87a3930f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:12:51.613203 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980072f7-18f1-4c61-ac79-49eb87a3930f service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:12:51.618684 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaaf887-39d6-4dba-90c5-6544e617fd87 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:12:51.619342 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaf887-39d6-4dba-90c5-6544e617fd87 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:12:51.619626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaf887-39d6-4dba-90c5-6544e617fd87 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:12:51.619900 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaf887-39d6-4dba-90c5-6544e617fd87 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:12:51.621718 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-deaaf887-39d6-4dba-90c5-6544e617fd87 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:12:51.633585 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaaf887-39d6-4dba-90c5-6544e617fd87 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:12:51.635121 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaaf887-39d6-4dba-90c5-6544e617fd87 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:12:51.645473 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1474/2987] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:12:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:12:55.808088 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a3697-cb73-41bc-9357-de6869ba3b16 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:12:55.808662 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a3697-cb73-41bc-9357-de6869ba3b16 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:12:55.808662 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a3697-cb73-41bc-9357-de6869ba3b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:12:55.828226 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ef5a3697-cb73-41bc-9357-de6869ba3b16 None None] MFA Rules not processed for user `739b27bcd1664339b5541314f1d0b75d`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:12:55.829471 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ef5a3697-cb73-41bc-9357-de6869ba3b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:12:55.837612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1514/2988] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 12:12:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:13:01.641069 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=43 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:13:05.822799 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=15 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:13:12.479703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaaf887-39d6-4dba-90c5-6544e617fd87 service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:13:12.490499 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaaf887-39d6-4dba-90c5-6544e617fd87 service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:13:12.495050 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21a8d9-3e48-45d1-ab1c-ff35670c2539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:13:12.495720 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21a8d9-3e48-45d1-ab1c-ff35670c2539 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:12.496004 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21a8d9-3e48-45d1-ab1c-ff35670c2539 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:12.496276 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21a8d9-3e48-45d1-ab1c-ff35670c2539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:12.498437 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fc21a8d9-3e48-45d1-ab1c-ff35670c2539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:13:12.510150 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21a8d9-3e48-45d1-ab1c-ff35670c2539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:13:12.511625 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21a8d9-3e48-45d1-ab1c-ff35670c2539 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:13:12.521318 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1475/2989] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:13:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:13:15.056476 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a3697-cb73-41bc-9357-de6869ba3b16 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:13:15.073235 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a3697-cb73-41bc-9357-de6869ba3b16 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:13:15.079269 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d2813-aedd-4ff0-ac70-7d97953e0a35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:13:15.080006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d2813-aedd-4ff0-ac70-7d97953e0a35 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:15.080325 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d2813-aedd-4ff0-ac70-7d97953e0a35 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:15.080492 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d2813-aedd-4ff0-ac70-7d97953e0a35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:15.082458 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2c2d2813-aedd-4ff0-ac70-7d97953e0a35 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:13:15.095038 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d2813-aedd-4ff0-ac70-7d97953e0a35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:13:15.096652 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d2813-aedd-4ff0-ac70-7d97953e0a35 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:13:15.107528 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1515/2990] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:13:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:13:22.516798 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:13:25.103046 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:13:37.757277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21a8d9-3e48-45d1-ab1c-ff35670c2539 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:13:37.772357 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21a8d9-3e48-45d1-ab1c-ff35670c2539 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:13:37.778232 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2ed92-e7f7-450f-899c-8561620f7e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:13:37.779277 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2ed92-e7f7-450f-899c-8561620f7e3b service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:37.779703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2ed92-e7f7-450f-899c-8561620f7e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:37.780166 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2ed92-e7f7-450f-899c-8561620f7e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:37.797283 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2ed92-e7f7-450f-899c-8561620f7e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:13:37.800052 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2ed92-e7f7-450f-899c-8561620f7e3b service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:13:37.818723 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1476/2991] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:13:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:13:47.809942 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:14:20.681949 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d2813-aedd-4ff0-ac70-7d97953e0a35 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:20.692405 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d2813-aedd-4ff0-ac70-7d97953e0a35 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:20.696752 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60728616-d1fb-48e5-a38d-80d3043f7d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:20.697341 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60728616-d1fb-48e5-a38d-80d3043f7d2e service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:20.697614 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60728616-d1fb-48e5-a38d-80d3043f7d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:20.697859 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60728616-d1fb-48e5-a38d-80d3043f7d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:20.707790 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60728616-d1fb-48e5-a38d-80d3043f7d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:20.709234 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60728616-d1fb-48e5-a38d-80d3043f7d2e service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:20.720126 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1516/2992] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:14:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:14:30.716012 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:15:36.951617 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2ed92-e7f7-450f-899c-8561620f7e3b service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:15:36.961068 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2ed92-e7f7-450f-899c-8561620f7e3b service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:15:36.965290 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd59694-2700-4023-a0b2-b53ee75d3a10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:15:36.965991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd59694-2700-4023-a0b2-b53ee75d3a10 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:15:36.966302 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd59694-2700-4023-a0b2-b53ee75d3a10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:15:36.966555 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd59694-2700-4023-a0b2-b53ee75d3a10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:15:36.978681 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd59694-2700-4023-a0b2-b53ee75d3a10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:15:36.980006 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd59694-2700-4023-a0b2-b53ee75d3a10 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:15:36.991035 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1477/2993] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:15:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:15:38.191155 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60728616-d1fb-48e5-a38d-80d3043f7d2e service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:15:38.204332 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60728616-d1fb-48e5-a38d-80d3043f7d2e service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:15:38.210457 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a29fd9-1c59-4648-a39b-aaea4156fd2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:15:38.211141 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a29fd9-1c59-4648-a39b-aaea4156fd2d service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:15:38.211411 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a29fd9-1c59-4648-a39b-aaea4156fd2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:15:38.211684 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a29fd9-1c59-4648-a39b-aaea4156fd2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:15:38.226395 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a29fd9-1c59-4648-a39b-aaea4156fd2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:15:38.228645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a29fd9-1c59-4648-a39b-aaea4156fd2d service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:15:38.242334 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1517/2994] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:15:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:15:46.986115 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:15:48.236251 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:15:51.735501 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd59694-2700-4023-a0b2-b53ee75d3a10 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:15:51.736991 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4fd59694-2700-4023-a0b2-b53ee75d3a10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:15:51.751896 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd59694-2700-4023-a0b2-b53ee75d3a10 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:15:51.757823 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e3839-aec0-4fea-b08e-9c2c2cea02d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:15:51.758465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e3839-aec0-4fea-b08e-9c2c2cea02d1 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:15:51.758776 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e3839-aec0-4fea-b08e-9c2c2cea02d1 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:15:51.759047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e3839-aec0-4fea-b08e-9c2c2cea02d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:15:51.760913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ff0e3839-aec0-4fea-b08e-9c2c2cea02d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:15:51.772655 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e3839-aec0-4fea-b08e-9c2c2cea02d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:15:51.774289 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e3839-aec0-4fea-b08e-9c2c2cea02d1 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:15:51.784744 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1478/2995] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:15:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:16:01.780246 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:35.658711 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a29fd9-1c59-4648-a39b-aaea4156fd2d service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:35.660422 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-69a29fd9-1c59-4648-a39b-aaea4156fd2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:35.729678 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a29fd9-1c59-4648-a39b-aaea4156fd2d service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:35.733517 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c2ab1-7d55-47e6-b853-cc5287718fe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:35.734205 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c2ab1-7d55-47e6-b853-cc5287718fe3 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:35.734478 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c2ab1-7d55-47e6-b853-cc5287718fe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:35.734745 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c2ab1-7d55-47e6-b853-cc5287718fe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:35.736635 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-599c2ab1-7d55-47e6-b853-cc5287718fe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:35.844938 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c2ab1-7d55-47e6-b853-cc5287718fe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:35.846349 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c2ab1-7d55-47e6-b853-cc5287718fe3 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:35.866080 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1518/2996] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:17:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:17:39.118635 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e3839-aec0-4fea-b08e-9c2c2cea02d1 service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:39.231987 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e3839-aec0-4fea-b08e-9c2c2cea02d1 service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:39.237311 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d7e46-1576-40d0-b101-9420a5ebb52b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:39.238047 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d7e46-1576-40d0-b101-9420a5ebb52b service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:39.238385 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d7e46-1576-40d0-b101-9420a5ebb52b service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:39.238720 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d7e46-1576-40d0-b101-9420a5ebb52b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:39.240562 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7c6d7e46-1576-40d0-b101-9420a5ebb52b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:39.253511 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d7e46-1576-40d0-b101-9420a5ebb52b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:39.254923 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d7e46-1576-40d0-b101-9420a5ebb52b service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:39.265145 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1479/2997] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:17:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:17:42.207251 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c2ab1-7d55-47e6-b853-cc5287718fe3 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:42.209078 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-599c2ab1-7d55-47e6-b853-cc5287718fe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:42.224624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c2ab1-7d55-47e6-b853-cc5287718fe3 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:42.229709 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fa357-3192-4868-970b-aae7b181e326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:42.230672 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fa357-3192-4868-970b-aae7b181e326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:42.231079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fa357-3192-4868-970b-aae7b181e326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:42.231285 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fa357-3192-4868-970b-aae7b181e326 admin admin] PATH_INFO: `/v3/users/739b27bcd1664339b5541314f1d0b75d` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:42.251222 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fa357-3192-4868-970b-aae7b181e326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=739b27bcd1664339b5541314f1d0b75d)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:42.253192 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fa357-3192-4868-970b-aae7b181e326 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:42.298486 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:42.309283 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4d2fa357-3192-4868-970b-aae7b181e326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '739b27bcd1664339b5541314f1d0b75d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:17:42.317945 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4d2fa357-3192-4868-970b-aae7b181e326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '739b27bcd1664339b5541314f1d0b75d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:17:42.329367 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4d2fa357-3192-4868-970b-aae7b181e326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '739b27bcd1664339b5541314f1d0b75d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:17:42.330295 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4d2fa357-3192-4868-970b-aae7b181e326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '739b27bcd1664339b5541314f1d0b75d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:17:42.331248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4d2fa357-3192-4868-970b-aae7b181e326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '739b27bcd1664339b5541314f1d0b75d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:17:42.353105 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1519/2998] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 12:17:42 2022] DELETE /identity/v3/users/739b27bcd1664339b5541314f1d0b75d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:17:42.538461 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d7e46-1576-40d0-b101-9420a5ebb52b service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:42.554545 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d7e46-1576-40d0-b101-9420a5ebb52b service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:42.614713 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56406470-d948-452d-bc07-e07477410f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:42.615499 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56406470-d948-452d-bc07-e07477410f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:42.615779 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56406470-d948-452d-bc07-e07477410f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:42.616054 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56406470-d948-452d-bc07-e07477410f83 admin admin] PATH_INFO: `/v3/projects/6bffead897cd4f21a8850452486e151a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:42.627049 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56406470-d948-452d-bc07-e07477410f83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bffead897cd4f21a8850452486e151a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:42.629059 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56406470-d948-452d-bc07-e07477410f83 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:42.680849 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-56406470-d948-452d-bc07-e07477410f83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bffead897cd4f21a8850452486e151a', 'request_id': 'req-56406470-d948-452d-bc07-e07477410f83'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:17:42.689703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-56406470-d948-452d-bc07-e07477410f83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bffead897cd4f21a8850452486e151a', 'request_id': 'req-56406470-d948-452d-bc07-e07477410f83'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:17:42.695730 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-56406470-d948-452d-bc07-e07477410f83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bffead897cd4f21a8850452486e151a', 'request_id': 'req-56406470-d948-452d-bc07-e07477410f83'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:17:42.708517 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-56406470-d948-452d-bc07-e07477410f83 admin admin] The token cache is being invalidate because project 6bffead897cd4f21a8850452486e151a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:17:42.708837 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-56406470-d948-452d-bc07-e07477410f83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:17:42.709524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-56406470-d948-452d-bc07-e07477410f83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:17:42.711073 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1480/2999] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 12:17:42 2022] DELETE /identity/v3/projects/6bffead897cd4f21a8850452486e151a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:17:42.715291 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fa357-3192-4868-970b-aae7b181e326 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:42.716832 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4d2fa357-3192-4868-970b-aae7b181e326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:42.730943 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fa357-3192-4868-970b-aae7b181e326 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:42.795144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5fe87-4f9a-4626-a25e-0a3775a0caa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:42.796050 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5fe87-4f9a-4626-a25e-0a3775a0caa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:42.796331 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5fe87-4f9a-4626-a25e-0a3775a0caa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:42.796777 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5fe87-4f9a-4626-a25e-0a3775a0caa6 admin admin] PATH_INFO: `/v3/users/425d36c7a3d64ed69726079e08076529` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:42.813473 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5fe87-4f9a-4626-a25e-0a3775a0caa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=425d36c7a3d64ed69726079e08076529)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:42.815469 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5fe87-4f9a-4626-a25e-0a3775a0caa6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:42.868282 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4bc5fe87-4f9a-4626-a25e-0a3775a0caa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '425d36c7a3d64ed69726079e08076529'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:17:42.877480 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4bc5fe87-4f9a-4626-a25e-0a3775a0caa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '425d36c7a3d64ed69726079e08076529'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:17:42.886884 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4bc5fe87-4f9a-4626-a25e-0a3775a0caa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '425d36c7a3d64ed69726079e08076529'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:17:42.887653 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4bc5fe87-4f9a-4626-a25e-0a3775a0caa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '425d36c7a3d64ed69726079e08076529'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:17:42.888312 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4bc5fe87-4f9a-4626-a25e-0a3775a0caa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '425d36c7a3d64ed69726079e08076529'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:17:42.908281 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1520/3000] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 12:17:42 2022] DELETE /identity/v3/users/425d36c7a3d64ed69726079e08076529 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:17:43.102356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56406470-d948-452d-bc07-e07477410f83 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:43.103887 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-56406470-d948-452d-bc07-e07477410f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:43.117514 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56406470-d948-452d-bc07-e07477410f83 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:43.140364 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:43.182123 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9272523-d686-4cd8-8e0a-09788c098f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:43.182975 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9272523-d686-4cd8-8e0a-09788c098f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:43.183256 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9272523-d686-4cd8-8e0a-09788c098f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:43.183528 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9272523-d686-4cd8-8e0a-09788c098f04 admin admin] PATH_INFO: `/v3/projects/444393d604f5449c8372b4f82fe198a9` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:43.195206 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9272523-d686-4cd8-8e0a-09788c098f04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=444393d604f5449c8372b4f82fe198a9)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:43.197179 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9272523-d686-4cd8-8e0a-09788c098f04 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:43.244175 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f9272523-d686-4cd8-8e0a-09788c098f04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '444393d604f5449c8372b4f82fe198a9', 'request_id': 'req-f9272523-d686-4cd8-8e0a-09788c098f04'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:17:43.252708 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f9272523-d686-4cd8-8e0a-09788c098f04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '444393d604f5449c8372b4f82fe198a9', 'request_id': 'req-f9272523-d686-4cd8-8e0a-09788c098f04'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:17:43.258877 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f9272523-d686-4cd8-8e0a-09788c098f04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '444393d604f5449c8372b4f82fe198a9', 'request_id': 'req-f9272523-d686-4cd8-8e0a-09788c098f04'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:17:43.270999 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f9272523-d686-4cd8-8e0a-09788c098f04 admin admin] The token cache is being invalidate because project 444393d604f5449c8372b4f82fe198a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:17:43.271292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f9272523-d686-4cd8-8e0a-09788c098f04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:17:43.272030 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f9272523-d686-4cd8-8e0a-09788c098f04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:17:43.273742 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1481/3001] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 12:17:43 2022] DELETE /identity/v3/projects/444393d604f5449c8372b4f82fe198a9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:17:43.279275 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac07e5a-5a59-4aea-939b-647c51642fdb None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:43.279830 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac07e5a-5a59-4aea-939b-647c51642fdb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:43.279830 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac07e5a-5a59-4aea-939b-647c51642fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:43.320020 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:43.341524 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4ac07e5a-5a59-4aea-939b-647c51642fdb None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:43.342754 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4ac07e5a-5a59-4aea-939b-647c51642fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:43.405885 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1521/3002] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 12:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:17:43.414215 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cd8f4-d60d-4270-b58f-40e3513090f5 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:43.414501 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cd8f4-d60d-4270-b58f-40e3513090f5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:43.414772 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cd8f4-d60d-4270-b58f-40e3513090f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:43.433626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-474cd8f4-d60d-4270-b58f-40e3513090f5 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:43.434838 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-474cd8f4-d60d-4270-b58f-40e3513090f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:43.443040 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1482/3003] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 12:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:17:43.447464 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac07e5a-5a59-4aea-939b-647c51642fdb None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:43.457680 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac07e5a-5a59-4aea-939b-647c51642fdb None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:43.462622 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3e152-dd8a-4042-90aa-ca1950991efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:43.463293 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3e152-dd8a-4042-90aa-ca1950991efd admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:43.463583 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3e152-dd8a-4042-90aa-ca1950991efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:43.463853 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3e152-dd8a-4042-90aa-ca1950991efd admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:43.464549 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3e152-dd8a-4042-90aa-ca1950991efd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:43.464869 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3e152-dd8a-4042-90aa-ca1950991efd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:43.466494 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3e152-dd8a-4042-90aa-ca1950991efd admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:43.480528 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1522/3004] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jul 19 12:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:43.485949 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474cd8f4-d60d-4270-b58f-40e3513090f5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:43.498116 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474cd8f4-d60d-4270-b58f-40e3513090f5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:43.507524 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7c7ee-09c0-4200-b350-8b89e68a36ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:43.508557 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7c7ee-09c0-4200-b350-8b89e68a36ee admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:43.509065 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7c7ee-09c0-4200-b350-8b89e68a36ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:43.509510 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7c7ee-09c0-4200-b350-8b89e68a36ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:43.510626 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7c7ee-09c0-4200-b350-8b89e68a36ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:43.513703 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7c7ee-09c0-4200-b350-8b89e68a36ee admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:43.559371 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1483/3005] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 12:17:43 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:17:43.564397 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3e152-dd8a-4042-90aa-ca1950991efd admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:43.575832 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3e152-dd8a-4042-90aa-ca1950991efd admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:43.640094 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b35114-bccc-4460-a27d-c23bad75c8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:43.640813 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b35114-bccc-4460-a27d-c23bad75c8da admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:43.641100 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b35114-bccc-4460-a27d-c23bad75c8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:43.641377 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b35114-bccc-4460-a27d-c23bad75c8da admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:43.642068 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b35114-bccc-4460-a27d-c23bad75c8da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:43.643995 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b35114-bccc-4460-a27d-c23bad75c8da admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:43.665099 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1523/3006] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 12:17:43 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:17:43.669272 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7c7ee-09c0-4200-b350-8b89e68a36ee admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:43.680583 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7c7ee-09c0-4200-b350-8b89e68a36ee admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:43.685380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10d5cc-345d-41c0-9b74-8dfa4115846d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:43.686262 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10d5cc-345d-41c0-9b74-8dfa4115846d admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:43.686753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10d5cc-345d-41c0-9b74-8dfa4115846d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:43.687203 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10d5cc-345d-41c0-9b74-8dfa4115846d admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:43.688407 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10d5cc-345d-41c0-9b74-8dfa4115846d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:43.690643 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10d5cc-345d-41c0-9b74-8dfa4115846d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:43.702552 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1484/3007] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 12:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:17:43.706774 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b35114-bccc-4460-a27d-c23bad75c8da admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:43.717721 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b35114-bccc-4460-a27d-c23bad75c8da admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:43.723635 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bae89-fdee-4806-8638-57f0802c87b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:43.724307 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bae89-fdee-4806-8638-57f0802c87b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:43.724579 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bae89-fdee-4806-8638-57f0802c87b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:43.724956 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bae89-fdee-4806-8638-57f0802c87b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:43.725677 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126bae89-fdee-4806-8638-57f0802c87b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:43.727275 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126bae89-fdee-4806-8638-57f0802c87b0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:43.738756 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1524/3008] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 12:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:17:43.743220 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10d5cc-345d-41c0-9b74-8dfa4115846d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:43.754467 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10d5cc-345d-41c0-9b74-8dfa4115846d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:43.760016 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32521511-cf64-4a43-a6ed-52234f33dded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:43.760979 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32521511-cf64-4a43-a6ed-52234f33dded admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:43.761251 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32521511-cf64-4a43-a6ed-52234f33dded admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:43.761537 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32521511-cf64-4a43-a6ed-52234f33dded admin admin] PATH_INFO: `/v3/projects/dc1790a4b2f94682aedbcd64569a0a92/users/91c553cdab96426baea8ed188e571c84/roles/6ff885694ad84e4cb935ef1c1f001858` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:43.778292 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32521511-cf64-4a43-a6ed-52234f33dded admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc1790a4b2f94682aedbcd64569a0a92, user_id=91c553cdab96426baea8ed188e571c84, role_id=6ff885694ad84e4cb935ef1c1f001858)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:43.781078 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32521511-cf64-4a43-a6ed-52234f33dded admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:43.796435 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1485/3009] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 12:17:43 2022] PUT /identity/v3/projects/dc1790a4b2f94682aedbcd64569a0a92/users/91c553cdab96426baea8ed188e571c84/roles/6ff885694ad84e4cb935ef1c1f001858 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:17:43.801771 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff498b32-0046-4194-adcd-299be15a03e4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:43.802066 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff498b32-0046-4194-adcd-299be15a03e4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:43.802348 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff498b32-0046-4194-adcd-299be15a03e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:43.820945 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ff498b32-0046-4194-adcd-299be15a03e4 None None] MFA Rules not processed for user `2c3f1716e28a48c696a1d4a7994e37ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:43.822178 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ff498b32-0046-4194-adcd-299be15a03e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:43.882737 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1525/3010] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 12:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:17:43.892551 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32521511-cf64-4a43-a6ed-52234f33dded admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:43.894669 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-32521511-cf64-4a43-a6ed-52234f33dded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:43.930287 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:43.956592 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32521511-cf64-4a43-a6ed-52234f33dded admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:43.960337 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cd83a-9924-4733-a7e7-dc459abe9df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:43.961034 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cd83a-9924-4733-a7e7-dc459abe9df4 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:43.961319 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cd83a-9924-4733-a7e7-dc459abe9df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:43.961589 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cd83a-9924-4733-a7e7-dc459abe9df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:43.970921 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505cd83a-9924-4733-a7e7-dc459abe9df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:43.972362 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505cd83a-9924-4733-a7e7-dc459abe9df4 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:43.982016 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1486/3011] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:17:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:17:48.194594 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b392e-c708-4e76-9e75-76a10122334b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:48.195044 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b392e-c708-4e76-9e75-76a10122334b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:48.195044 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b392e-c708-4e76-9e75-76a10122334b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:48.201148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:48.235152 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5a2b392e-c708-4e76-9e75-76a10122334b None None] MFA Rules not processed for user `91c553cdab96426baea8ed188e571c84`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:48.236449 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5a2b392e-c708-4e76-9e75-76a10122334b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:48.305802 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1526/3012] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 12:17:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:17:48.310166 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cd83a-9924-4733-a7e7-dc459abe9df4 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:48.321297 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cd83a-9924-4733-a7e7-dc459abe9df4 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:48.326117 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec12720-e1a0-4cb0-82ec-e0f906f770dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:48.326836 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec12720-e1a0-4cb0-82ec-e0f906f770dd admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:48.327118 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec12720-e1a0-4cb0-82ec-e0f906f770dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:48.327422 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec12720-e1a0-4cb0-82ec-e0f906f770dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:48.328132 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec12720-e1a0-4cb0-82ec-e0f906f770dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:48.330099 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec12720-e1a0-4cb0-82ec-e0f906f770dd admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:48.359872 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1487/3013] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jul 19 12:17:48 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:17:48.363725 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b392e-c708-4e76-9e75-76a10122334b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:48.375680 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b392e-c708-4e76-9e75-76a10122334b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:48.440201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d86d49-fc0d-48a3-b3fd-c93998877e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:48.440934 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d86d49-fc0d-48a3-b3fd-c93998877e88 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:48.441215 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d86d49-fc0d-48a3-b3fd-c93998877e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:48.441500 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d86d49-fc0d-48a3-b3fd-c93998877e88 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:48.442201 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d86d49-fc0d-48a3-b3fd-c93998877e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:48.444144 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d86d49-fc0d-48a3-b3fd-c93998877e88 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:48.477578 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1527/3014] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jul 19 12:17:48 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:17:48.478033 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec12720-e1a0-4cb0-82ec-e0f906f770dd admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:48.497331 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec12720-e1a0-4cb0-82ec-e0f906f770dd admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:48.503012 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a54180-32a2-4d01-9a20-0d53863636a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:48.503900 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a54180-32a2-4d01-9a20-0d53863636a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:48.504183 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a54180-32a2-4d01-9a20-0d53863636a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:48.504459 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a54180-32a2-4d01-9a20-0d53863636a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:48.505308 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a54180-32a2-4d01-9a20-0d53863636a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:48.507018 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a54180-32a2-4d01-9a20-0d53863636a6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:48.521159 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1488/3015] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 12:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:17:48.525635 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d86d49-fc0d-48a3-b3fd-c93998877e88 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:48.536599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d86d49-fc0d-48a3-b3fd-c93998877e88 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:48.541867 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31598037-79c4-4ed3-ae20-c6c5ec9443ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:48.542776 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31598037-79c4-4ed3-ae20-c6c5ec9443ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:48.543053 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31598037-79c4-4ed3-ae20-c6c5ec9443ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:48.543323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31598037-79c4-4ed3-ae20-c6c5ec9443ab admin admin] PATH_INFO: `/v3/projects/00ef52dec9014d749b2482980c83a9ea/users/71de75bf9b1d44c99425e3aa5f060d09/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:48.560301 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31598037-79c4-4ed3-ae20-c6c5ec9443ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=00ef52dec9014d749b2482980c83a9ea, user_id=71de75bf9b1d44c99425e3aa5f060d09, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:48.563224 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31598037-79c4-4ed3-ae20-c6c5ec9443ab admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:48.578126 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1528/3016] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 12:17:48 2022] PUT /identity/v3/projects/00ef52dec9014d749b2482980c83a9ea/users/71de75bf9b1d44c99425e3aa5f060d09/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:17:48.582334 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a54180-32a2-4d01-9a20-0d53863636a6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:48.592399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a54180-32a2-4d01-9a20-0d53863636a6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:48.653857 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be71f8-abc9-48c9-9297-5f5e417e5497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:48.654571 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be71f8-abc9-48c9-9297-5f5e417e5497 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:48.654847 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be71f8-abc9-48c9-9297-5f5e417e5497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:48.655119 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be71f8-abc9-48c9-9297-5f5e417e5497 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:48.655842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be71f8-abc9-48c9-9297-5f5e417e5497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:48.657489 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be71f8-abc9-48c9-9297-5f5e417e5497 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:48.667638 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1489/3017] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jul 19 12:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:17:48.672117 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31598037-79c4-4ed3-ae20-c6c5ec9443ab admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:48.684559 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31598037-79c4-4ed3-ae20-c6c5ec9443ab admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:48.690623 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bc9c6-ab33-400f-980e-a79d0cfa40ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:48.691567 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bc9c6-ab33-400f-980e-a79d0cfa40ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:48.691849 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bc9c6-ab33-400f-980e-a79d0cfa40ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:48.692231 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bc9c6-ab33-400f-980e-a79d0cfa40ba admin admin] PATH_INFO: `/v3/projects/00ef52dec9014d749b2482980c83a9ea/users/71de75bf9b1d44c99425e3aa5f060d09/roles/3f9528e7a7914797a4635aa6b536b7ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:48.697507 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210bc9c6-ab33-400f-980e-a79d0cfa40ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=00ef52dec9014d749b2482980c83a9ea, user_id=71de75bf9b1d44c99425e3aa5f060d09, role_id=3f9528e7a7914797a4635aa6b536b7ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:48.701073 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210bc9c6-ab33-400f-980e-a79d0cfa40ba admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:48.714030 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1529/3018] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jul 19 12:17:48 2022] PUT /identity/v3/projects/00ef52dec9014d749b2482980c83a9ea/users/71de75bf9b1d44c99425e3aa5f060d09/roles/3f9528e7a7914797a4635aa6b536b7ff => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:17:53.220217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae3925-aeab-4ba5-9014-55e3e2d436b7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:53.220990 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae3925-aeab-4ba5-9014-55e3e2d436b7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:53.221328 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae3925-aeab-4ba5-9014-55e3e2d436b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:53.262573 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d7ae3925-aeab-4ba5-9014-55e3e2d436b7 None None] MFA Rules not processed for user `71de75bf9b1d44c99425e3aa5f060d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:53.263993 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d7ae3925-aeab-4ba5-9014-55e3e2d436b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:53.357992 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1490/3019] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 12:17:53 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:17:53.375299 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bc9c6-ab33-400f-980e-a79d0cfa40ba admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:53.377694 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-210bc9c6-ab33-400f-980e-a79d0cfa40ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:53.454733 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:53.525421 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bc9c6-ab33-400f-980e-a79d0cfa40ba admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:53.531489 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a6dba-a12c-4b76-9f11-13dc65067d05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:53.532163 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a6dba-a12c-4b76-9f11-13dc65067d05 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:53.532447 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a6dba-a12c-4b76-9f11-13dc65067d05 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:53.532742 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a6dba-a12c-4b76-9f11-13dc65067d05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:53.609861 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a6dba-a12c-4b76-9f11-13dc65067d05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:53.611557 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a6dba-a12c-4b76-9f11-13dc65067d05 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:53.621817 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1530/3020] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:17:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:17:54.736683 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba69a4e-4e7d-4578-b47f-9805d37e2a19 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:54.737762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba69a4e-4e7d-4578-b47f-9805d37e2a19 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:54.738301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba69a4e-4e7d-4578-b47f-9805d37e2a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:54.758654 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4ba69a4e-4e7d-4578-b47f-9805d37e2a19 None None] MFA Rules not processed for user `91c553cdab96426baea8ed188e571c84`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:54.759944 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4ba69a4e-4e7d-4578-b47f-9805d37e2a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:54.771269 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1491/3021] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 12:17:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:18:00.028252 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a6dba-a12c-4b76-9f11-13dc65067d05 service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:00.029883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-690a6dba-a12c-4b76-9f11-13dc65067d05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:00.113924 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a6dba-a12c-4b76-9f11-13dc65067d05 service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:00.119624 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6b57d-ec34-4c5b-9bce-2594970768d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:00.120275 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6b57d-ec34-4c5b-9bce-2594970768d6 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:00.120554 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6b57d-ec34-4c5b-9bce-2594970768d6 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:00.120866 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6b57d-ec34-4c5b-9bce-2594970768d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:00.122868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e2c6b57d-ec34-4c5b-9bce-2594970768d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:00.135040 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6b57d-ec34-4c5b-9bce-2594970768d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:00.136607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6b57d-ec34-4c5b-9bce-2594970768d6 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:00.146426 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1531/3022] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:18:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:18:02.231494 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba69a4e-4e7d-4578-b47f-9805d37e2a19 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:02.233753 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4ba69a4e-4e7d-4578-b47f-9805d37e2a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:02.263602 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba69a4e-4e7d-4578-b47f-9805d37e2a19 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:02.271136 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a98e0-c28a-4245-be75-800c94a3c6a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:02.272410 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a98e0-c28a-4245-be75-800c94a3c6a0 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:02.272928 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a98e0-c28a-4245-be75-800c94a3c6a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:02.273385 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a98e0-c28a-4245-be75-800c94a3c6a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:02.275617 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-573a98e0-c28a-4245-be75-800c94a3c6a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:02.293394 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a98e0-c28a-4245-be75-800c94a3c6a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:02.295357 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a98e0-c28a-4245-be75-800c94a3c6a0 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:02.327964 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1492/3023] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:18:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:18:08.770514 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6b57d-ec34-4c5b-9bce-2594970768d6 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:08.783566 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6b57d-ec34-4c5b-9bce-2594970768d6 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:08.790110 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a612d4-9f6a-46e5-b1ce-e10034322903 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:08.790781 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a612d4-9f6a-46e5-b1ce-e10034322903 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:08.791067 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a612d4-9f6a-46e5-b1ce-e10034322903 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:08.791348 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a612d4-9f6a-46e5-b1ce-e10034322903 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:08.793238 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-18a612d4-9f6a-46e5-b1ce-e10034322903 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:08.805777 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a612d4-9f6a-46e5-b1ce-e10034322903 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:08.807385 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a612d4-9f6a-46e5-b1ce-e10034322903 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:08.818629 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1532/3024] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:18:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:18:11.208083 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a98e0-c28a-4245-be75-800c94a3c6a0 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:11.209572 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-573a98e0-c28a-4245-be75-800c94a3c6a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:11.214641 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:11.271267 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a98e0-c28a-4245-be75-800c94a3c6a0 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:11.275197 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc38b8-9f81-4778-8581-8750c395799b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:11.275856 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc38b8-9f81-4778-8581-8750c395799b service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:11.276144 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc38b8-9f81-4778-8581-8750c395799b service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:11.276415 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc38b8-9f81-4778-8581-8750c395799b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:11.286086 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc38b8-9f81-4778-8581-8750c395799b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:11.287525 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc38b8-9f81-4778-8581-8750c395799b service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:11.297094 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1493/3025] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:18:11 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:18:18.813809 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=86 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:21.292865 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=25 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:25.697612 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a612d4-9f6a-46e5-b1ce-e10034322903 service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:25.713707 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a612d4-9f6a-46e5-b1ce-e10034322903 service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:25.720270 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962bfa9-c4f6-4e18-b5f5-34f52114ab6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:25.720970 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962bfa9-c4f6-4e18-b5f5-34f52114ab6f service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:25.721213 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962bfa9-c4f6-4e18-b5f5-34f52114ab6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:25.721519 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962bfa9-c4f6-4e18-b5f5-34f52114ab6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:25.723704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f962bfa9-c4f6-4e18-b5f5-34f52114ab6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:25.734860 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962bfa9-c4f6-4e18-b5f5-34f52114ab6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:25.737248 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962bfa9-c4f6-4e18-b5f5-34f52114ab6f service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:25.750079 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1533/3026] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:19:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:19:35.743831 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:40.300321 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ae46d-8405-4b8b-b027-553690fbb4e7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:40.301068 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ae46d-8405-4b8b-b027-553690fbb4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:40.301068 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ae46d-8405-4b8b-b027-553690fbb4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:40.368605 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d00ae46d-8405-4b8b-b027-553690fbb4e7 None None] MFA Rules not processed for user `d1bcfbee5a5e4016a77901d0a637da63`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:20:40.369905 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d00ae46d-8405-4b8b-b027-553690fbb4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:20:40.436301 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1494/3027] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Jul 19 12:20:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:20:40.442625 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962bfa9-c4f6-4e18-b5f5-34f52114ab6f service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:40.452261 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962bfa9-c4f6-4e18-b5f5-34f52114ab6f service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:40.455901 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d8788-5f63-4da6-902f-72e6aaeef553 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bcfbee5a5e4016a77901d0a637da63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:40.456550 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d8788-5f63-4da6-902f-72e6aaeef553 service glance] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:40.456862 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d8788-5f63-4da6-902f-72e6aaeef553 service glance] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:40.457136 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d8788-5f63-4da6-902f-72e6aaeef553 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:40.458922 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-520d8788-5f63-4da6-902f-72e6aaeef553 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:20:40.472642 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d8788-5f63-4da6-902f-72e6aaeef553 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:40.474107 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d8788-5f63-4da6-902f-72e6aaeef553 service glance] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:40.485451 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1534/3028] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:20:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:20:50.257567 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959746c8-5908-48ab-8822-14a37564e911 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:50.258217 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959746c8-5908-48ab-8822-14a37564e911 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:50.258450 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959746c8-5908-48ab-8822-14a37564e911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:50.319263 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-959746c8-5908-48ab-8822-14a37564e911 None None] MFA Rules not processed for user `654631b067b94b269f93ea7b3977609d`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:20:50.320900 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-959746c8-5908-48ab-8822-14a37564e911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:20:50.414334 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1495/3029] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 19 12:20:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:20:50.470883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d8788-5f63-4da6-902f-72e6aaeef553 service glance] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:50.473753 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-520d8788-5f63-4da6-902f-72e6aaeef553 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:20:50.580925 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d8788-5f63-4da6-902f-72e6aaeef553 service glance] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:50.586947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a36055-cb51-40c4-9bf1-cc5cf5b88b03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa6a9aa611640f893b5e717a094acf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:50.587620 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a36055-cb51-40c4-9bf1-cc5cf5b88b03 service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:50.587899 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a36055-cb51-40c4-9bf1-cc5cf5b88b03 service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:50.588173 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a36055-cb51-40c4-9bf1-cc5cf5b88b03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:50.597520 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a36055-cb51-40c4-9bf1-cc5cf5b88b03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:50.599148 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a36055-cb51-40c4-9bf1-cc5cf5b88b03 service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:50.608619 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1535/3030] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 19 12:20:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:20:59.379317 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1e94c-c7d0-410a-a84f-332491d1a68a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:59.379902 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1e94c-c7d0-410a-a84f-332491d1a68a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:59.379902 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1e94c-c7d0-410a-a84f-332491d1a68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:59.407633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ccc1e94c-c7d0-410a-a84f-332491d1a68a None None] MFA Rules not processed for user `91c553cdab96426baea8ed188e571c84`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:20:59.408732 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ccc1e94c-c7d0-410a-a84f-332491d1a68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:20:59.417107 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1496/3031] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jul 19 12:20:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:20:59.748771 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a36055-cb51-40c4-9bf1-cc5cf5b88b03 service swift] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:59.759134 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a36055-cb51-40c4-9bf1-cc5cf5b88b03 service swift] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:59.763448 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b8418-b8b6-49c1-837a-f295622bfac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:59.764098 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b8418-b8b6-49c1-837a-f295622bfac5 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:59.764495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b8418-b8b6-49c1-837a-f295622bfac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:59.764797 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b8418-b8b6-49c1-837a-f295622bfac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:59.766645 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d16b8418-b8b6-49c1-837a-f295622bfac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:20:59.776139 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b8418-b8b6-49c1-837a-f295622bfac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:59.777607 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b8418-b8b6-49c1-837a-f295622bfac5 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:59.785764 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1536/3032] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:20:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:21:00.139148 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1e94c-c7d0-410a-a84f-332491d1a68a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:00.152114 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1e94c-c7d0-410a-a84f-332491d1a68a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:00.157591 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b8418-b8b6-49c1-837a-f295622bfac5 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:00.158553 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f07cf-2d5f-4076-892c-ea3c38f19ff7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:00.159285 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f07cf-2d5f-4076-892c-ea3c38f19ff7 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:00.159632 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f07cf-2d5f-4076-892c-ea3c38f19ff7 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:00.159982 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f07cf-2d5f-4076-892c-ea3c38f19ff7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:00.161939 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c28f07cf-2d5f-4076-892c-ea3c38f19ff7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:21:00.167746 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b8418-b8b6-49c1-837a-f295622bfac5 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:00.171534 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6861d0a-5eed-4a4d-82c4-83503689048d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:00.172183 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6861d0a-5eed-4a4d-82c4-83503689048d service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:00.172466 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6861d0a-5eed-4a4d-82c4-83503689048d service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:00.172827 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6861d0a-5eed-4a4d-82c4-83503689048d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:00.174686 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f6861d0a-5eed-4a4d-82c4-83503689048d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:21:00.174814 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f07cf-2d5f-4076-892c-ea3c38f19ff7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:00.176343 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f07cf-2d5f-4076-892c-ea3c38f19ff7 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:00.186641 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1497/3033] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:21:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:21:00.188140 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6861d0a-5eed-4a4d-82c4-83503689048d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:00.189611 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6861d0a-5eed-4a4d-82c4-83503689048d service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:00.201423 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1537/3034] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:21:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:21:01.525403 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ded82b-c84b-464e-b541-5071acbff207 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:01.525949 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ded82b-c84b-464e-b541-5071acbff207 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:01.526072 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ded82b-c84b-464e-b541-5071acbff207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:01.532938 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:01.546597 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-36ded82b-c84b-464e-b541-5071acbff207 None None] MFA Rules not processed for user `654631b067b94b269f93ea7b3977609d`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:21:01.547834 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-36ded82b-c84b-464e-b541-5071acbff207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:21:01.556878 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1498/3035] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 19 12:21:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:21:01.571602 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6861d0a-5eed-4a4d-82c4-83503689048d service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:01.585187 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6861d0a-5eed-4a4d-82c4-83503689048d service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:01.590979 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a0a01-2eca-440b-b86d-e487200a976c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa6a9aa611640f893b5e717a094acf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:01.591729 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a0a01-2eca-440b-b86d-e487200a976c service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:01.592049 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a0a01-2eca-440b-b86d-e487200a976c service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:01.592327 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a0a01-2eca-440b-b86d-e487200a976c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:01.601710 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a0a01-2eca-440b-b86d-e487200a976c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:01.603287 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a0a01-2eca-440b-b86d-e487200a976c service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:01.611575 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1538/3036] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 19 12:21:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:21:11.542913 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:11.608441 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=65 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:24.992028 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ded82b-c84b-464e-b541-5071acbff207 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:25.005779 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ded82b-c84b-464e-b541-5071acbff207 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:25.011899 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbf075-d64b-46ec-8b7a-07a7a4cbb040 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:25.012484 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbf075-d64b-46ec-8b7a-07a7a4cbb040 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:25.012823 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbf075-d64b-46ec-8b7a-07a7a4cbb040 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:25.013093 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbf075-d64b-46ec-8b7a-07a7a4cbb040 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:25.023017 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbf075-d64b-46ec-8b7a-07a7a4cbb040 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:25.025612 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbf075-d64b-46ec-8b7a-07a7a4cbb040 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:25.043284 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1499/3037] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:23:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:23:35.036067 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:37.140323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a0a01-2eca-440b-b86d-e487200a976c service swift] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:37.152939 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a0a01-2eca-440b-b86d-e487200a976c service swift] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:37.159138 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c304f-887c-4873-b082-7b14a26e5704 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:37.159917 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c304f-887c-4873-b082-7b14a26e5704 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:37.160197 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c304f-887c-4873-b082-7b14a26e5704 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:37.160484 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c304f-887c-4873-b082-7b14a26e5704 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:37.172323 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c304f-887c-4873-b082-7b14a26e5704 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:37.173966 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c304f-887c-4873-b082-7b14a26e5704 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:37.183495 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1539/3038] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:23:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:23:44.810331 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbf075-d64b-46ec-8b7a-07a7a4cbb040 service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:44.823633 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbf075-d64b-46ec-8b7a-07a7a4cbb040 service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:44.829158 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac6481-be0b-46da-a2e6-f82e7aebb14a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:44.829816 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac6481-be0b-46da-a2e6-f82e7aebb14a service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:44.830104 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac6481-be0b-46da-a2e6-f82e7aebb14a service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:44.830380 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac6481-be0b-46da-a2e6-f82e7aebb14a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:44.839863 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac6481-be0b-46da-a2e6-f82e7aebb14a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:44.841334 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac6481-be0b-46da-a2e6-f82e7aebb14a service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:44.852508 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1500/3039] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:23:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:23:46.785841 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8c205-2e49-4739-96c3-b7d81ce00044 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:46.786575 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8c205-2e49-4739-96c3-b7d81ce00044 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:46.786575 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8c205-2e49-4739-96c3-b7d81ce00044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:46.805707 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-67b8c205-2e49-4739-96c3-b7d81ce00044 None None] MFA Rules not processed for user `654631b067b94b269f93ea7b3977609d`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:46.807263 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-67b8c205-2e49-4739-96c3-b7d81ce00044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:46.817051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1540/3040] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 19 12:23:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:46.865356 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac6481-be0b-46da-a2e6-f82e7aebb14a service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:46.877782 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac6481-be0b-46da-a2e6-f82e7aebb14a service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:46.885535 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed211ec8-86fb-4d61-a38e-4ff3138e70c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa6a9aa611640f893b5e717a094acf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:46.886491 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed211ec8-86fb-4d61-a38e-4ff3138e70c4 service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:46.886842 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed211ec8-86fb-4d61-a38e-4ff3138e70c4 service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:46.887223 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed211ec8-86fb-4d61-a38e-4ff3138e70c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:46.896834 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed211ec8-86fb-4d61-a38e-4ff3138e70c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:46.898438 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed211ec8-86fb-4d61-a38e-4ff3138e70c4 service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:46.906742 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1501/3041] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 19 12:23:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:23:56.051733 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad20597-3fd9-4a5e-89e9-b9970e9e68ae None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:56.052324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad20597-3fd9-4a5e-89e9-b9970e9e68ae None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:56.052324 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad20597-3fd9-4a5e-89e9-b9970e9e68ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:56.071807 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9ad20597-3fd9-4a5e-89e9-b9970e9e68ae None None] MFA Rules not processed for user `654631b067b94b269f93ea7b3977609d`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:56.073034 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9ad20597-3fd9-4a5e-89e9-b9970e9e68ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:56.081409 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1541/3042] 10.222.0.18 () {58 vars in 967 bytes} [Tue Jul 19 12:23:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:56.094127 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed211ec8-86fb-4d61-a38e-4ff3138e70c4 service swift] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:56.105399 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed211ec8-86fb-4d61-a38e-4ff3138e70c4 service swift] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:56.112262 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865073a-78c4-4afc-ba1b-0bc0587c169e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa6a9aa611640f893b5e717a094acf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:56.112948 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865073a-78c4-4afc-ba1b-0bc0587c169e service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:56.113254 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865073a-78c4-4afc-ba1b-0bc0587c169e service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:56.113496 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865073a-78c4-4afc-ba1b-0bc0587c169e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:56.122328 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865073a-78c4-4afc-ba1b-0bc0587c169e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:56.123941 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865073a-78c4-4afc-ba1b-0bc0587c169e service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:56.132465 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1502/3043] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 19 12:23:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:23:57.682425 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad20597-3fd9-4a5e-89e9-b9970e9e68ae None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:57.697040 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad20597-3fd9-4a5e-89e9-b9970e9e68ae None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:57.703279 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b3b01-062a-4ebc-879d-c9216578d6b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:57.704088 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b3b01-062a-4ebc-879d-c9216578d6b0 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:57.704352 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b3b01-062a-4ebc-879d-c9216578d6b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:57.704634 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b3b01-062a-4ebc-879d-c9216578d6b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:57.714869 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b3b01-062a-4ebc-879d-c9216578d6b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:57.716736 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b3b01-062a-4ebc-879d-c9216578d6b0 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:57.727988 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1542/3044] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:23:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:00.213947 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865073a-78c4-4afc-ba1b-0bc0587c169e service swift] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:00.227307 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865073a-78c4-4afc-ba1b-0bc0587c169e service swift] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:00.233264 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a7747-c87f-4bff-8ffb-da5eb6129db3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c50a821e9ef44cb9fccd49ee4af7dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:00.233961 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a7747-c87f-4bff-8ffb-da5eb6129db3 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:00.234426 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a7747-c87f-4bff-8ffb-da5eb6129db3 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:00.234859 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a7747-c87f-4bff-8ffb-da5eb6129db3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:00.237044 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-462a7747-c87f-4bff-8ffb-da5eb6129db3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:00.251743 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a7747-c87f-4bff-8ffb-da5eb6129db3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:00.253454 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a7747-c87f-4bff-8ffb-da5eb6129db3 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:00.265918 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1503/3045] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:01.355680 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41286ecf-1a82-43c3-9e8d-c8f701bc62e5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:01.356164 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41286ecf-1a82-43c3-9e8d-c8f701bc62e5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:01.356265 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41286ecf-1a82-43c3-9e8d-c8f701bc62e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:01.375132 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-41286ecf-1a82-43c3-9e8d-c8f701bc62e5 None None] MFA Rules not processed for user `654631b067b94b269f93ea7b3977609d`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:01.376691 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-41286ecf-1a82-43c3-9e8d-c8f701bc62e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:01.385655 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1543/3046] 10.222.0.18 () {58 vars in 967 bytes} [Tue Jul 19 12:24:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:24:01.398265 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a7747-c87f-4bff-8ffb-da5eb6129db3 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:01.409620 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a7747-c87f-4bff-8ffb-da5eb6129db3 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:01.415018 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656e9d9-ac1b-487c-9ecc-22776edf78b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa6a9aa611640f893b5e717a094acf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:01.415645 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656e9d9-ac1b-487c-9ecc-22776edf78b6 service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:01.415930 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656e9d9-ac1b-487c-9ecc-22776edf78b6 service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:01.416204 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656e9d9-ac1b-487c-9ecc-22776edf78b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:01.424762 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656e9d9-ac1b-487c-9ecc-22776edf78b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:01.426541 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656e9d9-ac1b-487c-9ecc-22776edf78b6 service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:01.438316 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1504/3047] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 19 12:24:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:24:05.956895 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41286ecf-1a82-43c3-9e8d-c8f701bc62e5 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:05.962051 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=22 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:05.969194 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41286ecf-1a82-43c3-9e8d-c8f701bc62e5 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:05.973672 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98050503-00f5-4c8a-b112-dfc90148bbdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07eaacc831ae481d99e8ab03ee295e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:05.974342 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98050503-00f5-4c8a-b112-dfc90148bbdf service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:05.974621 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98050503-00f5-4c8a-b112-dfc90148bbdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:05.974892 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98050503-00f5-4c8a-b112-dfc90148bbdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:06.036929 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98050503-00f5-4c8a-b112-dfc90148bbdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:06.038389 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98050503-00f5-4c8a-b112-dfc90148bbdf service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:06.048380 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1544/3048] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:08.990144 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656e9d9-ac1b-487c-9ecc-22776edf78b6 service swift] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:08.992793 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5656e9d9-ac1b-487c-9ecc-22776edf78b6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:08.999278 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=31 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:09.034045 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656e9d9-ac1b-487c-9ecc-22776edf78b6 service swift] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:09.039171 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78acf1-778c-4a3d-852b-d557cdb733a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:09.039861 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78acf1-778c-4a3d-852b-d557cdb733a8 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:09.040123 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78acf1-778c-4a3d-852b-d557cdb733a8 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:09.040579 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78acf1-778c-4a3d-852b-d557cdb733a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:09.045611 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fc78acf1-778c-4a3d-852b-d557cdb733a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:09.060943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78acf1-778c-4a3d-852b-d557cdb733a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:09.062652 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78acf1-778c-4a3d-852b-d557cdb733a8 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:09.108387 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1505/3049] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:12.417116 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98050503-00f5-4c8a-b112-dfc90148bbdf service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:12.429235 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98050503-00f5-4c8a-b112-dfc90148bbdf service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:12.435109 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a16d2b-c025-41cb-90fe-435d715723c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:12.435914 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a16d2b-c025-41cb-90fe-435d715723c4 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:12.436402 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a16d2b-c025-41cb-90fe-435d715723c4 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:12.436868 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a16d2b-c025-41cb-90fe-435d715723c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:12.439011 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e5a16d2b-c025-41cb-90fe-435d715723c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:12.453042 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a16d2b-c025-41cb-90fe-435d715723c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:12.454918 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a16d2b-c025-41cb-90fe-435d715723c4 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:12.466507 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1545/3050] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:12.472637 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78acf1-778c-4a3d-852b-d557cdb733a8 service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:12.489844 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78acf1-778c-4a3d-852b-d557cdb733a8 service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:12.494785 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90e3da-44e9-49c6-9961-66c6dda1e85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:12.495737 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90e3da-44e9-49c6-9961-66c6dda1e85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:12.496087 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90e3da-44e9-49c6-9961-66c6dda1e85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:12.496360 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90e3da-44e9-49c6-9961-66c6dda1e85c admin admin] PATH_INFO: `/v3/users/91c553cdab96426baea8ed188e571c84` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:12.499635 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90e3da-44e9-49c6-9961-66c6dda1e85c admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c553cdab96426baea8ed188e571c84)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:12.502048 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90e3da-44e9-49c6-9961-66c6dda1e85c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:12.553459 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8b90e3da-44e9-49c6-9961-66c6dda1e85c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c553cdab96426baea8ed188e571c84'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:24:12.562100 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8b90e3da-44e9-49c6-9961-66c6dda1e85c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c553cdab96426baea8ed188e571c84'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:24:12.576307 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8b90e3da-44e9-49c6-9961-66c6dda1e85c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c553cdab96426baea8ed188e571c84'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:24:12.577096 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8b90e3da-44e9-49c6-9961-66c6dda1e85c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c553cdab96426baea8ed188e571c84'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:24:12.584747 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8b90e3da-44e9-49c6-9961-66c6dda1e85c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c553cdab96426baea8ed188e571c84'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:24:12.591167 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1506/3051] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 12:24:12 2022] DELETE /identity/v3/users/91c553cdab96426baea8ed188e571c84 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:24:12.774234 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a16d2b-c025-41cb-90fe-435d715723c4 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:12.785306 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a16d2b-c025-41cb-90fe-435d715723c4 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:12.842829 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a5685-abb8-4986-adda-c301ddcf1efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:12.843704 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a5685-abb8-4986-adda-c301ddcf1efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:12.843965 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a5685-abb8-4986-adda-c301ddcf1efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:12.844235 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a5685-abb8-4986-adda-c301ddcf1efb admin admin] PATH_INFO: `/v3/projects/dc1790a4b2f94682aedbcd64569a0a92` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:12.845436 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a5685-abb8-4986-adda-c301ddcf1efb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc1790a4b2f94682aedbcd64569a0a92)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:12.847328 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a5685-abb8-4986-adda-c301ddcf1efb admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:12.897040 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-034a5685-abb8-4986-adda-c301ddcf1efb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc1790a4b2f94682aedbcd64569a0a92', 'request_id': 'req-034a5685-abb8-4986-adda-c301ddcf1efb'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:24:12.903829 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-034a5685-abb8-4986-adda-c301ddcf1efb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc1790a4b2f94682aedbcd64569a0a92', 'request_id': 'req-034a5685-abb8-4986-adda-c301ddcf1efb'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:24:12.910001 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-034a5685-abb8-4986-adda-c301ddcf1efb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc1790a4b2f94682aedbcd64569a0a92', 'request_id': 'req-034a5685-abb8-4986-adda-c301ddcf1efb'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:24:12.924599 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-034a5685-abb8-4986-adda-c301ddcf1efb admin admin] The token cache is being invalidate because project dc1790a4b2f94682aedbcd64569a0a92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:24:12.924927 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-034a5685-abb8-4986-adda-c301ddcf1efb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:24:12.925564 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-034a5685-abb8-4986-adda-c301ddcf1efb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:24:12.927501 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1546/3052] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 12:24:12 2022] DELETE /identity/v3/projects/dc1790a4b2f94682aedbcd64569a0a92 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:24:12.931471 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90e3da-44e9-49c6-9961-66c6dda1e85c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:12.933111 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8b90e3da-44e9-49c6-9961-66c6dda1e85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:12.947207 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90e3da-44e9-49c6-9961-66c6dda1e85c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:13.010105 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080bdeb-cf8a-4eea-8bf7-f62b0e22b1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:13.011018 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080bdeb-cf8a-4eea-8bf7-f62b0e22b1f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:13.011297 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080bdeb-cf8a-4eea-8bf7-f62b0e22b1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:13.011599 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080bdeb-cf8a-4eea-8bf7-f62b0e22b1f6 admin admin] PATH_INFO: `/v3/users/71de75bf9b1d44c99425e3aa5f060d09` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:13.012855 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9080bdeb-cf8a-4eea-8bf7-f62b0e22b1f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71de75bf9b1d44c99425e3aa5f060d09)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:13.014812 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9080bdeb-cf8a-4eea-8bf7-f62b0e22b1f6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:13.063147 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9080bdeb-cf8a-4eea-8bf7-f62b0e22b1f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71de75bf9b1d44c99425e3aa5f060d09'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:24:13.066771 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:13.072377 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9080bdeb-cf8a-4eea-8bf7-f62b0e22b1f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71de75bf9b1d44c99425e3aa5f060d09'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:24:13.086050 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9080bdeb-cf8a-4eea-8bf7-f62b0e22b1f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71de75bf9b1d44c99425e3aa5f060d09'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:24:13.086770 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9080bdeb-cf8a-4eea-8bf7-f62b0e22b1f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71de75bf9b1d44c99425e3aa5f060d09'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:24:13.094830 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9080bdeb-cf8a-4eea-8bf7-f62b0e22b1f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71de75bf9b1d44c99425e3aa5f060d09'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:24:13.101446 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1507/3053] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jul 19 12:24:12 2022] DELETE /identity/v3/users/71de75bf9b1d44c99425e3aa5f060d09 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:24:13.294252 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a5685-abb8-4986-adda-c301ddcf1efb admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:13.296344 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-034a5685-abb8-4986-adda-c301ddcf1efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:13.316740 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a5685-abb8-4986-adda-c301ddcf1efb admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:13.330009 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:13.384703 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a4fd3-b097-4a66-9026-a57d60074c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c3f1716e28a48c696a1d4a7994e37ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f39c75cf6e84472a01d3e6114767933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:13.386013 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a4fd3-b097-4a66-9026-a57d60074c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:13.386429 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a4fd3-b097-4a66-9026-a57d60074c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:13.386688 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a4fd3-b097-4a66-9026-a57d60074c33 admin admin] PATH_INFO: `/v3/projects/00ef52dec9014d749b2482980c83a9ea` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:13.388505 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a4fd3-b097-4a66-9026-a57d60074c33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00ef52dec9014d749b2482980c83a9ea)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:13.391465 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a4fd3-b097-4a66-9026-a57d60074c33 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:13.443006 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-163a4fd3-b097-4a66-9026-a57d60074c33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00ef52dec9014d749b2482980c83a9ea', 'request_id': 'req-163a4fd3-b097-4a66-9026-a57d60074c33'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:24:13.450036 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-163a4fd3-b097-4a66-9026-a57d60074c33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00ef52dec9014d749b2482980c83a9ea', 'request_id': 'req-163a4fd3-b097-4a66-9026-a57d60074c33'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:24:13.455883 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-163a4fd3-b097-4a66-9026-a57d60074c33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00ef52dec9014d749b2482980c83a9ea', 'request_id': 'req-163a4fd3-b097-4a66-9026-a57d60074c33'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:24:13.470447 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-163a4fd3-b097-4a66-9026-a57d60074c33 admin admin] The token cache is being invalidate because project 00ef52dec9014d749b2482980c83a9ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:24:13.470735 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-163a4fd3-b097-4a66-9026-a57d60074c33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:24:13.471366 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-163a4fd3-b097-4a66-9026-a57d60074c33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:24:13.472947 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1547/3054] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jul 19 12:24:13 2022] DELETE /identity/v3/projects/00ef52dec9014d749b2482980c83a9ea => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:24:23.097562 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=12,keystone:DELETE=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:23.467150 dv-neutron-master-2-hyperv devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:28:31.923223 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080bdeb-cf8a-4eea-8bf7-f62b0e22b1f6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:28:31.924959 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9080bdeb-cf8a-4eea-8bf7-f62b0e22b1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:28:32.070166 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080bdeb-cf8a-4eea-8bf7-f62b0e22b1f6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:28:32.134959 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afeff2b-71df-4ca9-8a1f-10ebf082fcd6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc3d4e645a3349e78452f67cbe79f052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789e54670f7c40ffb67f20478aba00f2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:28:32.135623 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeff2b-71df-4ca9-8a1f-10ebf082fcd6 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:28:32.135909 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeff2b-71df-4ca9-8a1f-10ebf082fcd6 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:28:32.136187 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeff2b-71df-4ca9-8a1f-10ebf082fcd6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:28:32.138345 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0afeff2b-71df-4ca9-8a1f-10ebf082fcd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:28:32.150532 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afeff2b-71df-4ca9-8a1f-10ebf082fcd6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:28:32.152125 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afeff2b-71df-4ca9-8a1f-10ebf082fcd6 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:28:32.161998 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1508/3055] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 19 12:28:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:28:42.157943 dv-neutron-master-2-hyperv devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=84 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}